At a Glance
- Tasks: Design and develop real-time data pipelines using AWS and Databricks technologies.
- Company: Join a leading tech organisation with a collaborative engineering culture.
- Benefits: Competitive salary, flexible work arrangements, and professional development opportunities.
- Other info: Work in a supportive environment with opportunities for career growth.
- Why this job: Tackle interesting technical challenges and make a genuine impact in data engineering.
- Qualifications: Experience with AWS, Kinesis, Python, and SQL required.
The predicted salary is between 126000 - 154000 $ per year.
AGSVA Security clearance required (Baseline - minimum).
We're partnering with a leading technology organisation who are looking for an experienced Data Engineer to join a collaborative engineering team delivering modern, cloud-based data solutions. This is an opportunity to work with a cutting-edge AWS and Databricks technology stack, designing and developing scalable, real-time data pipelines that process high volumes of data. If you're passionate about data engineering, enjoy working with streaming technologies and want to make a genuine technical impact, we'd love to hear from you.
The Opportunity
You’ll play a key role in building and optimising real‑time data pipelines, leveraging Amazon Kinesis, Databricks, Apache Spark and Delta Lake to deliver reliable, scalable data solutions. Working alongside experienced data engineers and cloud specialists, you’ll help develop robust streaming architectures, improve data-processing performance and contribute to the delivery of business‑critical data platforms. This is a genuinely hands‑on engineering position where you’ll have the opportunity to solve interesting technical challenges and work with modern cloud technologies.
What You’ll Be Doing
- Design, develop and maintain high-performance, real‑time data pipelines using Amazon Kinesis Data Streams and Kinesis Data Firehose.
- Build scalable streaming solutions using Databricks and Apache Spark Structured Streaming.
- Develop and optimise data ingestion into Delta Lake tables.
- Improve pipeline performance, reliability, latency and cost efficiency.
- Implement monitoring and alerting using AWS CloudWatch.
- Collaborate with engineering teams to integrate streaming and batch data solutions.
- Write clean, maintainable and testable Python and SQL code.
- Troubleshoot complex data‑processing challenges and continuously improve engineering practices.
What We’re Looking For
- Strong commercial experience with Amazon Kinesis Data Streams and/or Kinesis Data Firehose.
- Solid programming skills in Python and SQL.
- Hands‑on experience with Apache Spark Structured Streaming.
- Experience working with Databricks in a production environment.
- Good understanding of AWS services, including S3, IAM and CloudWatch.
- Experience designing scalable, reliable data pipelines.
- Strong analytical, troubleshooting and problem‑solving capabilities.
Nice to Have
- Experience with Delta Lake and Unity Catalog.
- Exposure to Apache Kafka or other event‑streaming technologies.
- Experience working with large‑scale enterprise data platforms.
Why This Opportunity?
- Modern technology stack: Work extensively with AWS, Kinesis, Databricks, Spark and Delta Lake.
- Interesting technical challenges: Build and optimise high-volume, real‑time data‑processing solutions.
- Flexibility: Enjoy flexible working arrangements that support work‑life balance.
- Professional development: Access training, certifications and opportunities to develop your technical expertise.
- Career progression: Join an organisation offering long‑term growth and exposure to impactful projects.
- Supportive environment: Collaborate with experienced engineers in an inclusive, technically focused team.
- Competitive remuneration: Attractive salary package and employee benefits.
Data Engineer in Canberra employer: Intrinzic
As a leading Australian FinTech, this organisation offers an exceptional work environment for Cloud Site Reliability Engineers, where innovation meets critical real-time payments infrastructure. Employees benefit from a collaborative culture that prioritises reliability and operational excellence, alongside opportunities for professional growth in a highly regulated and dynamic sector. With a focus on cutting-edge technologies like AWS and Kubernetes, team members are empowered to make impactful contributions while enjoying the advantages of working in vibrant Sydney.
