Data Engineer | Sydney, NSW
We are looking for an experienced Data Engineer (9–14 Years) to join a high-performing team delivering enterprise-scale data platforms and real-time data solutions on AWS.
Must Have Skills
- AWS Cloud Services
- Python & PySpark
- Apache Airflow (MWAA)
- SQL
- Amazon Redshift
- AWS SageMaker Unified Studio
- AWS Kinesis / Kafka (Real‐Time Streaming)
Key Responsibilities
- Design and develop scalable batch and real‐time data ingestion frameworks.
- Build and optimize data pipelines using AWS services and modern data engineering practices.
- Develop low‐latency streaming solutions using Kinesis, Kafka, or similar technologies.
- Implement data transformations, orchestration workflows, and monitoring solutions.
- Work with Data Warehouses, Data Lakes, and Lakehouse architectures.
- Collaborate with cross-functional teams to deliver robust and scalable data solutions.
Required Experience
- Strong expertise in AWS, Python, PySpark, Airflow, and Redshift.
- Hands‐on experience with SageMaker Unified Studio.
- Experience with relational and NoSQL databases (Oracle, MongoDB, DynamoDB, Snowflake, Teradata, etc.).
- Proven experience building real‐time and batch data pipelines.
- Knowledge of CI/CD, Git, Infrastructure as Code (Terraform/CloudFormation).
- Data Modelling experience is highly desirable.
Data Engineer-NSW in Sydney employer: The HR Ally
As a Security Testing Lead Specialist in Sydney or Melbourne, you'll join a dynamic team that prioritises innovation and professional growth. Our collaborative work culture fosters continuous learning and mentorship, ensuring you have the resources to excel in your role while contributing to high-stakes security assessments. With a commitment to employee well-being and a focus on aligning security practices with business objectives, we offer a rewarding environment where your expertise can make a significant impact.
