Location: Melbourne, VIC
Role Type: Permanent
Work Rights: Australian PR / Citizens preferred
Experience: 10+ years
If you are an experienced Azure Data Engineer with strong Databricks, Spark, SQL and ADF expertise, we would like to hear from you.
Role Overview
We are seeking a Senior Data Engineer with strong experience in Microsoft Azure, Databricks, Spark, SQL and Azure Data Factory to design, develop and deliver scalable data engineering solutions.
Key Responsibilities
- Design, develop and implement robust, scalable data engineering solutions on Microsoft Azure.
- Develop and optimise data pipelines using Azure Databricks, Spark and Azure Data Factory.
- Write and optimise complex SQL/T-SQL queries and data transformations.
- Implement strong engineering practices across development, testing, deployment and production support.
- Build and maintain CI/CD pipelines to support automated and reliable deployments.
- Work with stakeholders, architects and development teams to deliver high-quality data solutions.
- Troubleshoot performance, data quality and integration issues.
- Contribute to data platform standards, architecture and continuous improvement.
Essential Skills & Experience
- Degree in Engineering, Computer Science or a related technology discipline.
- 10+ years' experience as a Software Engineer or Data Engineer.
- Strong hands‐on experience with Azure Databricks and Apache Spark - Mandatory.
- Strong hands‐on experience with Azure Data Factory - Mandatory.
- Strong SQL/T-SQL skills.
- Strong CI/CD experience.
- Strong software/data engineering practices and development standards.
- Azure certification(s) or equivalent experience.
Azure Technologies
Mandatory:
- Azure Databricks / Spark
- Azure Data Factory
Desirable:
- Azure Synapse / Azure SQL Data Warehouse
- Azure Analysis Services
- Azure Cosmos DB
- Azure Event Hubs
- Azure ML
- Power BI
Senior Data Engineer – Melbourne employer: The HR Ally
As a Security Testing Lead Specialist in Sydney or Melbourne, you'll join a dynamic team that prioritises innovation and professional growth. Our collaborative work culture fosters continuous learning and mentorship, ensuring you have the resources to excel in your role while contributing to high-stakes security assessments. With a commitment to employee well-being and a focus on aligning security practices with business objectives, we offer a rewarding environment where your expertise can make a significant impact.
