Overview:
We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.
Responsibilities:
- Design, build, and maintain ETL pipelines using Databricks and Spark SQL
- Develop and optimise SQL queries for large-scale data transformation and performance
- Extract and load data from source systems into Azure-based data warehouses and downstream platforms
- Collaborate with data and integration teams to align data flows and resolve issues
- Ensure data pipelines are reliable, efficient, and well-documented
- Support testing, troubleshooting, and performance tuning activities
Key Skills and Experience:
- Proven experience as a Data Engineer or similar role in a cloud environment
- Strong expertise in Databricks and Spark SQL, including joins and query optimisation
- Hands-on experience with ETL development and pipeline orchestration (Azure Data Factory desirable)
- Solid SQL skills and ability to work with large datasets
- Familiarity with Azure data services (Data Lake, Synapse, D365 exposure a bonus)
- Strong problem-solving skills and ability to work collaboratively within cross-functional teams
Interested candidates who meet the required skillset of the role are encouraged to apply via the link with an updated resume. Reference BIHI 113260
Seniority level
- Mid-Senior level
Employment type
- Contract
Job function
- Information Technology
Industries
- IT Services and IT Consulting
Data Engineer in Sydney employer: Data#3
Data#3 is an exceptional employer, recognised as HRD's Employer of Choice for 11 consecutive years, offering a vibrant work culture that prioritises diversity and employee well-being. Located in Brisbane, our team enjoys a supportive environment with ample opportunities for professional growth, where your expertise in Microsoft licensing can truly make an impact on technology decisions for a diverse range of clients. Join us to be part of a leading IT services provider that values innovation and fosters strong relationships within the industry.
