- Contract until end of April 2027 - Government Agency
- Databricks, Python, SQL and Azure
We are seeking a Data Engineer - Databricks to join a major data platform migration program. You will play a hands-on role in transitioning an existing SQL Server data warehouse and associated pipelines to a modern Databricks and Azure environment.
Key Responsibilities
- Lead the migration of an existing SQL Server data warehouse and ETL environment into Databricks and Azure.
- Translate existing SQL warehouse structures, queries, stored procedures and ETL logic into scalable Databricks solutions.
- Build and develop Databricks notebooks, data pipelines and workflows using SQL and Python.
- Analyse existing SQL data and processes, identify migration requirements
- Support data validation, testing, optimisation and troubleshooting throughout the migration
Key Skills and Experience
- 10+ years of hands-on experience as a Data Engineer.
- Strong hands-on experience with Databricks, including data engineering, notebooks, workflows and pipelines.
- Advanced SQL skills, with proven experience working with data warehouses
- Strong Python development skills, particularly for building data pipelines
- Proven experience migrating SQL Server data warehouses, ETL processes or data platforms to Databricks or similar modern data platforms.
What’s in it for you
- Contract until end of April 2027
- Government Agency
#J-18808-Ljbffr
Databricks Data Engineer – Sql/Etl Migration Lead in Melbourne employer: Talent
As a Defence Cyber Security Assessor, you will join a dynamic team dedicated to safeguarding critical technology environments. Our Canberra office fosters a collaborative work culture that prioritises employee growth through continuous learning and professional development opportunities. With a strong commitment to work-life balance and a focus on meaningful contributions to national security, we offer an exceptional environment for those looking to make a real impact in the field of cyber security.
