At a Glance
- Tasks: Join a team to build a cutting-edge data platform using Databricks on Azure.
- Company: Well-established superannuation business focused on modernising their data infrastructure.
- Benefits: Competitive day rate, hybrid work model, and opportunity to work with AI technologies.
- Other info: 12-month contract with excellent career growth potential in a dynamic environment.
- Why this job: Be part of a transformative project that lays the groundwork for AI in finance.
- Qualifications: Experience with Databricks, Azure, Python, and SQL is essential.
The predicted salary is between 90 - 110 $ per hour.
Location: North Sydney (Hybrid)
Duration: 12-month Day Rate Contract
We’re working with a well-established superannuation business that’s investing heavily in modernising their data platform. As part of this transformation, they’re looking for a Senior Data Engineer to join the team on a 6-month contract to help create a brand new greenfield data platform in Databricks on Azure. The aim is to bring AI to the forefront of the business; however, the foundations need to be laid out in place first before enabling AI throughout the business.
Responsibilities:
- Migrating legacy data processes and models into a modern lakehouse architecture
- Working closely with a team of data engineers to help upgrade and enhance the existing data platform.
- Creating robust CI/CD pipelines.
- Supporting the internal team with uplift and documentation as part of knowledge transfer
Requirements:
- Must have commercial experience using Databricks
- Strong hands-on experience with Databricks, Azure Data Lake, and Azure Data Factory
- Solid background in Python and SQL for data engineering
- Experience building data pipelines in a cloud environment (Azure)
- Good understanding of Delta Lake, data governance, and platform architecture
- Prior experience working in regulated industries, ideally financial services or superannuation
Next steps:
1 stage interview process involving a technical deep dive discussion. Aim is End of August/Early Sept.
Seniority level: Mid-Senior level
Employment type: Contract
Job function: Information Technology
Industries: Financial Services and IT Services and IT Consulting
Lead Data Engineer employer: MAP TALENT
At MAP TALENT, we pride ourselves on being an exceptional employer, offering a dynamic work culture that fosters collaboration and innovation within the telecommunications sector. Our Sydney location provides employees with access to a vibrant city life while working on high-profile transformation projects that enhance professional growth and development. With competitive remuneration and opportunities for contract extensions, we are committed to supporting our team in achieving their career aspirations.