Lead Data Engineer

Lead Data Engineer

Temporary 90 - 110 $ / hour (est.) Hybrid
M

At a Glance

  • Tasks: Join a team to build a cutting-edge data platform using Databricks on Azure.
  • Company: Well-established superannuation business focused on modernising their data infrastructure.
  • Benefits: Competitive day rate, hybrid work model, and opportunity to work with AI technologies.
  • Other info: 12-month contract with excellent career growth potential in a dynamic environment.
  • Why this job: Be part of a transformative project that lays the groundwork for AI in finance.
  • Qualifications: Experience with Databricks, Azure, Python, and SQL is essential.

The predicted salary is between 90 - 110 $ per hour.

Location: North Sydney (Hybrid)

Duration: 12-month Day Rate Contract

We’re working with a well-established superannuation business that’s investing heavily in modernising their data platform. As part of this transformation, they’re looking for a Senior Data Engineer to join the team on a 6-month contract to help create a brand new greenfield data platform in Databricks on Azure. The aim is to bring AI to the forefront of the business; however, the foundations need to be laid out in place first before enabling AI throughout the business.

Responsibilities:

  • Migrating legacy data processes and models into a modern lakehouse architecture
  • Working closely with a team of data engineers to help upgrade and enhance the existing data platform.
  • Creating robust CI/CD pipelines.
  • Supporting the internal team with uplift and documentation as part of knowledge transfer

Requirements:

  • Must have commercial experience using Databricks
  • Strong hands-on experience with Databricks, Azure Data Lake, and Azure Data Factory
  • Solid background in Python and SQL for data engineering
  • Experience building data pipelines in a cloud environment (Azure)
  • Good understanding of Delta Lake, data governance, and platform architecture
  • Prior experience working in regulated industries, ideally financial services or superannuation

Next steps:

1 stage interview process involving a technical deep dive discussion. Aim is End of August/Early Sept.

Seniority level: Mid-Senior level

Employment type: Contract

Job function: Information Technology

Industries: Financial Services and IT Services and IT Consulting

Lead Data Engineer employer: MAP TALENT

At MAP TALENT, we pride ourselves on being an exceptional employer, offering a dynamic work culture that fosters collaboration and innovation within the telecommunications sector. Our Sydney location provides employees with access to a vibrant city life while working on high-profile transformation projects that enhance professional growth and development. With competitive remuneration and opportunities for contract extensions, we are committed to supporting our team in achieving their career aspirations.

M

Contact Details:

MAP TALENT Recruitment Team

We think you need these skills to ace Lead Data Engineer

Databricks
Azure Data Lake
Azure Data Factory
Python
SQL
Data Pipeline Development
Cloud Environment Experience