Senior Data Engineer - AI Platform & Architecture in Brisbane

Senior Data Engineer - AI Platform & Architecture in Brisbane

Brisbane Full-Time On-site
B

BLACKROC is recruiting on behalf of one of Australia's most forward-thinking AI-first organisations.

Our client operates with zero legacy technology; everything yes, everything is built from the ground up using the latest modern data and AI engineering practices. Data is the foundation that powers their AI strategy, used intelligently both internally and externally to build a real competitive moat for the future.

They believe AI is a powerful tool that should enhance human potential, not replace it. People, culture and values remain at the centre of the organisation; this is a philosophy strongly supported from the Board and CEO through to the CIO. They recently achieved 98% adoption on a major AI rollout across their 500-person company.

We're looking for an experienced Senior Data Engineer, AI Platform & Lakehouse Architecture to play a key role in designing and evolving their new Databricks Lakehouse platform.

You will take ownership of the platform architecture, focusing on:

  • Designing and evolving the Databricks Lakehouse architecture
  • Defining Medallion layer structures, table formats, partitioning, clustering and data lifecycle policies
  • Implementing Unity Catalogue, governance, access controls, and schema evolution practices
  • Optimising compute strategy, cost efficiency, performance and scalability
  • Establishing engineering standards, best practices and technical leadership across the team

BLACKROC is recruiting on behalf of one of Australia's most forward-thinking AI-first organisations.

Our client operates with zero legacy technology; everything yes, everything is built from the ground up using the latest modern data and AI engineering practices. Data is the foundation that powers their AI strategy, used intelligently both internally and externally to build a real competitive moat for the future.

They believe AI is a powerful tool that should enhance human potential, not replace it. People, culture and values remain at the centre of the organisation; this is a philosophy strongly supported from the Board and CEO through to the CIO. They recently achieved 98% adoption on a major AI rollout across their 500-person company.

We're looking for an experienced Senior Data Engineer, AI Platform & Lakehouse Architecture to play a key role in designing and evolving their new Databricks Lakehouse platform.

You will take ownership of the platform architecture, focusing on:

  • Designing and evolving the Databricks Lakehouse architecture
  • Defining Medallion layer structures, table formats, partitioning, clustering and data lifecycle policies
  • Implementing Unity Catalogue, governance, access controls, and schema evolution practices
  • Optimising compute strategy, cost efficiency, performance and scalability
  • Establishing engineering standards, best practices and technical leadership across the team

You'll work in a collaborative, high-performing environment with a \"Silicon Valley\" mindset, clean architecture, high standards, rapid iteration and real ownership.

What You'll Bring

  • 7+ years' experience building and architecting modern data platforms
  • Deep hands-on expertise with Databricks, Delta Lake, Lakehouse architecture, and Unity Catalogue
  • Strong skills in data modelling, governance, observability, and platform reliability
  • Proficiency in Python, SQL and PySpark
  • Experience supporting large-scale AI/ML workloads (a big plus)
  • A collaborative, mentoring mindset and excellent communication skills
  • Full Australian work rights

Why Join

  • Work on greenfield AI data infrastructure with zero legacy constraints
  • Have real impact on strategic platform decisions in an AI-first organisation
  • Competitive salary + salary packaging
  • Modern Bowen Hills office with good transport links
  • Strong executive sponsorship for data and AI initiatives

We strongly encourage applications from women and people from diverse backgrounds; our client is genuinely committed to building a more inclusive tech team.

If you're a Senior Data Engineer who loves platform architecture and wants to work on cutting-edge AI data systems in a company that values both innovation and its people, we'd love to hear from you.

Senior Data Engineer - AI Platform & Architecture in Brisbane employer: Blackroc

At BLACKROC, we pride ourselves on being an exceptional employer, offering Full Stack Developers the chance to work on impactful projects within a supportive and inclusive environment. Located in Brisbane, our team enjoys flexible work arrangements, including two days of remote work, and is dedicated to fostering professional growth through hands-on experience with cutting-edge technologies like AWS and modern development frameworks. Join us to be part of a collaborative culture that values diversity and empowers you to take ownership of your work while contributing to meaningful government initiatives.

B

Contact Details:

Blackroc Recruitment Team