- Contract: 6-12 months, with potential extensions (subject to confirmation).
- Locations: Melbourne, Sydney or Canberra.
- Work arrangement: Hybrid.
Join a global IT services and consulting organisation delivering enterprise-scale data and decision intelligence solutions.
We are seeking an experienced Quantexa Data Engineer with strong hands-on experience in Quantexa implementations, Scala, Apache Spark and SQL to design, develop and optimise enterprise data pipelines.
This is an opportunity to contribute to a major data and decision intelligence programme, integrating complex datasets, enabling entity resolution and delivering reliable, high-performance data solutions that support risk, compliance and business decision-making.
Key Responsibilities
- Design, develop and maintain data pipelines to ingest, transform and integrate data from multiple internal and external sources.
- Configure and support Quantexa data models, entity resolution, record matching and network generation.
- Develop scalable data processing solutions using Scala, Apache Spark and SQL.
- Perform data cleansing, standardisation, validation and reconciliation across complex, high-volume datasets.
- Optimise data pipelines for performance, scalability and reliability.
- Troubleshoot data quality issues, pipeline failures and integration challenges.
- Implement data quality, lineage, governance and access controls.
- Support testing, production deployments, release management and ongoing platform maintenance.
- Collaborate with solution architects, business analysts, data specialists and governance teams.
- Australian Government baseline, NV1 or NV2 security clearance or eligibility to obtain one, particularly for Canberra-based opportunities.
- ONLY open to Australian Citizens.
- Proven hands-on Quantexa implementation experience as a Data Engineer or Developer, rather than solely consuming Quantexa outputs.
- Strong Scala and Apache Spark experience in large-scale distributed data processing.
- Advanced SQL skills for data querying, transformation and troubleshooting.
- Solid commercial experience developing and maintaining production-grade data pipelines.
- Strong understanding of data modelling, mapping, transformation and integration across multiple source systems.
- Experience with entity resolution, record matching, deduplication and entity linking.
- Proven experience delivering enterprise data solutions into production.
- Strong troubleshooting, analytical, communication and stakeholder engagement skills.
Highly Desirable
- Quantexa certification or experience delivering solutions through a Quantexa partner.
- Experience in financial services, financial crime, fraud, AML, risk or compliance.
- Knowledge of network analytics and graph-based data solutions.
- Experience with AWS, Azure or GCP, Elasticsearch, Git and CI/CD pipelines.
- Understanding of data governance, lineage, provenance and data quality frameworks.
- Experience working in government or regulated enterprise environments.
#J-18808-Ljbffr
Quantexa Data Engineer in Canberra employer: Nixil
Nixil is an exceptional employer that fosters a collaborative and innovative work culture, empowering employees to lead in the rapidly evolving field of AI and microservices. Located in Australia, we offer competitive benefits, continuous professional development opportunities, and a commitment to work-life balance, making it an ideal environment for those looking to make a meaningful impact in technology.
