At a Glance
- Tasks: Lead data engineering projects, develop ETL/ELT processes, and create data visualisations.
- Company: Join a federal government client in Canberra with a hybrid work model.
- Benefits: 12-month initial contract with potential 24-month extension and flexible working arrangements.
- Other info: Collaborative agile team environment with opportunities for professional growth.
- Why this job: Make an impact by transforming data for decision-making using modern cloud technologies.
- Qualifications: Experience in data engineering, ETL/ELT processes, and strong communication skills required.
The predicted salary is between 123750 - 151250 $ per year.
One of our federal government clients is seeking to engage a Lead Data Engineer for the Canberra location.
Extension term details: 24 months
Location of work: ACT
Working arrangements: Hybrid
Initial contract duration: 12 months
Experience level: EL1 equivalent
Job details:
Our client is looking for a Data Engineer who can work across its data and analytics platforms. We are seeking candidates with strong experience in developing Extract, Transform, Load (ETL) and Extract, Load, Transform (ELT) processes, and/or the development of data products and complex data visualisations. The role will be responsible for design, development and testing activities across several data movement, data transformation, and data visualisation processes. The data movement and transformation processes focus on the preparation of data for use in decision-making processes across the department, utilising modern cloud technology (Azure & Databricks) to enable operational analytics use cases.
Key duties and responsibilities:
- Be responsive, flexible, and work collaboratively as part of an agile team.
- Strong relationship building and negotiation skills.
- Strong written and oral communication skills.
- Creating and maintaining automated ingest and transformation patterns and frameworks.
- Designing, building and maintaining data ingest and transformation solutions to meet current and emerging needs.
- Assisting project teams achieve objectives that align with departmental, divisional, and program priorities.
- Supporting data engineers in delivery teams, through regular quality reviews and constructive feedback on utilising data assets to produce quality data products.
The successful candidate will require experience with the following techniques and technologies:
- Data Integration - Data Factory, SQL Server Integration Services and/or Databricks
- Data Store - SQL Server and/or Data Lake Storage
- Analytics - Azure Databricks, Azure Machine Learning, ArcGIS Enterprise
- Development tools – DevOps, Visual Studio
- Data technology solutions – sourcing (Oracle, Ingres, Azure, SQL Server), automated ingestion
- Data Preparation - Transformation of data into formats tailored for advanced analytics and AI use cases – Parquet and/or Delta
- Data Visualisation - Analyse and interpret complex data sets, and to identify trends and patterns.
- Design principles to create appropriate visualisations for target audience.
- Visualisation tools - Power BI.
Weighting:
- 1. Demonstrated experience developing ETL/ELT processes for complex and/or large data movement, transformation and/or visualisations, particularly in a cloud environment. Weighting: 50%
- 2. Experience preparing data optimised for query performance in cloud computed engines. E.g. Distributed computing engines (Spark), Graph Databases, Azure SQL. Weighting: 25%
- 3. Experience working with Engineering, Storage and Analytics services in cloud infrastructure. Weighting: 25%
Desirable criteria:
- 1. Experience working with Azure Data Factory and Databricks.
- 2. Experience/Knowledge of working with Data Lake and Lakehouses.
Lead Data Engineer – Hybrid in Canberra employer: IT Alliance
IT Alliance is an exceptional employer, offering a dynamic work culture that prioritises innovation and collaboration in the heart of Canberra and Adelaide. Employees benefit from comprehensive professional development opportunities, competitive remuneration, and a commitment to work-life balance, all while contributing to meaningful projects that enhance national security through cutting-edge technology. Join us to be part of a team that values your expertise and fosters growth in a supportive environment.
