Job Description
Position: Data Engineer
Security clearance: Candidates must hold NV1 clearance
Job Details:
ETL pipeline development in Spark / Cloudera Data Engineering / Airflow (critical requirement)
ETL pipeline development using NiFi within Cloudera Data Platform (strong requirement)
ETL development using DDLs and Erwin (Strong requirement)
ETL development experience using Ozone & Iceberg, Hive, Hue and Impala (critical requirement)
Configuration and management of Cloudera Data Platform environments and tenancies, including complex ranger and atlas security & access controls, linked to enterprise identity management services, such as EntraID
DevOps skills using AzureDevOps / VisualStudio Code (critical requirement)
Complex ETL pipeline debugging and design of various methods of ETL, including truncate & reload etc (critical requirement)
Developer / Engineering skills in Cloudera Data Visualisation (nice to have)
Developer / Engineering / Integration skills in MSSQL & PowerBI (nice to have)
Excellent problem solving, communication and task management skills (strong requirement)
Previous experience working on large agency data warehouses and data integration projects (strong requirement)
Pervious experience working in Defence (desirable)
#J-18808-Ljbffr
Data Engineer- Nv1 Security Clearance employer: XPT Software Australia Pty Ltd
XPT Software Australia Pty Ltd is an exceptional employer, offering a dynamic work environment in the heart of Sydney, where innovation meets collaboration. With a strong focus on employee growth and development, we provide ample opportunities for career advancement through mentorship and leadership roles, particularly in the fast-evolving field of infrastructure services. Our commitment to service excellence and operational governance ensures that our team members are empowered to lead transformative projects while enjoying a supportive culture that values diversity and teamwork.
Contact Details:
XPT Software Australia Pty Ltd Recruitment Team
