At a Glance
- Tasks: Join a team to design and implement cutting-edge ETL processes and Big Data tools.
- Company: Leading financial organisation with innovative projects and a collaborative culture.
- Benefits: Competitive daily rate, access to market-leading tools, and a modern working environment.
- Other info: Exciting opportunity for career growth and exposure to diverse technologies.
- Why this job: Work with top tech and gain valuable experience in a dynamic field.
- Qualifications: Experience with cloud platforms, Python, SQL, and Big Data tools.
The predicted salary is between 82800 - 101200 $ per year.
The Client
My client is a leading financial organisation who are continuing their journey with multiple projects where they are looking for Data Engineers. This client is working on multiple projects which would give you an exciting opportunity to work with cutting edge technology tools.
The Role
This role offers a great chance to join a team of Engineering Managers, Data experts and Project Managers working on cutting edge, highly complex ETL design and Big Data tools. The position will also give you the chance to gain exposure to a range of other languages and technologies. The ideal candidate will have experience working on similar projects heavily with Big Data Tools and ETL design.
The key responsibilities will include:
- Create repeatable and reusable ingestion and curation code in accordance with the architecture.
- Populate Data Lake and Data model for new sources that haven’t been incorporated into the big data ecosystem.
- Low level design implementing ETL processes/pipelines where required.
- Delivery of data curation jobs, including development, testing and implementation using CI/CD framework.
- Ingest structured/unstructured data in real time, near real time or batch cadence into GCP.
- Responsible for ensuring the production services are optimally configured and aligned to best practices to protect production data.
Candidate Profile
Looking for the following skills/experience:
- Working experience with cloud platforms such as Azure & GCP.
- Strong experience with Python & Databricks.
- Proven experience building data working with tools such as Spark and Kafka.
- Highly skilled in all aspects of SQL and PL/SQL.
- Low level design or reusable framework experience highly regarded.
- Working experience with tools such as Snowflake or Databricks.
What’s on offer?
This is an excellent opportunity to work on a great contract where you will have access to market leading tools, expert colleagues and a modern working environment. This opportunity offers a competitive daily rate as well as other excellent benefits.
Data Engineer in Sydney employer: Hydrogen Group
Join a prestigious global law firm in New York City, where you will be part of a dynamic team that handles high-profile corporate transactions. The firm fosters a collaborative work culture that prioritises professional development, offering mentorship opportunities and the chance to work closely with industry leaders. With a commitment to excellence and innovation, this role provides a unique platform for growth in a vibrant city known for its legal prowess.
