At a Glance
- Tasks: Design and build scalable data pipelines using Python and PySpark.
- Company: Join a global tech consultancy with a dynamic, hybrid work culture.
- Benefits: Competitive hourly rate, flexible work environment, and opportunities for growth.
- Other info: Exciting 3-month contract with potential for future opportunities.
- Why this job: Make an impact by optimising data platforms and collaborating with talented teams.
- Qualifications: Strong Python and PySpark skills, experience with Databricks and AWS.
The predicted salary is between 100 - 100 $ per hour.
This range is provided by Humanised Group. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.
3 Month Contract | Hybrid Environment | Must be Sydney Based
If you are someone who enjoys designing scalable data pipelines and building modern, high performance data platforms, this is a great opportunity! We are partnering with a global tech consultancy to find a Data Engineer for an initial 3 month contract.
Responsibilities:
- Build/ improve data pipelines using Python and PySpark for both batch and streaming workloads
- Design and manage Delta Lake layers (Bronze, Silver, Gold) - Databricks
- Set up and maintain Databricks workflows, jobs, notebooks, and DLT pipelines
- Optimise performance using Databricks tools and follow best practices for clean, modular code
- Work with AWS S3 to manage raw and processed data securely
- Use Terraform and Databricks Asset Bundles
- Automate AWS workflows using Boto3 (S3, Glue, Lambda)
- Work with data scientists and engineers to keep data flowing across teams
- Apply place checks for data quality, validation, and monitoring
Required Skills & Experience:
- Strong coding in Python and PySpark
- Experience with Databricks and Delta Lake
- Experience in AWS services, especially S3, Glue, Lambda, and Redshift
- Experience using Terraform or CloudFormation
- Comfortable automating AWS tasks with Boto3
- Prior experience building efficient, secure, and scalable pipelines
- Works well in cross functional and remote teams
- Databricks certification
- Experience working in consultancies or fast paced delivery environments
Seniority level: Mid-Senior level
Employment type: Contract
Job function: Information Technology
Industries: Staffing and Recruiting
Senior Data Engineer employer: Humanised Group
Humanised Group is an exceptional employer that fosters a supportive and collaborative team environment, perfect for a Business Analyst looking to make a meaningful impact. With strong development and mentoring opportunities, a hybrid working arrangement, and the added benefit of NFP salary packaging, employees can thrive both personally and professionally while contributing to ongoing organisational transformation.
