<pHalo Labs is seeking a Senior Data Engineer to design, develop and maintain PySpark-based data pipelines within a SaaS platform. You will architect scalable ETL/ELT processes on Azure and AWS, build distributed data processing with Databricks, and integrate third-party healthcare systems while ensuring security and data integrity.
You will collaborate with software engineers to embed data services into the product, optimize Spark performance, and implement robust testing and CI/CD practices in a remote-first Australian environment.
#J-18808-Ljbffr
Senior Python & Spark Data Engineer (Remote) in Melbourne employer: Mindrift
Mindrift is an exceptional employer for freelance Energy Systems Engineers, offering flexible project-based opportunities that allow you to work with leading tech companies while honing your skills in AI and energy engineering. With a focus on professional growth, you can expect a collaborative work culture that values innovation and encourages the application of your expertise in Python and energy systems. The competitive pay rates and potential for incentive payments make this an attractive option for those looking to engage in meaningful projects without the constraints of permanent employment.
