Accenture is seeking a hands-on Data Engineer in Melbourne to build reliable, real-time data pipelines using Amazon Kinesis and Databricks. You will move data from Kinesis to the Databricks Lakehouse via Spark Structured Streaming and Delta tables, optimizing for performance, latency, and cost.
You will ingest streaming data into Delta tables, develop Python and SQL code, and collaborate with batch engineers to ensure seamless integration of streaming and batch workloads.
Real-Time Data Engineer: AWS Kinesis & Databricks in Melbourne employer: Accenture PLC
At Partners in Performance, part of Accenture, we pride ourselves on being an exceptional employer that fosters a dynamic and collaborative work culture. Our focus on human performance means you will have the opportunity to work closely with clients, driving meaningful change and delivering tangible results rather than just reports. With a commitment to employee growth through mentorship and diverse experiences, our ANZ office offers a unique environment where your insights can lead to impactful outcomes for some of the world's largest companies.