Senior Data Engineer – AWS and Snowflake
- Design, develop, and maintain scalable real‐time, event‐driven, CDC‐based, and batch data pipelines on AWS and Snowflake to support analytics.
- Build and optimise data ingestion frameworks leveraging streaming technologies, event‐based architectures, and Change Data Capture (CDC) patterns.
- Develop and manage cloud‐native data solutions preferably on AWS that ensure high availability, reliability, scalability, and performance.
- Optimise Snowflake data models, queries, workloads, and storage strategies to improve performance and cost efficiency.
- Implement and maintain robust data quality, governance, security, privacy, and compliance controls across the data platform.
- Design and manage ETL/ELT processes for integrating data from multiple internal and external sources.
- Automate infrastructure provisioning, testing, deployment, and monitoring using CI/CD pipelines and Infrastructure‐as‐Code practices.
- Collaborate closely with solution architects, application development teams, data scientists, business analysts, and key stakeholders to deliver data solutions aligned with business objectives.
Experience and Qualifications
- Strong hands‐on experience with Python and SQL for data engineering, transformation, and automation.
- Extensive experience designing and implementing data solutions on AWS, including services such as S3, Glue, Lambda, EMR, Kinesis, EventBridge, Redshift, Step Functions, and related data services.
- Strong expertise in Snowflake, including data modelling, performance tuning, workload optimisation, security, and administration.
- Experience building real‐time streaming, event‐driven, and CDC‐based data ingestion architectures.
- Solid understanding of ETL/ELT frameworks, distributed data processing, and modern data engineering patterns.
- Experience with DevOps practices, CI/CD pipelines, version control systems (e.g., Git), and infrastructure automation.
- Knowledge of data governance, data quality frameworks, metadata management, security, and compliance requirements.
- Experience working with large‐scale structured and unstructured datasets in cloud environments.
Benefits
- Exposure to transformational programs in AI and Data portfolio.
- Career growth through learning platforms, certifications, and global mobility.
- Inclusive culture backed by the "Inclusive Future for All" commitment.
- Competitive total rewards and recognition programs.
Senior Data Engineer - AWS and Snowflake at Capgemini in Sydney employer: Capgemini
At Capgemini Engineering, we pride ourselves on being an exceptional employer that fosters a dynamic and inclusive work culture. With a strong emphasis on career growth, our employees benefit from flexible work arrangements and access to cutting-edge training programs, including certifications in AWS and Microsoft Azure. Join us in a vibrant environment where your contributions matter, and every day presents new opportunities to innovate and make a meaningful impact.
