Join a leading global Financial Services organisation on the development and enhancement of realt-time data solutions. This person will be responsible for designing scalable and reliable data solutions in a small, collaborative and high-output team.
The role focuses on individual contributions and development rather than management/leadership to develop high-performance engineering solutions.
What's a typical day look like?
- Design, develop, and improve highly scalable, fault-tolerant ETL/ELT pipelines.
- Build and maintain real-time processing solutions using Kafka and RabbitMQ to ensure real-time data availability.
- Work to optimise complex schema designs, indexing, and query performance for large-scale financial datasets.
- Deploy and maintain data services in cloud environments, implementing security controls and data governance standards required for the finance industry.
- Work with business stakeholders and senior leadership to understand business objectives and translate them into practical data solutions. Support fellow data engineers through code reviews and technical guidance.
- Implement monitoring and automated recovery systems to maintain the integrity and quality of critical financial data.
About you:
- Proven experience in data engineering, with a strong background in designing and implementing ETL processes within cloud environments.
- Experience within the Finance or Trading technology sector.
- Strong programming skills in Python, with experience in developing robust, maintainable, and scalable data processing pipelines.
- Extensive SQL knowledge and experience.
- Excellent problem-solving skills and the ability to work collaboratively.
- Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
- Permanent Resident / Citizen of Australia/NZ with full-working rights.
#J-18808-Ljbffr
Data Engineer in Sydney employer: Kapital Consulting
Our Client is an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration in the rapidly evolving field of AI within Financial Services. Employees benefit from comprehensive growth opportunities, including hands-on experience with cutting-edge technologies and the chance to contribute to impactful projects that shape the future of finance. Located in a vibrant area, the company promotes a healthy work-life balance and encourages a supportive environment where every team member's contributions are valued.
