At a Glance
- Tasks: Review and validate AI systems to ensure they meet safety and risk standards.
- Company: Join Macquarie, a global financial services leader with a collaborative culture.
- Benefits: Enjoy flexible working, wellbeing leave, and professional development opportunities.
- Other info: Be part of an inclusive team that values diverse perspectives and growth.
- Why this job: Make a real impact in AI safety while shaping your career in a dynamic environment.
- Qualifications: Experience in AI solutions, Python programming, and a passion for learning.
Our Model Risk Management team provides independent oversight and challenge of model and AI risks across Macquarie globally. We assess whether models and AI systems are fit for purpose, appropriately controlled, and aligned to the firm’s risk appetite and regulatory expectations. The team plays a critical role in enabling safe adoption of models and AI by providing robust validation, clear challenge, and sound risk-based decisions.
As a Data Scientist within Model Risk Management, you will independently review, challenge, and validate artificial intelligence use cases across the firm. Your work will assess whether AI systems are fit-for-purpose, operate as intended, and ensure that the risks introduced are understood, appropriately controlled, and remain within Macquarie’s risk appetite. You will design and execute proportionate validation approaches, assess data, methodology, assumptions, and outcomes, and clearly articulate findings to technical and non-technical stakeholders. Your analysis and judgement will directly inform model approvals, usage decisions, and risk acceptance.
Working closely with, but independently from, model developers, product owners, and business stakeholders, you will provide constructive challenge that enables safe and sustainable AI adoption. You will also contribute to the evolution of AI validation practices, tooling, and standards within the team, sharing knowledge and strengthening collective capability.
What You Offer
- A courageous mindset and a demonstrated track record of self-directed learning, with the curiosity and discipline to stay ahead of rapidly evolving AI techniques and risks.
- Attention to detail and a knack for identifying problems.
- Hands-on experience designing, developing, and evaluating AI and Generative AI solutions, including Retrieval-Augmented Generation (RAG), multi-agent systems, guardrail design, synthetic data generation, and LLM-as-a-Judge evaluation frameworks.
- Experience with modern GenAI frameworks and tooling, such as LangChain, LangGraph, Google ADK, OpenAI Agents SDK, Langfuse, DeepEval, or similar platforms.
- Advanced Python programming skills, along with strong experience using GitHub, version control best practices, and CI/CD pipelines.
- Knowledge of additional languages such as SQL, R, and TypeScript is highly regarded.
- Practical experience with AI coding agents, including tools such as Claude Code and Codex, and the ability to develop and maintain skills, sub-agents, hooks, plugins for workflow automations.
- Experience fine-tuning, evaluating, and deploying small language models (SLMs), with an understanding of performance optimisation and model assessment techniques.
- Working knowledge of traditional machine learning models, including various regression models, random forests, Xgboost, and related model evaluation approaches.
We recognise that no candidate will meet every requirement listed above. If you are passionate about AI and its safety, possess some of these skills, and are excited to learn and grow, we love hearing from anyone inspired to build a better future with us.
What We Offer
- 1 wellbeing leave day per year.
- Up to 5 additional service bonus leave days per year.
- Up to 20 weeks’ paid parental leave for primary caregivers along with 12 days of transition leave upon return to work, and 6 weeks’ paid leave for non-primary caregivers.
- 2 days of paid volunteer leave and donation matching.
- Up to 12 months’ gender affirmation leave, including 6 weeks’ paid leave.
- Access to Employee Assistance Program and wellbeing benefits including skin and health checks, and flu vaccinations.
- Access to a wide range of salary packaging options.
- Access to a wide range of learning and development opportunities, including reimbursement for professional membership or subscription.
- Hybrid and flexible working arrangements, dependent on role.
- Reimbursement for work from home equipment.
About the Risk Management Group: Our Risk Management Group works as an independent, centralised function, responsible for independent and objective review and challenge, oversight, monitoring, and reporting in relation to Macquarie’s material risks. We are a global team that aims to manage the risks of today and anticipate the risks of tomorrow.
Inclusion at Macquarie
We are committed to providing an inclusive environment for all, where different experiences, skills, and perspectives are valued and respected. Macquarie provides access to opportunities for all individuals regardless of race, colour, religion, sex, sexual orientation, national origin, age, disability, protected veteran status, genetic information, marital status, gender identity, or any other characteristic or circumstance. We provide reasonable adjustments to individuals who may need support during the recruitment process and employment. If you require an adjustment, please let us know during the application process.
Data Scientist in Sydney employer: Macquarie Group
Macquarie Group is an exceptional employer that fosters a collaborative and innovative work culture, where employees are empowered to drive meaningful change through data-driven insights. With a strong focus on professional development, the Global Reward Advisory team offers ample opportunities for growth and learning, all while being part of a dynamic global network that values diverse perspectives and encourages impactful contributions.
