At a Glance
- Tasks: Drive AI innovation in legal tech by developing and fine-tuning cutting-edge ML models.
- Company: Mary Technology, a fast-growing startup revolutionising the legal industry.
- Benefits: Equity ownership, career growth, and the chance to work on impactful projects.
- Other info: Join a dynamic team in a high-impact environment with significant growth opportunities.
- Why this job: Make a real difference in legal AI while collaborating with experts and innovators.
- Qualifications: Experience with transformer models, PyTorch, and a passion for ML research.
The predicted salary is between 135000 - 165000 $ per year.
About Us
At Mary Technology, we’re tackling one of the legal industry’s biggest challenges: Fact Chaos — the overwhelming disorder that arises from managing mountains of unstructured information. We’re building intuitive, scalable tools that help lawyers spend less time untangling facts and more time on high-value thinking. From visualising case timelines to extracting key insights from documents, we’re reimagining what legal work looks like. We’re backed by $2.7M in funding, growing over 30% MoM, and working with some of the largest law firms in Australia and 50+ mid-tier firms. If you're excited by AI, legal tech, and solving real-world problems at scale—we want to hear from you.
The Role
We’re looking for a Senior Machine Learning Software Engineer to drive forward both research and implementation. You’ll be working on cutting-edge models and infrastructure that transform how legal professionals interact with data. You’ll fine-tune and deploy production-grade transformer models, build simulation environments for synthetic data, and design scalable inference systems — all while working closely with a high-performing, curious team.
Your Impact
- Fine-tune and iterate on transformer-based models — LLMs, embedding models, cross-encoders, and other components of modern LLM pipelines.
- Build scalable, low-latency inference systems with monitoring, optimisation, and dynamic scaling.
- Design synthetic data pipelines and Gym-style simulation environments to support model evaluation.
- Lead experimental ML initiatives that drive product innovation and long-term value.
- Help shape the foundational systems for Legal AGI.
What We’re Looking For
- Experience training and iterating on production transformer models and LLM pipelines.
- Hands-on expertise with PyTorch, high-level ML frameworks, and inference engines (e.g. vLLM, SGLang, TensorRT).
- Profound grasp of the forefront of ML and LLMs, from weight quantisation to the nuances between MLA and GQA.
- Self-motivated learner who stays current with ML research and contributes to team knowledge sharing.
What We Value
- Agency – You move decisively through ambiguity and take full ownership.
- Taste – You have a sharp eye for quality across research investments, product, and engineering.
- Craft Obsession – You’re energised by solving hard problems and continuously levelling up your work.
Why Join Us?
- Career growth – Join early and grow with us in a fast-scaling, high-impact environment.
- Direct impact – Work closely with founders, legal experts, and engineers to shape the future of legal AI.
- Equity – Share in our success with meaningful ownership in the company.
- Purposeful work – Build technology that transforms how the legal industry works from the ground up.
Senior ML Engineer in Sydney employer: Mary Technology
At Mary Technology, we pride ourselves on being an exceptional employer by fostering a dynamic work culture that encourages innovation and collaboration. As a Senior ML Engineer, you'll have the opportunity to work on groundbreaking legal AI solutions while enjoying career growth in a fast-scaling environment. With meaningful equity options and a direct impact on transforming the legal industry, joining our team means being part of something truly purposeful and rewarding.
