At a Glance
- Tasks: Evaluate AI responses to Australian law questions and provide detailed feedback.
- Company: Join Mercor, a leader in legal AI innovation.
- Benefits: Earn USD 100-120 per hour with flexible hours and potential for more work.
- Other info: Work independently with a focus on detail in a dynamic environment.
- Why this job: Be at the forefront of AI and law, shaping the future of legal technology.
- Qualifications: 5+ years as in-house counsel with expertise in Australian law.
Mercor is partnering with a leading legal AI company to benchmark how well AI systems answer real questions of Australian law. We are hiring experienced in-house counsel to serve as expert reviewers.
What you'll do:
- Run the same set of prompts across two AI (LLM) platforms
- Compare the outputs from both platforms side by side
- Score each response against a standardized rubric we provide
- Submit concise written feedback for every evaluation
Requirements:
- 5+ years as in-house legal counsel practising in Australia
- Strong command of Australian law, especially commercial and contract matters
- Sharp attention to detail and precise written English
- Able to work independently to a rubric and to deadlines
Logistics:
- Initial commitment: ~10 hours, with strong potential for more
- Confidentiality: all work is covered by NDA
- Pay: USD 100-120 per hour
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
In-House Counsel – Australia employer: aitrainer
At Mercor, we pride ourselves on fostering a collaborative and innovative work culture that empowers our employees to excel in their roles. As an In-House Counsel, you'll have the opportunity to engage with cutting-edge legal AI technology while contributing to meaningful projects that shape the future of Australian law. With competitive pay and flexible hours, we support your professional growth and value your expertise in a dynamic environment.
