LLM Evaluation Architect – Remote in Sydney

LLM Evaluation Architect – Remote in Sydney

Sydney Full-Time 63000 - 77000 $ / year (est.) Hybrid
B

At a Glance

  • Tasks: Build and optimise LLM evaluation capabilities for dialogue and trading scenarios.
  • Company: Join Binance, a leading global cryptocurrency exchange with a dynamic team.
  • Benefits: Enjoy remote work flexibility, competitive salary, and opportunities for professional growth.
  • Other info: Collaborate with diverse teams and contribute to innovative projects in a thriving industry.
  • Why this job: Make an impact in the fast-paced crypto world while working on cutting-edge AI technologies.
  • Qualifications: Strong algorithmic background and experience in model performance evaluation.

The predicted salary is between 63000 - 77000 $ per year.

Binance is seeking an Evaluation Expert with an algorithmic background to build LLM evaluation capabilities for dialogue, trading, and other scenarios.

You will quantify model performance, identify issues, and guide R&D iterations with actionable recommendations.

You will design end-to-end evaluation plans, construct benchmarks, and automate workflows to scale high-frequency assessments while collaborating with product and data teams to align objectives with business needs.

#J-18808-Ljbffr

LLM Evaluation Architect – Remote in Sydney employer: Blockchain Academics

Blockchain Academics offers a dynamic work environment focused on the rapidly evolving blockchain industry. Employees benefit from opportunities for professional growth and development, as well as the chance to work with cutting-edge technology in a collaborative setting. The company's commitment to transparency and security in financial access makes it an attractive employer for those passionate about innovation in finance.

B

Contact Details:

Blockchain Academics Recruitment Team

We think you need these skills to ace LLM Evaluation Architect – Remote in Sydney

Algorithmic Background
Model Performance Quantification
Issue Identification
R&D Guidance
Evaluation Plan Design
Benchmark Construction
Workflow Automation