Lifted logo

LLM Model Response Evaluation

Lifted
Remote
Ottawa, ONRemote· 9 days ago

Straight from Lifted’s careers page. Apply on the company site — no recruiter, no middleman.

Copy of LLM Model Response Evaluation

Location: Ottawa, ON, ca, Remote

Company Description

Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description

 

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelors Degree required
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities 

Additional Information

Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours: Workload may vary weekly

Similar remote jobs

More like this →
Blooming Health logo

Blooming Health

Director of Quality Assurance

Remote
New York, NY
✓ From careers page· 27 minutes ago
Mercury logo

Mercury

Software Engineer - Product

Remote
San Francisco, CA$122k–$158k
✓ From careers page· 30 minutes ago
Mercury logo

Mercury

Senior Manager, Data and AI Governance (Remote)

Remote
San Francisco, CA$203k–$282k
✓ From careers page· 31 minutes ago
Mercury logo

Mercury

Head of Data Engineering & Platform

Remote
San Francisco, CA$290k–$362k
✓ From careers page· 31 minutes ago

Discover More than 100,000 Hidden Remote Jobs Before Everyone Else

Unlock All Remote Jobs Today

Simple pricing. Big savings on Quarterly and Yearly.

Monthly Access

$19/month
  • Instant access to fresh remote jobs from 500+ companies
  • New opportunities added hourly, often 3-7 days before anywhere else
  • Advanced filtering by role type, stack, pay, and location
  • Priority customer support
Start 7-day trial — $2.95
Most Popular

Yearly Access

$59/year
  • Everything in Monthly
  • Save $169 (~74%) vs paying monthly
  • Average job search takes ~6 months - get covered for the whole journey
  • Less than the cost of one lunch per month for competitive advantage
  • Equivalent to just ~$4.92/month
Start 7-day trial — $2.95