LLM Model Response Evaluation
Straight from Lifted’s careers page. Apply on the company site — no recruiter, no middleman.
Copy of LLM Model Response Evaluation
Location: Ottawa, ON, ca, Remote
Company Description
Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.
Job Description
- Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
- The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
- The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
- Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
- Each task will include detailed project guidelines within the evaluation platform.
Qualifications
- 3+ years of hands-on experience in LLM / GenAI data evaluation.
- Bachelors Degree required
- Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
- Comfortable evaluating content across multiple modalities
Additional Information
Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours: Workload may vary weekly
Similar remote jobs
More like this →

Mercury
Software Engineer - Product
Remote
San Francisco, CA$122k–$158k✓ From careers page· 30 minutes ago

Mercury
Senior Manager, Data and AI Governance (Remote)
Remote
San Francisco, CA$203k–$282k✓ From careers page· 31 minutes ago

Mercury
Head of Data Engineering & Platform
Remote
San Francisco, CA$290k–$362k✓ From careers page· 31 minutes ago
Discover More than 100,000 Hidden Remote Jobs Before Everyone Else
Unlock All Remote Jobs Today
Simple pricing. Big savings on Quarterly and Yearly.
Monthly Access
$19/month
- Instant access to fresh remote jobs from 500+ companies
- New opportunities added hourly, often 3-7 days before anywhere else
- Advanced filtering by role type, stack, pay, and location
- Priority customer support
Most Popular
Yearly Access
$59/year
- Everything in Monthly
- Save $169 (~74%) vs paying monthly
- Average job search takes ~6 months - get covered for the whole journey
- Less than the cost of one lunch per month for competitive advantage
- Equivalent to just ~$4.92/month