Expert Talent Pool, Feedback and Alignment
Straight from Clera’s careers page. Apply on the company site — no recruiter, no middleman.
Expert Talent Pool, Feedback and Alignment (Senior Expert)
Department: Engineering
Location: remote
Employment Type: FullTime
About the Role
Join a remote expert network as a senior rater and reviewer, evaluating complex AI model outputs and helping calibrate other graders. Your work supports the development of high-quality, trustworthy AI systems across specialized fields.
What Youll Do
Rank and rate expert-level model answers using detailed rubrics and write clear rationales.
Evaluate steps in model reasoning across fields such as mathematics, coding, law, medicine, and finance.
Fact-check complex claims against primary sources and verify accuracy.
Assess answers against content policies, style guides, and edge cases.
Review other raters work, calibrate standards, and develop or refine grading guidelines.
Assess search relevance and provide feedback in live sessions.
What Were Looking For
At least 5 years of professional experience in rating, review, editing, fact-checking, trust and safety, or a relevant professional domain.
Native or near-native written English proficiency.
Experience grading or reviewing expert-level answers against rubrics, policies, or style guides.
Experience leading or reviewing other raters, such as as a QA lead, rubric owner, or reviewer of reviewers.
An advanced degree, professional license, or deep working expertise in the domain you grade.
Hands-on AI data annotation experience, search-quality rating, or experience writing and maintaining grader guidelines is a plus.
Compensation & Benefits
Compensation is $50 to $120 per hour, depending on the project, field, and expertise level. Payment is based on hours worked.
Location
Fully remote. Projects typically run from one week to several months.
Similar remote jobs
More like this →
Technical Program Manager

SPD Technology - Current Openings
Machine Learning and Artificial Intelligence Engineer


Discover More than 100,000 Hidden Remote Jobs Before Everyone Else
Unlock All Remote Jobs Today
Simple pricing. Big savings on Quarterly and Yearly.
Monthly Access
- Instant access to fresh remote jobs from 500+ companies
- New opportunities added hourly, often 3-7 days before anywhere else
- Advanced filtering by role type, stack, pay, and location
- Priority customer support
Yearly Access
- Everything in Monthly
- Save $169 (~74%) vs paying monthly
- Average job search takes ~6 months - get covered for the whole journey
- Less than the cost of one lunch per month for competitive advantage
- Equivalent to just ~$4.92/month