micro1 logo

Domain Contributor - Evaluation Specialist

micro1
Remote
Remote$62k–$124k· 3 days ago

Straight from micro1’s careers page. Apply on the company site — no recruiter, no middleman.

Role Title: Domain Contributor - Evaluation Specialist


Role Type: Contractor (~15 hrs/week)


Location: Remote


micro1 is engaging Domain Contributor - Evaluation Specialists to support an internal project evaluating and improving advanced AI models. In this role, youll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Flexible, pay-per-task work across history, law, finance, journalism, and tech, for experts with prior AI training experience.


Scope of Work

  1. Design nuanced, domain-specific tasks that probe AI model limits and surface reasoning flaws.
  2. Author questions and scenarios demanding deep subject knowledge, beyond general understanding.
  3. Assess AI-generated outputs, validating accuracy against authoritative, primary sources in your area of expertise.
  4. Document clear rationales for model shortcomings, specifying missed reasoning, source errors, or nuances.
  5. Apply detailed task guidelines and evaluation rubrics consistently to each submission.
  6. Submit completed deliverables independently on a rolling basis, meeting project requirements for written and verbal clarity.


Preferred Qualifications

  1. Proven hands-on experience with AI model training, annotation, RLHF, or evaluation.
  2. Deep expertise in a core domain: history, archival or library science, law (paralegal, legal academic, compliance), finance (equity research, PE/VC, forensic accounting), journalism, or technology/industry history.
  3. Advanced research skills with a track record of verifying complex claims against authoritative sources.
  4. Exceptional written and verbal communication skills to articulate findings and feedback.
  5. Demonstrated ability to precisely follow detailed instructions and evaluation frameworks.
  6. Background in adversarial or “stomp the model” task design is advantageous.
  7. Graduate-level research, experience at a Fortune 100 company, or professional fluency in a non-English language a plus.


Compensation Structure

Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.


Start Timeline & Availability

We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.

Similar remote jobs

More like this →
M&M Software logo

M&M Software

Domain Expert Energy Market & Digital Solutions

Remote
St. Georgen im Schwarzwald
✓ From careers page· about 3 hours ago
Pennylane logo

Pennylane

Product Domain Specialist, Agricultural Sector

Remote
✓ From careers page· about 7 hours ago
Palo Alto Networks logo

Palo Alto Networks

Channel Cortex Domain Consultant - Southern Europe

Remote
Madrid, Spain
✓ From careers page· about 11 hours ago
Palo Alto Networks logo

Palo Alto Networks

Domain Consultant, Next-Gen Trust Security

Remote
Zurich, Switzerland
✓ From careers page· about 11 hours ago

Discover More than 100,000 Hidden Remote Jobs Before Everyone Else

Unlock All Remote Jobs Today

Simple pricing. Big savings on Quarterly and Yearly.

Monthly Access

$19/month
  • Instant access to fresh remote jobs from 500+ companies
  • New opportunities added hourly, often 3-7 days before anywhere else
  • Advanced filtering by role type, stack, pay, and location
  • Priority customer support
Start 7-day trial — $2.95
Most Popular

Yearly Access

$59/year
  • Everything in Monthly
  • Save $169 (~74%) vs paying monthly
  • Average job search takes ~6 months - get covered for the whole journey
  • Less than the cost of one lunch per month for competitive advantage
  • Equivalent to just ~$4.92/month
Start 7-day trial — $2.95