Invisible Agency logo

Agentic Audio Specialist

Invisible Agency
Remote
Remote· 2 months ago

Straight from Invisible Agency’s careers page. Apply on the company site — no recruiter, no middleman.

Agentic Audio Specialist - Freelance AI Trainer Project

Location: World Wide - Remote

Department: Language & Linguistics

A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program’s mission is to evaluate and optimize model performance for real-world customer support use cases.
Responsibilities
  • Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions across multiple domains, including:
    • Flight bookings and travel support
    • Financial services
    • Telecommunications and technical support
  • Contribute to the development of diverse and representative datasets used to assess conversational audio agents.
  • Evaluate model performance across a standardized set of qualitative and quantitative metrics.
  • Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow.

Evaluation Metrics
Model performance is assessed using a combination of conversational, technical, and audio-specific criteria, including but not limited to:
  • Task completion accuracy and efficiency
  • Conversational naturalness (tone, flow, and coherence)
  • Audio comprehension and response quality
  • Instruction adherence and contextual understanding
  • Basic computer programming literacy, including:
    • Understanding of JSON structures
    • Familiarity with functions and methods
    • Ability to reason about structured data and simple logic
  • Technical communication clarity when handling support-style problem-solving

Technical & Equipment Requirements
  • Strong verbal communication skills in a simulated customer support context
  • English proficiency including fluency across all language skills: reading, listening, writing, and speaking.
  • Access to a high-quality microphone to ensure clean, reliable audio input during evaluations
  • Comfort working with structured prompts, evaluation rubrics, and technical guidelines
  • Device capable of running audio recording software and opening large technical documentation

We offer a pay range of $11-to- $30.65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.

Employment type: Contract
Workplace type: Remote
Seniority level: Mid‑Senior Level

Similar remote jobs

More like this →
KeyBank logo

KeyBank

API Security Engineer

Remote
Brooklyn, OH$116k–$216k
✓ From careers page· about 2 hours ago
Kobie logo

Kobie

Lead Software Engineer (Remote)

Remote
St. Petersburg, FL
✓ From careers page· about 3 hours ago
GDIT logo

GDIT

Full Stack Java Developer (Remote)

Remote
✓ From careers page· about 4 hours ago
Nielsen logo

Nielsen

Senior Product Solutions Architect

Remote
New York, NY
✓ From careers page· about 7 hours ago

Discover More than 100,000 Hidden Remote Jobs Before Everyone Else

Unlock All Remote Jobs Today

Simple pricing. Big savings on Quarterly and Yearly.

Monthly Access

$19/month
  • Instant access to fresh remote jobs from 500+ companies
  • New opportunities added hourly, often 3-7 days before anywhere else
  • Advanced filtering by role type, stack, pay, and location
  • Priority customer support
Start 7-day trial — $2.95
Most Popular

Yearly Access

$59/year
  • Everything in Monthly
  • Save $169 (~74%) vs paying monthly
  • Average job search takes ~6 months - get covered for the whole journey
  • Less than the cost of one lunch per month for competitive advantage
  • Equivalent to just ~$4.92/month
Start 7-day trial — $2.95