Quality Operations Analyst

Remote Intelligence Generalist | Up to $18/hr | Flexible Schedule
Shape the future of AI through critical analysis and strategic thinking.

Outlier, owned by Scale AI, partners with leading AI labs to train next-generation language models.

Your analytical expertise will directly influence how AI systems reason and respond.
What You'll Do
Evaluate AI-generated responses using sophisticated reasoning and professional judgment.

Develop complex prompts that test AI capabilities.

Apply structured frameworks to assess model performance.

This isn't annotation work—it's intellectually rigorous evaluation requiring critical thinking and analytical depth.

What We're Looking For
-Strong analytical and problem-solving capabilities
-Native English proficiency with excellent writing skills
-Ability to assess nuanced reasoning and identify logical gaps
-Meticulous attention to detail
-Self-directed with strong time management

Nice to Have: Background in philosophy, literature, history, research, or analytical fields.

Experience in writing, editing, or evaluation roles.

Compensation & Flexibility
-Up to $18 USD/hour, paid weekly
-100% remote, work from anywhere in eligible countries
-Choose your hours: 5-10 hours/week typical, up to 40 available
-Free access to Model Playground
-No contracts or fixed schedules

Eligible: Based in United States (18+, authorized to work)
This is a 1099 freelance opportunity.