Prompt Evaluation Associate

About the job

- Job Title: Prompt Evaluation Associate (Remote)
- Employment Type: Remote (Part-Time)
- Location: Remote within one of the following countries: United States, United Kingdom, Canada, Ireland, Australia, or New Zealand.
- Compensation: Up to USD 18 per hour, depending on location, experience, scope of responsibilities, and performance.

About the Role
- This role focuses on evaluating AI prompts and model responses for quality, accuracy, relevance, and effectiveness across various AI applications in a fully remote environment.
- You will collaborate closely with the team to assess prompt-response pairs, annotate outputs, provide feedback using rubrics, and help keep evaluation processes organized, AI performance improved, and prompt workflows efficient.
Key Responsibilities
- Assist with prompt evaluation-focused project tasks such as prompt-response rating, output assessment, error annotation, rubric application, data entry and maintenance, online research, basic analysis, operations support, AI-output review, documentation, and coordination.
- Review, organise, and update evaluation files and related information with a high level of accuracy and attention to detail.
- Communicate clearly with team members through written and verbal channels and provide timely updates on task status and progress.

Skills & Qualifications
- Strong command of written English and clear, professional communication skills.
- Comfort using digital tools such as email, spreadsheets, AI evaluation platforms, project management or online productivity tools.
- Analytical mindset with strong attention to detail and accuracy.
- Ability to manage time, prioritise tasks, and work independently in a remote environment.
- Interest in AI prompt evaluation, LLM testing, response analysis, or data-related work is helpful but not required; training and onboarding will be provided.

What We Offer
- 100% remote work within the listed countries, with flexible scheduling aligned to team needs and agreed time zones.
- Weekly payments via secure, compliant payment methods, with a clear and transparent compensation structure.
- Opportunities to build skills in research, content operations, data handling, prompt evaluation, and AI-related workflows.
- A supportive work culture that encourages feedback, learning, and long-term professional growth.

You must be legally authorised to work in the country where you are based.

We welcome applicants from all backgrounds and make hiring decisions based solely on qualifications, experience, and business needs, in line with applicable employment and anti-discrimination laws.

Apply now to be considered for this opportunity.