Search Engine Quality Evaluator - English (Remote) Job at Scale AI, State College, PA

  • Scale AI
  • State College, PA

Job Description

Salary: $31,200 - 31,200 per year Requirements:

  • Fluent in English, with strong written communication skills and comfort with natural, everyday conversation
  • Careful attention to detail and patience to review media closely, including replaying audio or zooming in on images and video
  • Ability to think on your feet and discuss realistic scenarios naturally
  • Experience writing concise, evidence-based explanations or reviews
  • Confidence making a clear choice when both options have flaws
  • A bachelors degree or higher is a plus
  • To sign up, provide a valid ID and mobile phone from your country of residence, an up-to-date resume, and a LinkedIn profile showing your education and work history
  • Applicants must be authorized to work in their country of residence; applications are currently accepted from Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States
Responsibilities:
  • Hold live, scenario-based conversations in English with AI voice models and assess how natural, useful, and clear their responses are
  • Compare AI-generated images and videos, including edited media, and determine which better follows the prompt or source material
  • Closely inspect media for issues such as distorted anatomy, flickering, unnatural movement, text errors, or mismatched audio and video
  • Rate outputs for qualities such as instruction adherence, quality, and realism, and explain findings in specific written feedback
  • Label first-person videos of people or robots performing hands-on tasks by dividing clips into actions and correcting AI-generated caption drafts
  • Evaluate AI-generated speech for naturalness, pronunciation, and similarity to a target voice; some tasks involve recording a brief spoken explanation
Technologies:
  • AI
  • Mobile

More:

Outlier is an AI training platform owned and operated by Scale AI. We engage experts on projects that help evaluate and improve AI systems, including work that supports the development of advanced models for real-world use. This is a remote, flexible freelance opportunity on the Outlier.ai platform, with no minimum hours; contributors can set their own schedules. Project work pays up to USD $15 per hour, with rates varying according to expertise, assessment results, location, project needs, and other factors. Additional Missions incentives may be available, and payments are processed weekly on Tuesdays through PayPal, AirTM, or ACH transfer. We provide free access to leading large language models valued at over $200 per month, and our community includes more than 900,000 experts across 52 countries. To apply, create an Outlier account, upload a resume and valid ID, then complete available tasks. This is an independent-contractor opportunity, not employment; internships and sponsorship are not offered.

last updated 44 week of 2026

Job Tags

Hourly pay, Full time, For contractors, Freelance, Internship, Remote work, Flexible hours

Similar Jobs

CivicMinds, Inc

Nurse Practitioner Job at CivicMinds, Inc

 ...medical histories. \n Diagnose and treat acute and chronic health conditions. \n Order and review diagnostic tests and laboratory...  ...and Benefits \n \n ~ Health, dental, and vision insurance \n ~401(k)\n ~ Company-sponsored life insurance \n ~ Student... 

Central Coast Aquarium

Summer Camp Counselor Job at Central Coast Aquarium

 ...in preserving marine life. Role Description This is a full-time, on-site role located in Avila Beach, CA. As a Summer Camp Counselor, you will lead and engage with children in educational and recreational activities, promoting ocean stewardship through hands... 

Purple Cow Recruiting

Skilled Trades Recruiter & Business Development | Base + Commission | $51K-$70K Job at Purple Cow Recruiting

 ...Full-time Description Skilled Trades Recruiter & Business Development | Base + Commission | $51K-$70K Full-Time | In-Office | Bethlehem, PA Dana Gudermuth Senior Recruiter | Heartline Staffing Call or Text: (***) ***-**** Email: ****@*****.***... 

Corgan

Interior Design Project Manager | Workplace QA/QC Manager Job at Corgan

 ...Corgan we are passionate about great design but the best thing we build is...  ...recruiting a dynamic QAQC Manager to join the firm as part of our Workplace Interiors Studio. Tackle these responsibilities...  ...documents for use during the project and for archiving upon completion... 

McCaffrey's Food Markets

Coffee Shop Manager Job at McCaffrey's Food Markets

 ...Coffee Bar ManagerFriendly personality and "customer service" mentalityCarry out all merchandising programs for the departmentOrder merchandise and control inventorySupervise and provide in depth training for department personnelMake sure products are prepared, priced...