Remote Search Engine Evaluator - English Job at Scale AI, Arlington, TX

  • Scale AI
  • Arlington, TX

Job Description

Salary: $31,200 - 31,200 per year Requirements:

  • Fluent in English, with strong written communication and comfort speaking naturally in everyday conversations.
  • Strong attention to detail and patience when reviewing audio and visual content, including replaying or zooming in to inspect issues.
  • Ability to think on your feet and discuss realistic scenarios conversationally.
  • Experience writing concise, evidence-based explanations or reviews.
  • Ability to make a clear choice when both options have flaws.
  • A bachelors degree or higher is a plus.
  • To sign up, you need a valid ID and mobile phone from your country of residence, an up-to-date resume highlighting your expertise, and a LinkedIn profile showing your education and work experience.
  • You must be authorized to work in your country of residence.
  • Applicants are currently accepted from Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States.
Responsibilities:
  • Hold live, scenario-based English conversations with AI voice models and assess how natural, useful, and clear their responses are.
  • Compare AI-generated images and videos, judging which better follows the prompt.
  • Inspect outputs closely for issues such as distorted anatomy, flickering, unnatural motion, text errors, or mismatched audio and video.
  • Rate outputs for qualities such as prompt adherence, quality, and realism, and write specific English explanations supported by what you observed.
  • Compare generated images for instruction-following, visual quality, and AI artifacts; some assignments involve ranking edited images against originals.
  • Rank generated videos against prompts or edited videos against their source clips.
  • Label first-person videos of people or robots performing hands-on tasks by dividing clips into individual actions and writing precise captions, correcting AI-generated drafts as needed.
  • Evaluate generated speech for naturalness, pronunciation, and similarity to a target voice; some assignments require recording a short spoken explanation.
Technologies:
  • AI
  • Mobile

More:

Outlier is an AI training platform owned and operated by Scale AI. Our experts contribute to projects that generate training data and evaluate AI model performance, helping improve how advanced systems reason, learn, and perform in real-world settings. This remote freelance work can be done from anywhere at any time, with no minimum hours and a self-set schedule. Project work pays up to USD $15 per hour, with rates varying according to expertise, skills assessment, location, project needs, and other factors. Contributors may also receive Missions incentives; payments are processed weekly on Tuesdays through PayPal, AirTM, or ACH transfer. We provide free access to leading LLMs valued at over $200 per month and opportunities to collaborate with experts on pre-release models. Our community includes more than 900,000 experts across 52 countries, and we have paid more than $600 million to experts. This is a 1099 contract opportunity: contributors join us as freelancers or independent contractors, not employees. We do not offer internships, sponsorship, or employment through this opportunity. International students may be able to sign up while on a visa; individual tax or immigration questions should be directed to an appropriate advisor.

last updated 44 week of 2026

Job Tags

Hourly pay, Full time, Contract work, For contractors, Work experience placement, Freelance, Internship, Remote work

Similar Jobs

Pizza Hut

Pizza Hut Server Job at Pizza Hut

 ...Pizza Hut Server1108 N MAIN ST, Monticello, IN ID#063c1bb7-b1b0-48a1-909b-a5a201393a37Wage: $7.50 Server Benefits Include:Weekly PayDaily TipsPaid TrainingCasual UniformsPaid VacationFlexible HoursEmployee Meal BenefitCareer GrowthDiscounts for Verizon, AT&T, Firestone... 

University Health

Critical Care Advanced Practice Provider Nurse Practitioner - Physician Assistant Job at University Health

 ...University Health in San Antonio is seeking board-certified Advanced Practice Providers (Acute Care Nurse Practitioners and Physician Assistants) to join a high-acuity, multidisciplinary critical care team at University Hospital. This role supports a 24/7, high... 

Humane Rescue Alliance (HRA)

Public Affairs Specialist Job at Humane Rescue Alliance (HRA)

 ...engagement, corporate relations, or related field. ~ Bachelors degree in communications, public relations, nonprofit management, political science, or related field preferred. ~ An equivalent combination of education and professional experience may be considered.... 

CSI International

Cargo Warehouse Job at CSI International

 ...Cargo AgentU.S. Aviation Services is a leading provider of ground support and facility cleaning services for some of the nation's busiest airports. As part of the United Service Companies family, we bring decades of experience, innovation, and dedication to the aviation... 

Militello Paint and Powerwashing

Get Paid to Talk to People - Canvasser Role (Up to $1,000/Week) Job at Militello Paint and Powerwashing

Job Description Job Description About Militello Painting & Powerwashing Founded in 2002, Militello Painting & Powerwashing is a trusted, family-owned company serving Ambler and the Greater Philadelphia area. Known for exceptional craftsmanship, professionalism, ...