Video Evaluation Specialist - Annotator
mercorNew York, NY
$15–$20/hour
APPLY (opens in a new tab)Video Evaluation Specialist - Annotator
mercorNew York, NYJunior L3
$15–$20/hour
Other Scientific and Technical Consulting ServicesTeleproduction and Other Postproduction ServicesEducational Support Services
APPLY NOW (opens in a new tab)Job Description Job DescriptionAbout the job
Mercorconnects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors includeBenchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers, andJack Dorsey.
Position: Video Evaluation Generalist
Type: Contract
Compensation: $15–$20/hour
Location:
Remote
Commitment:20 hours/week
Role Responsibilities:
Evaluate paired video outputs by comparing two short video clips against a provided rubric for prompt adherence, motion quality, visual artifacts, and physical plausibility.
Score and justify preferences by assigning rubric scores to each clip, selecting an overall preference, and documenting a brief written justification.
Maintain scoring consistency across high task volumes, ensuring calibration to the rubric remains steady for reliable judgments.
Work independently and meet deadlines in a structured project environment with clear goals and tools.
Qualifications
Must-Have:
BS or BAfrom a reputable institution completed or in progress.
Strong writing and critical thinking skills.
Ability to work independently and meet deadlines.
Preferred
2+ yearsof experience in teaching or research.
Application Process (Takes 20–30 mins to complete)
Complete an AI-led interview, this should take around 15 minutes.
If selected, you will be invited to work on the project.
Resources & Support
For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
For any help or support, reach out to:
PS:
Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Matching similar jobs
Level
Junior L3
Salary
$15–$20/hour
Location
New York, NY
Occupation
Proofreaders and Copy Markers
Industry
Other Scientific and Technical Consulting Services
Posted
today