Remote Helpfulness Ranking Evaluator & Rubric Calibration
auraoneNew York, NY
Remote Helpfulness Ranking Evaluator & Rubric Calibration
Training and Development SpecialistsCompensation, Benefits, and Job Analysis SpecialistsSoftware Quality Assurance Analysts and Testers
Other Management Consulting ServicesCustom Computer Programming ServicesAdministrative Management and General Management Consulting Services
AuraOne, Inc. is seeking a remote Helpfulness Ranking Reward Model Evaluator to assess paired model outputs against a versioned rubric. You will label edge cases, annotate severity, and generate structured feedback to help retrain the model.
This contractor role requires careful written reasoning, attention to detail, and reliable availability for at least 10 hours per week, with compensation discussed after interviews.
Matching similar jobs
Level
Mid L4
Location
New York, NY
Occupation
Training and Development Specialists
Industry
Other Management Consulting Services
Posted
11 days ago