Remote Rubric Evaluation Specialist
auraoneNew York, NY
Remote Rubric Evaluation Specialist
Other Management Consulting ServicesCustom Computer Programming ServicesOther Scientific and Technical Consulting Services
AuraOne is seeking a Rubric Expert to review rubric evaluation prompts and responses, compare outputs, label edge cases, and provide structured feedback for retraining the model.
AI data reviewers help turn rubric evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data. Review frontier model outputs, judge benchmark failures, and calibrate other evaluators. This remote contractor role requires clear written reasoning and reliable async availability.
Matching similar jobs
Level
Senior L5
Location
New York, NY
Occupation
Human Resources Specialists
Industry
Other Management Consulting Services
Posted
2 days ago