Seeking a musically literate specialist, the contract-based Full Stack Producer (Music Notation, Audio ML) will evaluate the quality of AI models related to music notation and audio, contributing to QA and data labeling efforts across various projects while working remotely.
Key responsibilities: Expert-score every OMR and A2S release each sprint and run deeper quarterly QA cycles with AB-tests Conduct quarterly competitor benchmarking against multiple competitors on the golden dataset and provide fast sanity checks on model candidates between releases Build and label the Autograde golden test set, extending the QA process to adjacent projects as they scaleRequired qualificationsStrong musical literacy with the ability to read and evaluate music notation, scores, and audio performances Experience judging OMR and audio-to-score transcription output for accuracy Familiarity with structured/rubric-based QA scoring methodology Comfortable evaluating a range of score types, including multilingual lyrics and various ensemble formats Attention to detail for spot-checking datasets against ground truth

Matching similar jobs

Level

Senior L5

Location

New York, NY

Occupation

Musicians and Singers

Industry

Custom Computer Programming Services

Posted

yesterday

APPLY NOW