Research Engineer, Post-Training Model Evaluations
prof rodMillbrae, CA
Research Engineer, Post-Training Model Evaluations
prof rodMillbrae, CASenior L5
Other Scientific and Technical Consulting ServicesResearch and Development in the Physical, Engineering, and Life SciencesAll Other Professional, Scientific, and Technical Services
APPLY NOW (opens in a new tab)Research Engineer, Post-Training Model Evaluations Investigate model quality during production post-training, maintain evaluation coverage and explain regressions to research teams. Vacancy announcement Who this suits: Individual qualified applicant Accepting applications has not been verified separately from the announcement. USD 500,000–850,000/year (salary; 2026-10-05). Published annual salary range; employer determines level. What the institution asks for Experience designing and analyzing ML evaluations at scale; strong Python and production-system skills. Statistics and experimental design are additional strengths. Bachelor's degree or equivalent experience; office attendance expected. ProfRod's suggested preparation Understand what this work involves Practice the paired comparisons used to investigate changes in post-training evaluation results. Predict the difference before recomputing the saved results. Name the sampling unit, interval and one limit; keep the notebook output with your memo.
Matching similar jobs
Level
Senior L5
Location
Millbrae, CA
Occupation
Data Scientists
Industry
Other Scientific and Technical Consulting Services
Posted
yesterday