AI Medical Records Evals Specialist Remote · Contract Job at MedRecords in New York

Medrecords AI helps attorneys, physicians, medical-legal professionals, insurers, and claims teams process large medical records faster and more accurately. Our users are IME and QME physicians, medical expert witnesses, personal injury and malpractice attorneys, legal nurse consultants, life care planners, claims adjusters, and TPAs. For them, a missed diagnosis, a wrong date, or an unsupported claim can change the outcome of a case. As an AI Medical Records Evals Specialist, you are the human quality-control layer between our AI and the people who rely on its output. You take a set of medical records and the chronology, summary, report, or Q&A answer our system generated from them, and you check the second against the first, line by line: what did the AI miss, misstate, or invent; are the dates, diagnoses, medications, procedures, providers, and encounters right; does every citation point to the passage it claims to support. You turn what you find into structured evaluation data, and into eval sets and edge cases that keep the system honest as it changes. Strong plus: clinical background as an RN, LPN/LVN, medical coder, or nurse/medical reviewer; experience with IME/QME, personal injury, malpractice, or workers' comp records; exposure to LLM evaluation, prompt testing, or AI QA.