Remote-First Lead ML Inference Systems Engineer
runpodMt Laurel, NJ
Remote-First Lead ML Inference Systems Engineer
runpodMt Laurel, NJLead L6
Computer Systems Engineers/ArchitectsSoftware DevelopersComputer and Information Research Scientists
Computer Systems Design ServicesCustom Computer Programming ServicesComputing Infrastructure Providers, Data Processing, Web Hosting, and Related Services
APPLY NOW (opens in a new tab)Runpod is hiring an ML Systems Engineer, Inference to own end-to-end LLM serving performance, optimizing latency and cost across models and hardware generations. This hands-on role requires identifying bottlenecks, implementing fixes, and delivering reliable production configurations.
You will profile serving stacks, define metrics, and collaborate with product and infra teams to shape Runpod's inference offerings. Remote-first team with competitive compensation and equity.
Matching similar jobs
Level
Lead L6
Location
Mt Laurel, NJ
Occupation
Computer Systems Engineers/Architects
Industry
Computer Systems Design Services
Posted
yesterday