Site Reliability Engineer

Site Reliability EngineerNDIF is seeking an experienced Site Reliability Engineer to advance the reliability and coordinate the day-to-day operations of its growing research platform. This role creates systems that keep distributed services healthy and available, makes clusters easier to debug and operate, and builds tooling that enables the platform to scale as demand and deployments grow. This is a hands-on role with significant latitude for assessing complex technical problems, determining priorities, and delivering innovations with minimal oversight. A research background is not required, but knowledge of machine learning operations (MLOps) is highly desirable. The successful candidate will have experience operating production systems, a commitment to operating them well, and motivation to contribute to AI safety and interpretability. Key Responsibilities & Accountabilities Measure and improve the reliability, availability, and performance of the platform used by research teams Build and maintain observability systems so issues are detected early and debugging is proactive rather than reactive Improve operational tooling and automation, including continuous integration and continuous delivery (CI/CD), automated testing, and infrastructure as code Create effective workflows for debugging and resolving issues across the distributed stack, including Ray connectivity, graphics processing unit (GPU) and resource allocation, and scheduling Partner with the broader NDIF team to keep the system dependable and usable as user needs evolve Establish and advocate for operational best practices as the platform grows