Senior Petabyte-Scale Web Crawling Engineer

Thinking Machines Lab Inc. is seeking a Software Engineer to own and scale our web-crawling systems, from distributed collection to filtering and data preparation for pretraining. You will build the crawler, the scale-out infrastructure, and the data pipelines that convert raw crawls into usable datasets. You'll collaborate with pretraining and data teams to align crawler outputs with model quality goals, while maintaining production-grade reliability for petabyte-scale operations.