ML Engineer - Austin, TX
optimeAustin, TX
We are astealth-mode startupbuilding next-generation infrastructure for the AI industry. Our mission is to make advanced language models portable, efficient, and customizable for real-world deployments. We’re building tools that allow vendors to fine-tune models easily and deploy them securely on diverse hardware. Role
We are seeking aAIML Engineer (Python)to help design and implement ourAI Pipelines. This is not an academic research role — you will be productizing and automating existing fine-tuning techniques (LoRA/QLoRA) so vendors can train and manage their own adapters with minimal effort. You’ll work closely with backend engineers (Node.js) who orchestrate jobs and dashboards, while you focus on thetraining pipelines and adapter export logic .Responsibilities
Implement and maintain LoRA/QLoRA fine-tuning pipelinesusing PyTorch + Hugging Face Transformers + PEFT.Develop logic forincremental training and adapter stacking, producing clean, versioned “delta packs.”Automatedata preprocessing(tokenization, formatting, filtering) for user-supplied datasets. Build training scripts/workflows that integrate with orchestration backends (Node.js, REST/gRPC, or job queues).Implement monitoring hooks (loss curves, checkpoints, eval metrics) to feed into dashboards. Collaborate with DevOps to ensure reproducible, portable training environments. Write tests to guarantee reproducibility and correctness of adapter outputs. Willingness to occasionally be present in the office for discussions and team collaboration.
Requirements:
Strong programming skills inPython .Hands-on experience with PyTorchand the Hugging Face ecosystem(Transformers, Datasets, PEFT).Familiarity with LoRA/QLoRA or parameter-efficient fine-tuningmethods. Understanding ofmixed precision training (FP16/BF16)and memory optimization techniques. Experience buildingtraining scriptsthat are production-ready (reproducibility, logging, error handling).Comfortable working inLinux GPU environments(CUDA, ROCm).Ability to collaborate with backend/frontend engineers who are not ML specialists.
Nice to Have:
Experience withbitsandbytes , xformers, orflash-attention .Familiarity with distributed training (multi-GPU, NCCL, DeepSpeed, or Accelerate).Prior work inMLOpsor packaging ML pipelines for deployment. Contributions to open-source ML libraries.
Why Join:
Build thecore training productthat lets vendors adapt models safely and efficiently. Focus onproduct engineering, not open-ended research. Collaborate with a lean, highly technical team at the intersection of AI and systems. Competitive compensation, equity potential, and flexible remote work.
Matching similar jobs
Level
Senior L5
Location
Austin, TX
Occupation
Software Developers
Industry
Custom Computer Programming Services
Posted
yesterday