HPC Storage Engineer
sw5 consultingNew York, NY
$150,000 – $250,000
APPLY (opens in a new tab)HPC Storage Engineer
Computer Systems Engineers/ArchitectsNetwork and Computer Systems AdministratorsComputer and Information Research Scientists
Computer Systems Design ServicesComputing Infrastructure Providers, Data Processing, Web Hosting, and Related ServicesComputer Storage Device Manufacturing
Job DescriptionJob DescriptionHigh Performance Compute (HPC) Storage Engineer
Locations: Austin, TX | Chicago, IL | New York, NY | London, UK | Norway
About the Role:
The Infrastructure and R&D engineering group at a leading global quantitative trading firm designs, builds, and maintains the high-performance computing, networking, and data storage systems that power round-the-clock automated trading strategies and research platforms. The Storage Engineering team manages exabyte-scale data infrastructure tailored for state-of-the-art AI/ML workloads.
We are seeking an experienced Storage Engineer who thrives in a fast-paced environment and values an open, collaborative organizational culture. In this role, you will oversee existing storage systems while taking key responsibility for designing, automating, and scaling next-generation storage architectures. Joining a agile team dedicated to HPC storage, you will have significant autonomy to evaluate, prototype, and implement new hardware and software technologies to maximize performance and usability across the global research ecosystem.
Responsibilities:
Design, deploy, and manage a diverse suite of high-performance storage solutions.
Troubleshoot complex storage, Linux OS, and networking interactions.
Develop custom automation and tooling to enhance performance, reliability, and telemetry across storage clusters.
Research, benchmark, and integrate emerging storage hardware and software technologies.
Qualifications:
Distributed Filesystems: Deep expertise with distributed file systems for large-scale cluster environments (e.g., Lustre, CephFS, GPFS/MMFS).
Storage Design: Proven ability to architect custom, highly available NAS architectures with built-in redundancy.
HPC Experience:
3+ years in high-performance computing or ultra-low-latency environments managing petabyte-scale storage deployments (1PB+).
Enterprise Storage Solutions: 3+ years working with scale-out enterprise platforms (e.g., VAST Data, Isilon, NetApp, Pure Storage).
Linux Systems & Filesystems: Advanced proficiency in Linux system administration, OS troubleshooting, NFS, ZFS, and native Linux filesystems.
Scripting & Automation: Strong practical experience in Python and shell scripting (Bash).
Execution & Collaboration: Excellent cross-functional communication, strong time management, and the ability to balance solo execution with collaborative problem-solving in dynamic environments.
Compensation & Benefits
Base Salary Range:
$150,000 – $250,000 USD per year (or local currency equivalent), determined by location, skills, and experience.
Additional Compensation:
Eligible for discretionary annual performance bonuses and a comprehensive benefits package.
Matching similar jobs
Level
Lead L6
Salary
$150,000 – $250,000
Location
New York, NY
Occupation
Computer Systems Engineers/Architects
Industry
Computer Systems Design Services
Posted
today