Senior Staff Engineer, Data Platform
virtual vocationsNew York, NY
Senior Staff Engineer, Data Platform
Setting the technical direction for the Data Platform, the full-time Senior Staff Engineer, Data Platform will architect and build the Databricks lakehouse, design data pipelines, and lead AI pipeline development while working remotely.
Key Responsibilities:
Own and evolve the architecture of the Databricks lakehouse, including governance and performance strategies
Design, build, and optimize Spark and SQL pipelines, ensuring data quality and cost management
Mentor engineers across teams and establish platform-wide standards while communicating technical trade-offsRequired QualificationsBachelor's Degree in Computer Science, Electrical Engineering, Mathematics, or a related field
12+ years of software or data engineering experience with a focus on production data platforms
Experience in a highly regulated domain such as Healthcare, Insurance, or Finance
Deep expertise with Databricks and familiarity with the lakehouse stack, including Spark and Delta Lake
Fluency in Python and SQL, with sound software engineering practices including CI/CD and code review
Matching similar jobs
Level
Lead L6
Location
New York, NY
Occupation
Data Warehousing Specialists
Industry
Computer Systems Design Services
Posted
yesterday