Databricks Engineer
virtual vocationsNew York, NY
Driving the design and automation of a cloud-native data platform, the full-time Databricks Engineer will collaborate with engineering and business leaders to build scalable data integration solutions that enhance enterprise analytics and decision-making, working remotely.
Key responsibilities:
Lead the design, development, testing, and deployment of scalable batch/streaming data pipelines using Databricks
Collaborate with data engineering teams to define and develop data ingestion, validation, and transformation processes
Implement best practices for Databricks usage, including job orchestration and data quality checksRequired qualifications 5+ years of data engineering experience, with at least 3 years in a lead or senior role
Minimum 3 years of hands-on Databricks experience using Python, SQL, and PySpark
Experience with AWS and/or Azure cloud environments
Strong background in developing large-scale data processing and storage systems
Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field
Matching similar jobs
Level
Senior L5
Location
New York, NY
Occupation
Data Warehousing Specialists
Industry
Computer Systems Design Services
Posted
today