Senior Software Engineer, Apple Data Platform
appleCupertino, CA
Senior Software Engineer, Apple Data Platform
appleCupertino, CALead L6
Overview:
In this role you will advance Spark at Apple’s scale while accelerating Apache DataFusion Comet. You’ll design native operators and expressions, extend Comet’s Spark integration, and optimize IO, memory, and shuffle for large-scale workloads. You’ll work with open-source communities and cross-functional teams to ensure compatibility and performance. This is a hands-on, impact-first position focused on pushing the boundaries of distributed query engines. You will help shape high-performance data systems used by millions. Compensation / Benefits Medical and dental coverage Retirement benefits Employee stock programs Tuition reimbursement Relocation assistance Discounted products and free services
Responsibilities:
Design and implement native operators/expressions using DataFusion and Arrow Extend Comet integration across Spark versions Accelerate Iceberg/Parquet reads and writes while preserving Spark compatibility Profile, benchmark, and optimize memory, shuffle, and I/O for reliability at scale Collaborate with open-source contributors and cross-team partners to upstream improvements Promote performance, correctness, and stability in production environments
Key requirements:
3+ years of professional software engineering experience Proven track record building distributed systems Contributor or committer to Apache Spark and/or Apache DataFusion/Comet BS in Computer Science or related field, or equivalent practical experience Collaborative mindset with cross-functional teams Strong communication and teamwork Problem-solving mindset and bias for action Deep knowledge of Apache Spark internals Experience with Apache Iceberg and Apache Parquet internals Proficiency with Apache Arrow and DataFusion
Matching similar jobs
Level
Lead L6
Location
Cupertino, CA
Occupation
Software Developers
Industry
Software Publishers
Posted
today