Skip to main content

Senior Data Engineer / Databricks Specialist Remote / Telecommute Jobs

clearancejobsNew York, NYSenior L5

$150,000 per year

Senior Data Engineer / Databricks SpecialistSatsyil Corp is seeking a highly skilled and motivated Senior Data Engineer / Databricks Specialist to join our team. In this role, you will play a crucial part in designing, developing and optimizing high-performance Spark applications and managing enterprise data infrastructure within AWS Databricks. Using PySpark, Python, SQL and Delta Lake, you will architect robust ETL/ELT pipelines, maintain medallion architecture and establish efficient big data solutions supporting mission-critical public sector and enterprise environments.
Title: Senior Data Engineer / Databricks Specialist Platform: AWS Databricks (PySpark, Python, SQL, Delta Lake)
Experience: 6+ years of hands-on Databricks development
Salary: $150,000 – $180,000 per year
Clearance: Ability to obtain and maintain a Public Trust Eligibility: U.S. citizens only Mandatory certification: Active Databricks Certified Data Engineer Associate or Databricks Certified Data Engineer Professional Key roles and responsibilities: Develop and optimize scalable Spark applications in AWS Databricks using Python, PySpark and SQL to support data processing and analytics needs. Design, build and maintain robust ETL/ELT pipelines and implement Medallion Architecture (Bronze, Silver, Gold layers), ensuring data integrity, completeness and lineage. Administer Databricks workspaces, including cluster provisioning, job scheduling, access controls, Unity Catalog and notebook management. Manage AWS cloud infrastructure assets including S3, Lambda, IAM, Aurora and Glue, and provision environments using Terraform Infrastructure-as-Code (IaC). Perform query optimization, performance tuning, troubleshooting and debugging for complex Spark jobs and large-scale data solutions. Merge, consolidate and process structured, semi-structured and unstructured data sets from diverse API endpoints and databases. Embed security gates and compliance controls within DevSecOps CI/CD pipelines (Jenkins, GitLab CI) to support FISMA/FedRAMP requirements, ATO reassessments and POA&M resolution. Implement rigorous data quality controls, anomaly detection, validation rules and automated lineage tracking across all pipelines. Collaborate within cross-functional Agile/Scrum teams in multi-contractor federal environments, providing technical leadership and production on-call support. Required experience and technical skills:
Citizenship: U.S. citizenship required. Mandatory certification: Active Databricks Certified Data Engineer Associate or Databricks Certified Data Engineer Professional.
Experience: 6+ years of dedicated hands-on experience in Databricks development. Core big data stack: Production proficiency with PySpark, Spark SQL, Apache Spark and Delta Lake. Cloud ecosystem: Strong experience in AWS Cloud services including S3, IAM, Lambda, Glue and Aurora. Automation and DevOps: Production experience with Terraform (IaC) and CI/CD tools (Jenkins, GitLab CI or equivalent). Languages and frameworks: Deep proficiency in Python and SQL; working knowledge of REST APIs for ingestion.
Clearance: Ability to obtain and maintain a Public Trust. Methodology and education: Hands-on experience in Agile/Scrum delivery environments. Bachelor's degree in CS, IT, Data Science or a related engineering discipline.
Preferred qualifications: Hands-on experience with Unity Catalog, Delta Live Tables (DLT) and AI/ML pipeline support (MLflow, Model Registry). Experience in Federal Government contracting and compliance frameworks (FISMA / FedRAMP environments). Active security clearance (Public Trust or higher). Preferred certifications: Databricks Certified Machine Learning Associate, AWS Certified Solutions Architect – Associate or Professional, AWS Certified Data Engineer – Associate.
Compensation: The salary range for this position is $150,000 – $180,000 per year, based on experience and qualifications.
How to apply: Email your resume to hr@satsyil.com with the subject line "Senior Data Engineer / Databricks Specialist." Include your Databricks certification credential ID. Only U.S. citizens will be considered. Equal opportunity: Satsyil Corp is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veteran status or any other characteristic protected by law.
APPLY NOW (opens in a new tab)

Matching similar jobs

Level

Senior L5

Salary

$150,000 per year

Location

New York, NY

Occupation

Data Warehousing Specialists

Industry

Computer Systems Design Services

Posted

yesterday

APPLY NOW (opens in a new tab)