Data Engineer -27793

What You'll Do: Build batch and incremental pipelines that bring data from ERP, CRM, and other operational systems into the Databricks Lakehouse. Use medallion architecture to land raw data in bronze, validate and standardize it in silver, and publish curated models in gold for reporting and analytics. Review existing notebooks, pipelines, and data models built by implementation partners. Trace dependencies, fix gaps, and document how to operate and troubleshoot them. Monitor job failures and data freshness. Troubleshoot root causes and add automated checks to validate data and reconcile it to source systems. Apply Unity Catalog standards for access controls, ownership, and lineage. Use Git, code review, and CI/CD to deploy changes.

What You'll Bring: Approximately 3 years of data engineering experience, including at least 2 years building production pipelines in Databricks. Hands-on experience implementing bronze, silver, and gold layers using Delta Lake. Strong SQL, Python, and PySpark skills, with experience orchestrating pipelines in Databricks Workflows or Lakeflow Jobs. Working knowledge of Unity Catalog and Azure data services such as Azure Data Lake Storage or Azure Data Factory. Bachelor's degree in a related field or equivalent practical experience.

Preferred Experience: Integrating SAP ECC, Microsoft Dynamics GP, Salesforce, or similar enterprise systems. SAP ECC experience is especially valuable. Experience with Lakeflow Declarative Pipelines, Power BI, or data engineering in regulated manufacturing. Travel Up to 10%.