Skip to main content

Sr Data Engineer- Lead

spruce infotechAtlanta, GALead L6
Must Have Skills: Pyspark SparkAzure Synapse ScalaSQLNice to Have Skills:
JavaPythonDetailed Job Description: 8-10 Years of Total Experience with minimum 7-8 years of Experience in Data Engineering space on Scala & Spark, Pyspark + Azure Synapse+ Data LakeDesign scalable Azure data architectures using ADLS, Azure Synapse for enterprise analytics using Spark framework. Strong hands-on experience with Azure Synapse Analytics, along with a good understanding or exposure to Microsoft Fabric Develop and manage data models across bronze, silver, gold layers to support reporting and analytics. Delta/Parquet file formats. Ensure performance, reliability, and security by optimizing jobs, monitoring pipelines, and enforcing governance. Deep understanding of Apache Spark architecture and distributed data processing concepts Proficient in Scala and Python Experience working with Azure Synapse. Experience with KQL to query Log Analytics. Working experience with source code repository like GIT/Azure Repos & build tools like Maven. Strong problem-solving skills and excellent communication skills. Lead and collaborate by mentoring engineers, driving best practices, and working with stakeholders end to end. Minimum Years of Experience:
  • 8-10 years Certifications Needed:
  • NoneTop 3 responsibilities you would expect the Subcon to shoulder and execute:
Interview Process: (Is face to face required?) • Virtual
APPLY NOW (opens in a new tab)

Matching similar jobs

Level

Lead L6

Location

Atlanta, GA

Occupation

Data Warehousing Specialists

Industry

Computer Systems Design Services

Posted

yesterday

APPLY NOW (opens in a new tab)