Sr Data Engineer- Lead
spruce infotechAtlanta, GA
Sr Data Engineer- Lead
Must Have Skills: Pyspark SparkAzure Synapse ScalaSQLNice to Have Skills:
JavaPythonDetailed Job Description:
8-10 Years of Total Experience with minimum 7-8 years of Experience in Data Engineering space on Scala & Spark, Pyspark + Azure Synapse+ Data LakeDesign scalable Azure data architectures using ADLS, Azure Synapse for enterprise analytics using Spark framework. Strong hands-on experience with Azure Synapse Analytics, along with a good understanding or exposure to Microsoft Fabric Develop and manage data models across bronze, silver, gold layers to support reporting and analytics. Delta/Parquet file formats. Ensure performance, reliability, and security by optimizing jobs, monitoring pipelines, and enforcing governance. Deep understanding of Apache Spark architecture and distributed data processing concepts Proficient in Scala and Python Experience working with Azure Synapse. Experience with KQL to query Log Analytics. Working experience with source code repository like GIT/Azure Repos & build tools like Maven. Strong problem-solving skills and excellent communication skills. Lead and collaborate by mentoring engineers, driving best practices, and working with stakeholders end to end. Minimum Years of Experience:
- 8-10 years Certifications Needed:
- NoneTop 3 responsibilities you would expect the Subcon to shoulder and execute:
Interview Process: (Is face to face required?) • Virtual
Matching similar jobs
Level
Lead L6
Location
Atlanta, GA
Occupation
Data Warehousing Specialists
Industry
Computer Systems Design Services
Posted
yesterday