Senior Data Engineer
west monroe partnersBrooklyn, NY
Senior Data Engineer
west monroe partnersBrooklyn, NYLead L6
Overview:
In this Senior Data Engineer role, you design, build, and optimize cloud-based data platforms supporting analytics, AI, and business intelligence. You lead technical delivery on projects within West Monroe’s Data & AI practice, mentoring teammates and shaping solutions for clients. You’ll work with Databricks, Snowflake, and Microsoft Fabric to modernize data ecosystems and enable AI-driven insights. The position blends hands-on engineering with architecture, governance, and collaboration across stakeholders. Compensation / Benefits medical, dental, vision, basic life insurance 401k plan and ESOP annual bonuses unlimited flexible time off ten paid holidays paid parental leave
Responsibilities:
Design, develop, and optimize cloud-native data solutions using Databricks, Snowflake, Microsoft Fabric, and related technologies Architect and deliver modern cloud data solutions across AWS, Azure, and GCP Build scalable batch and streaming data pipelines for analytics and AI applications Design lakehouse and data warehouse architectures to improve access, governance, and performance Collaborate with stakeholders to translate business needs into technical solutions Develop robust ELT/ETL processes, data models, orchestration workflows, and data quality frameworks Enable AI and advanced analytics by creating trusted data foundations for ML and generative AI Apply data engineering best practices for security, governance, monitoring, and DevOps Mentor junior consultants and ensure solution quality across engagements Leverage AI tools to accelerate analysis and improve client outputs Apply AI technologies to enhance insights and delivery efficiency
Key requirements:
4+ years of enterprise data engineering experience Hands-on experience with Databricks, Snowflake, and/or Microsoft Fabric in enterprise environments Experience building cloud-native data pipelines using Spark, SQL, Python, and orchestration tools Experience with lakehouse architecture, data warehousing, data modeling, and ELT/ETL development Experience integrating data platforms with analytics, BI, ML, or generative AI solutions Familiarity with Azure services (Azure Data Factory, Storage, Synapse, Microsoft Fabric) or comparable cloud tech Experience designing cloud-native data platforms on AWS/Azure/GCP with Databricks, Snowflake, Microsoft Fabric Understanding of governance, security, metadata management, and data quality Experience with Git, CI/CD, Infrastructure as Code, and agile delivery Strong analytical, problem-solving, and communication skills across teams Experience integrating AI tools (e.g., ChatGPT) into workflows Willingness to travel 30–50% Commitment to inclusion and diversity, openness to new ideas Ability to work permanently in the United States without sponsorship Hybrid work environment – 2x/week in office strong communication and collaboration with cross-functional teams mentoring and leadership structured problem-solving and critical thinking Databricks Snowflake Microsoft Fabric
Matching similar jobs
Level
Lead L6
Location
Brooklyn, NY
Occupation
Data Warehousing Specialists
Industry
Computer Systems Design Services
Posted
yesterday