Skip to main content

DATA ENGINEERS

ipolarityPiscataway, NJSenior L5

$166,754 per year

Experience Required: 5 YearsMinimum Education Required BachelorsExpected Start Date 11/16/2026 Compensation $166,754.00 - $166,754.00 / YearlyHours Per Week 40 Number Of Positions 5Shift First Shift (Day)
Job Description: Design and implement automation frameworks underpinning the migration. Build reusable transformation component libraries covering parameterized ingestion, SCD processing, data quality assertion, and reconciliation reporting. Construct end-to-end column-level data lineage and data flow diagrams. Identify and eliminate data processing redundancies and perform pipeline inventory analysis. Implement Terraform IaC managing all Databricks and AWS resources. Execute Ab Initio legacy pipelines in parallel with new PySpark/Databricks equivalents. Track lineage from Oracle/Snowflake source systems through Ab Initio transformation layers and PySpark pipelines to Delta Lake Gold consumption tables. Skills required: AWS, Python, PySpark, Databricks, Terraform, ETL, Ab Initio, Oracle, Snowflake, airflow, dbt and Apache Kafka. Bachelor’s degree in Science, Technology, or Engineering (any) with 5 years of experience in the job offered or related occupation is required. Work location: Piscataway, NJ and various unanticipated locations throughout the U.S.Email Resume to HR Dept., Ipolarity, LLC., at hr@ipolarityllc.comPlace of Work On-siteRequisition ID DE191Job Type Full TimeApplication Email hr@ipolarityllc.com
APPLY NOW (opens in a new tab)

Matching similar jobs

Level

Senior L5

Salary

$166,754 per year

Location

Piscataway, NJ

Occupation

Data Warehousing Specialists

Industry

Computer Systems Design Services

Posted

2 days ago

APPLY NOW (opens in a new tab)