Job Description

Hi,

Greetings of the day!

We are hiring for the below position

Role: Sr Data Engineer -3635

Location: Remote

Duration: 5+ months

Would prefer someone in the Pacific, Mountain, or Central time zone in that order, if possible.

Working hours: 9 am - 6 pm, can adjust

About the Team & the Role

The Core Data team builds and scales the data platform and analytics capabilities that power decision-making across client locations. Within Core Data, the Vehicle Catalog team owns the vehicle domain - ingesting, curating, and organizing vehicle data for analytics, ML, and BI use cases used by hundreds of stakeholders across dozens of domain teams.

We are migrating the Vehicle Catalog to a new Databricks account while simultaneously building out a new vehicle catalog on that platform. As a Sr. Data Engineer, you will help us refactor and move the existing ETL/ELT and analytics pipelines into the new environment , migrate the underlying data, and validate that everything lands correctly.

This is hands-on migration work. You'll be working alongside our engineers on well-defined pipelines with clear acceptance criteria, and you'll pick up related migration requests - including dashboard and reporting migrations - as they come up.

What You'll Do

• • Work with one of our Staff Data Engineers to understand the migration plan, sequence your work against it, and provide regular progress updates.
  • Refactor existing ETL/ELT code written in PySpark, DABs and dbt from the current Databricks environment to meet the patterns and standards of the new account.
  • Migrate data pipelines and their underlying datasets, including backfills, and validate parity between source and target.
  • Build and run reconciliation checks - row counts, schema conformance, freshness, completeness - to confirm migrated data matches the legacy environment.
  • Migrate dashboards and downstream reporting assets to point at the new datasets, coordinating with the analysts who own them.
  • Update orchestration, scheduling, alerting, and runbooks so migrated pipelines are supportable after cutover.
  • Troubleshoot pipeline failures and data discrepancies during and after cutover.
  • Document what was migrated, what changed, and anything the team needs to know to own it going forward.
  • Take on adjacent migration and data engineering requests as the program evolves.

Qualifications

Required

• • 6+ years of experience in Data Engineering, Analytics Engineering, or Software Engineering working with production data systems.
  • Strong expertise in SQL and Python for building scalable data pipelines and transformations.
  • Strong familiarity with AI tools like Claude Code / Devin for SW development process
  • Hands-on experience building ELT pipelines using modern cloud data platforms (Databricks experience required).
  • Building robust testing frameworks for Data Migration ( Completeness, Quality etc)
  • Deep experience with dbt , including model development, testing, documentation, and CI/CD integration
  • Experience designing and operating production-grade data pipelines with monitoring and observability.
  • Strong collaboration skills and ability to partner with engineering teams, analysts, and operational stakeholders.
  • Bachelor's or master's degree in computer science, Engineering, Mathematics, or related field, or equivalent practical experience.
  • Prior data or platform migration experience

Nice-to-Have Skills

• • Familiarity with Fivetran connector management and ingestion architecture.
  • Experience with data contracts and schema governance.
  • Knowledge of streaming or near-real-time data pipelines.

Sriram R- Account Manager

iFlow Inc

+1 469-250-9791

sriram@iflowglobal.com

Job Tags

Similar Jobs