Lead Data Engineer – Integration & Migration

Job Details

  • Salary
  • Experience 7 Years Experience

Lead Data Engineer – Integration & Migration

  • Sri Lanka

Job Overview

We are seeking an experienced Lead Data Engineer – Integration & Migration to drive the technical design and delivery of enterprise data migration and integration solutions. This role requires strong expertise in data engineering, ETL development, and Azure data platforms, combined with the ability to lead technical discussions and mentor engineering teams.

The successful candidate will be responsible for defining technical approaches, overseeing migration and integration execution, and ensuring scalable, high-performance solutions that meet business and operational requirements.

Key Responsibilities

Technical Leadership & Solution Design

  • Define end-to-end technical strategies for data migration and integration delivery.

  • Establish standards for data modeling, SQL development, ETL design, and Azure-based integrations.

  • Review ERDs, source-to-target mappings, ETL designs, and data transformation logic.

  • Ensure solutions meet expectations for performance, scalability, reliability, and security.

  • Lead technical design discussions and act as the primary escalation point for complex technical issues.

Data Migration & Integration Delivery

  • Lead the execution of CRM data migration and integration strategies.

  • Define entity mappings, relationships, and incremental migration approaches.

  • Oversee API-driven and event-based integrations across enterprise platforms.

  • Support cutover planning, parallel runs, and post-migration stabilization activities.

  • Drive data reconciliation, validation, and quality assurance processes.

Azure Data Platform Implementation

  • Design data ingestion and staging workflows using Azure Data Lake (ADLS).

  • Define logical data layers for data ingestion, transformation, and consumption.

  • Implement orchestration workflows using Azure Logic Apps.

  • Develop and govern Azure Function Apps for integrations and data processing.

  • Ensure monitoring, logging, and operational alerting mechanisms are implemented.

Data Engineering & Performance Optimization

  • Guide dimensional data modeling approaches for reporting and analytics.

  • Define SSIS architecture standards, package design, and scheduling practices.

  • Optimize SQL queries and high-volume data processing workflows.

  • Troubleshoot complex performance, reconciliation, and data integrity issues.

  • Ensure migration and integration processes meet operational SLAs.

Governance, DevOps & Delivery Excellence

  • Define GitHub workflows, branching strategies, and code review standards.

  • Support CI/CD implementation and environment promotion processes.

  • Maintain technical documentation and design artifacts.

  • Ensure governance, auditability, and compliance standards are embedded in solutions.

  • Support UAT readiness and production deployment activities.

Team Leadership & Collaboration

  • Mentor engineers and support team capability development.

  • Lead technical reviews, solution walkthroughs, and design sessions.

  • Collaborate with business analysts, QA teams, CRM specialists, and infrastructure teams.

  • Communicate technical risks, dependencies, and mitigation strategies to stakeholders.

Required Technical Skills

Data Engineering & Integration

  • Strong expertise in data modeling (ERDs, PK–FK relationships, cardinality concepts).

  • Advanced SQL development and performance optimization.

  • Enterprise ETL design and development using SSIS.

  • Experience working with multiple data formats (CSV, JSON, XML, Parquet).

  • Strong understanding of data warehousing and reporting data structures.

Azure & Cloud Platforms

  • Hands-on experience with Azure Data Lake (ADLS) and staging architectures.

  • Development experience using Azure Logic Apps and Azure Function Apps.

  • Experience with API-based integrations and event-driven processing patterns.

  • Knowledge of cloud performance, monitoring, and security best practices.

DevOps & Delivery

  • Experience with GitHub version control and code review workflows.

  • Knowledge of CI/CD pipelines and deployment processes.

  • Experience with production support, monitoring, and incident management.

Experience & Qualifications

  • 5–7+ years of experience in data engineering, ETL development, or system integration roles.

  • Proven experience leading technical delivery for medium-to-large scale data migration projects.

  • Strong hands-on development background combined with leadership capabilities.

  • Ability to balance technical execution with stakeholder coordination.

  • Excellent analytical thinking, problem-solving, and communication skills.

Working Arrangement

  • Working Hours: 1:00 PM – 10:00 PM IST

  • Work Model: Hybrid

  • Compensation: Salary paid in USD

Apply This Job