Worked on a large scale data migration project.
• Led enterprise-scale data migration from legacy systems to Databricks, architecting a robust Data Lake with Delta Lake
integration for scalable analytics.
• Engineered and optimized Silver and Gold layers in the ETL pipeline, driving high-performance data pipeline optimization
and seamless data transformation.
• Migrated 1,500+ tables and refactored 150+ complex Talend workflows into streamlined workflow orchestration, enabling
modular and efficient pipelines.
• Developed DDL scripts for 500+ tables, integrated CI/CD for data delivery, and implemented data quality monitoring with
rigorous unit testing.
• Led a domain-specific team and engaged directly with clients to define and deliver solutions aligned with evolving business
data requirements.