Provided Big-Data solution for a South African Conglomerate. (Ongoing Data Migration Project):-
1. Provided end to end data migration solution from different sources to Teradata using SSIS tool. Made it more cost effective by replacing Informatica with SSIS as transformation tool and removing Cloudera as a staging layer. Used Azure Data Factory pipelines to schedule and trigger SSIS packages. Used Query Surge tool to test data integrity (QA & UAT).
2. Helped clients with their cloud migration journey, by designing and building data pipelines in Azure Data Factory and loading the data in Azure Synapse. It helped to gain insights into business & hence support decision making.
Skills: Microsoft Power BI · Query Surge · Teradata · SQL · SQL Server Integration Services (SSIS) · Azure DevOps · Azure Data Factory · Azure Synapse · SQL Server Management Studio · Microsoft Azure
R&D Intern
IUDX, IISc - Internship
May 9, 2022 - Jul 31, 2022 · 3 mos
Karnataka, India
Worked as a Research Intern with the Deployment team at IUDX at the Indian Institute of Science(IISc) Created a new instance of RabbitMQ using Python for the efficient flow of incoming JSON data and improving Data Publish Efficiency in the Data Exchange's ETL Pipeline.
Skills: JSON · RabbitMQ · Linux · Jupyter · Python (Programming Language)