Azure End to End Data Engineering Pipeline
- Built a data pipeline to migrate Sales and customer data from on-premises SQL Server to Azure using ADF and Databricks.
- Ensured secure data processing with Azure Key Vault, Entra ID (RBAC, and Managed Identity).
- Automated deployment and monitoring with Azure DevOps CI/CD and visualized insights using Power BI.
Azure
Databricks
ADF
Power BI
View on GitHub