Objective:
Azure Data Engineering
Develop and deploy a scalable data pipeline.
Process:
- Extracted data from diverse sources, including PostgreSQL, unstructured datasets, and HubSpot.
- Designed and implemented pipelines in Azure Data Factory, incorporating both basic and advanced transformations.
- Delivered processed data to a centralized Data Warehouse for analytics and reporting.
Impact
- Achieved real-time insights with a scalable pipeline, reducing data latency by 30%.
- Simplified reporting workflows, cutting manual effort by 40%.
- Enhanced decision-making through improved data accessibility and availability.