Skip to content
📊
Deployed

Azure ETL Pipeline

Scalable data processing pipeline using Microsoft Fabric and SQL to automate Azure financial cost analysis, transforming a 13-step, 2-3 hour monthly process into a 5-10 minute workflow.

Microsoft FabricAzure Data FactorySQLAzure FunctionsPythonPower BI

Process Transformation

Before: Manual Process

  • 13-step manual Azure cost analysis process
  • Required 2-3 hours of an engineer's time monthly
  • Error-prone manual data collection and calculations
  • Inconsistent reporting timing and formats

After: Automated Pipeline

  • Automated pipeline completes analysis in 5-10 minutes
  • Zero manager involvement in routine operations
  • Reliable, consistent data processing with validation
  • Standardized reporting with automated delivery

Technical Implementation

Data Extraction & Processing

Built automated system using Microsoft Fabric to extract Azure billing data and SQL for complex transformations, handling cost categorization and departmental allocation with built-in validation and error handling.

Microsoft FabricSQL TransformationsData Validation

Key Achievements & Impact

Transformed manual Azure cost analysis into an automated, reliable workflow, saving managers hours of work monthly

95%
Time Reduction (2-3 hours → 5-10 minutes)

Key Achievements

  • • Transformed 13-step manual process into automated workflow
  • • Eliminated manual effort for managers with automated reporting
  • • Built fault-tolerant pipeline with ongoing support capabilities
  • • Delivered highly reliable, repeatable results for financial analysis

Business Benefits

  • • Improved data accuracy and consistency
  • • Enabled reliable monthly financial analysis
  • • Reduced risk of human error in calculations
  • • Presented solution at company sprint reviews
May 2025 - Present