Open to relocate — EuropeUKAustraliaSingaporeDubaiUAEIndia EuropeUKAustraliaSingaporeDubaiUAEIndia

Hi, I'm Madhusudan
Reddy Mandala

Azure Data Engineer | 4.9 Years | 7x Certified

I'm an Azure Data Engineer who thrives at the intersection of cloud data engineering and business impact. Over the past 4.9 years at Deloitte and Celebal Technologies, I've designed and delivered end-to-end data pipelines across auto-finance, real estate, manufacturing, and automotive industries — migrating 2,500+ tables to modern Lakehouse pipelines, slashing runtimes by 65%, and shipping with zero data loss.

Explore My Work Let's Talk
DP-203 DP-600 Databricks Pro AZ-900
Madhusudan Reddy Mandala
Azure Databricks
Delta Lake
PySpark
7 Certs
Location
Hyderabad, India
Education
B.Sc. Math, Stats & CS
Languages
English · Telugu
Ready to Relocate
Europe · UK · Asia · Middle East
2,500+
Tables Migrated
65%
Faster Pipelines
7
Certifications
4.9
Years Experience
Experience

Where I've Made an Impact

From enterprise migrations at Deloitte to multi-client delivery at Celebal Technologies.

Azure Data Engineer @ Deloitte
SEP 2024 — PRESENT · Hyderabad
  • Architected scalable Databricks-based ETL workflows for a high-volume auto-finance client, automating the full data loading lifecycle and reducing manual intervention by 80%+.
  • Re-engineered underperforming pipelines using Delta Lake optimization techniques (Z-ordering, file compaction, partitioning, caching), cutting average execution time by ~65%.
  • Translated complex financial business rules into robust, reusable PySpark and SQL transformation logic ensuring full auditability.
  • Enforced enterprise governance — role-based access control, column-level security, and lineage tracking for full compliance.
  • Collaborated with solution architects and business analysts to deliver migration workstreams on schedule.
★ Applause Award — Apr 2025 ★ Outstanding Performance — Aug 2025
Azure Data Engineer @ Celebal Technologies
NOV 2021 — AUG 2024 · Hyderabad
  • Designed end-to-end ETL pipelines using Azure Data Factory with complex Data Flows, linked services, and parameterized pipelines.
  • Optimized SQL Server performance through strategic indexing, query plan analysis, and stored procedure refactoring — improving SLAs from T+1 to near real-time.
  • Built Azure Synapse Analytics environments — dedicated SQL pools, data models, and integrated pipelines for client reporting.
  • Configured Synapse Link for near-real-time replication from Dynamics 365 F&O into ADLS Gen2, eliminating overnight batch dependencies.
  • Built Medallion architecture (Bronze → Silver → Gold) using Delta Live Tables across multiple projects.
Data Engineering Intern @ Celebal Technologies
JUL 2021 — OCT 2021 · Hyderabad
  • Built foundational data pipelines using Azure Data Factory and ADLS, contributing to a live client project within the first month.
  • Automated operational workflows using Azure Logic Apps, reducing manual process steps and gaining real-world cloud engineering exposure.
Technical Skills

My Engineering Toolkit

Deep expertise across the Microsoft Azure data ecosystem.

☁️ Cloud & Azure Services

Azure Data FactoryDatabricksSynapse AnalyticsADLS Gen2Logic Apps

💻 Programming & Scripting

PythonPySparkSQL (Advanced)Spark SQL

🔄 ETL & Load Patterns

SCD Type-1 / Type-2Full LoadDelta LoadIncremental LoadTruncate & Reload

🗄️ Databases & Optimization

SQL ServerStored ProceduresViews & IndexesQuery OptimizationSchema Design

🏗️ Architecture & Patterns

Medallion (Bronze/Silver/Gold)Delta Live TablesLakehouseData Mesh

🛡️ Governance & Delivery

Data QualityLineage TrackingRBACAgile / ScrumTechnical Docs
Key Projects

Engineering at Enterprise Scale

Real-world data pipelines I've designed, built, and shipped to production.

🚗

Auto-Finance Platform Migration

Deloitte · Auto-Finance Client

Spearheaded the migration of 2,000+ production tables from a decade-old Informatica ETL ecosystem to Azure Databricks. Built a reusable, config-driven loading framework supporting SCD Type-1/2, Truncate & Reload, and Append patterns — dramatically accelerating delivery while maintaining zero data loss. Applied Delta Lake optimizations including Z-ordering, OPTIMIZE, and partition pruning to meet aggressive SLA windows.

~70% faster builds ~65% faster pipelines 0 data loss
DatabricksDelta LakePySparkSCD Patterns
🏢

Real Estate Cloud Data Platform

Celebal Technologies · Real Estate Client

Engineered a complete cloud data platform by migrating 500+ Dynamics 365 F&O tables to ADLS Gen2 via Synapse Link — replacing overnight batch processing with near-real-time data replication. Built a full Medallion pipeline (Bronze → Silver → Gold) using Delta Live Tables with declarative quality constraints, delivering 200+ optimized gold views that powered executive dashboards in Power BI.

500+ tables migrated ~40% faster dashboards 100% data integrity
Synapse LinkDynamics 365Delta Live TablesPower BI
🏭

Manufacturing Analytics Pipeline

Celebal Technologies · Packaging Client

Built a fully automated, end-to-end data pipeline for a packaging manufacturer ingesting high-frequency sensor data from production lines. Leveraged Delta Live Tables with Auto Loader and schema evolution support to handle unpredictable data formats without manual intervention. Designed Silver-layer transformations for unit normalization and outlier handling, and curated Gold aggregations enabling real-time operational decision-making across the factory floor.

Zero downtime ingestion Real-time analytics
Delta Live TablesAuto LoaderSchema EvolutionDatabricks
⚙️

Automotive Pipeline Automation

Celebal Technologies · Automotive Client

Deployed a suite of parameterized ADF pipelines supporting both full and incremental load patterns for a major automotive manufacturer. Integrated Azure Logic Apps for intelligent failure alerting, cutting mean time to resolution by ~50%. Built a comprehensive SQL Server stored procedure library that enabled BI teams to query production data directly — eliminating their dependency on pipeline schedules and unlocking faster reporting cycles.

~50% faster MTTR Direct BI access
Azure Data FactorySQL ServerLogic AppsAutomation
Certifications

7 Professional Certifications

Validated expertise across Microsoft Azure and Databricks ecosystems.

Microsoft
Azure Data Engineer Associate
Microsoft
DP-203
Microsoft
Fabric Analytics Engineer Associate
Microsoft
DP-600
Microsoft
Azure Data Fundamentals
Microsoft
DP-900
Microsoft
Azure Fundamentals
Microsoft
AZ-900
Databricks
Data Engineer Professional
Databricks
Professional Level
Databricks
Data Engineer Associate
Databricks
Associate Level
Databricks
Lakehouse Fundamentals
Databricks
Fundamentals

Let's Build Something Great

I'm actively seeking Azure Data Engineer roles across Europe, UK, Australia, Singapore, Dubai, and India. Whether you have a role that fits, a data challenge to solve, or just want to connect — I'd love to hear from you.

Email Me Call LinkedIn