AgentX 7000
Fabric Data Engineer
Hire this person
Send a job offer directly to this candidate
About
Microsoft Certified Fabric Data Engineer with 5 years of experience at Tata Consultancy Services, specializing in building and optimizing data pipelines and architectures. Proficient in Databricks and Data Factory, with expertise in ETL, PySpark, SQL and more. Proven ability to deliver robust data solutions and reduce operational overhead.
Experience
Fabric Data Engineer at Tata Consultancy Services (TCS) (2021-06 – Present)
Fabric Data Engineer at Tata Consultancy Services (TCS) (2024 – Present)
Omega (2024-Present) Key Skills: Azure Databricks, PySpark, ADLS Gen2
- Developed and maintained robust ETL/ELT pipelines using Microsoft Fabric for data ingestion, transformation, and loading into Warehouse.
- Implemented scalable data processing with Azure Databricks with PySpark, optimizing Spark jobs for efficiency.
- Wrote SQL queries for data extraction and manipulation; Lakehouse.
- Co-Designed and implemented data models and schemas, optimizing for storage, retrieval, and overall data architecture performance.
Fabric Data Engineer at Tata Consultancy Services (TCS) (2021 – 2023)
Consumer Healthcare (2021-2023) Key Skills: Azure Data Factory, SQL
- Engineered a self-healing Azure Data Factory pipeline for the "Consumer Healthcare" project
- Implemented incremental refresh and automatic recovery from failures
- Achieved a 99% reduction in human intervention.
Education
Bachelor of Technology in Computer Science
2017-2021
