Sneha Chowdhury Data Engineer
Profile

Data Engineer with 4 years of experience working on cloud-based data platforms, primarily within the Azure ecosystem. Skilled in building and maintaining data pipelines using Azure Data Factory and Azure Databricks, with hands-on experience in PySpark and SQL for data transformation and processing. Good understanding of data warehousing concepts, including layered architecture (Raw, Silver, Gold), and experience working with Snowflake for data storage and querying. Familiar with implementing data validation checks to ensure data quality across different stages of the pipeline. Experience in supporting reporting needs through Power BI and working closely with business teams to understand requirements. Comfortable working in Agile environments and contributing to end-to-end data workflows from ingestion to reporting.

Professional Experience
Data Engineer, Tata Consultancy Services
Jan 2022 – Present
  • •Worked on data ingestion and orchestration across multiple enterprise sources using Azure Data Factory (ADF), supporting cloud-based data platforms for analytics and reporting.
  • •Developed and maintained ETL pipelines in ADF, handling scheduling, basic monitoring and fixing pipeline failures when required.
  • •Used Azure Databricks to perform data transformations and cleansing on large datasets, improving data readiness for downstream reporting.
  • •Wrote SQL queries involving joins, aggregations, and window functions as per business requirements.
  • •Applied practical understanding of data warehousing concepts, including layered architecture and transformation logic.
  • •Implemented data validation checks across Raw, Silver and Gold layers to ensure consistency and catch data issues during processing.
  • •Supported migration and data loading activities in Snowflake, including working with bulk and incremental loads.
  • •Created and modified tables, views and SQL queries in Snowflake to support reporting and downstream processes.
  • •Followed existing access control and data security practices, including role-based access where applicable.
  • •Assisted in building and updating Power BI dashboards and reports based on business needs.
  • •Performed unit testing and basic integration testing to validate data pipelines and ensure expected outputs.
  • •Worked with team members and business users to understand requirements and support ongoing data needs.
  • •Participated in Agile ceremonies like daily stand-ups and sprint discussions.
  • •Supported end-to-end data flow from ingestion to reporting for projects in BFSI and Hospitality domains.
    • Skills
    Data Analysis & Visualization
    • •Python
    • •SQL
    • •Pyspark
    • •PowerBi
    • •Microsoft Excel
    Data Engineering & Warehousing
    • •ETL/​ELT Pipelines
    • •Data Modeling
    • •Data Warehousing Concepts
    Soft Skills
    • •Risk Analysis
    • •Stakeholder Communication
    • •Agile & Iterative Delivery
    • •Analytical Problem Solving
    Data Engineering & Cloud
    • •Azure Databricks
    • •Azure Data factory
    • •Azure Data Lake
    • •Snowflake
    • •Matillion
    Version Control & Agile Collaboration
    • •Git
    • •Bitbucket
    • •JIRA
    • •Agile Methodologies
    Education
    Master of Science, Institute of Technical Education and Research, SOA University
    Bhubaneswar
    Bachelor of Science, Government Autonomous College
    Rourkela