FlowCV Logo
Lavy MittalData Engineer @ HCL
resume profile picture
[email protected]
+91-7906394070
Noida, India
LinkedIn
https://www.linkedin.com/in/lavymittal/
Indian
TECHNICAL SKILLS
BIG DATA FRAMEWORKS

Apache Spark, Hadoop, Hive, Kafka

PROGRAMMING LANGUAGES

SQL, Python, Java, C/C++

DATABASES/ERP Systems

MySQL, Oracle, SAP S/4 HANA

AWS Cloud Services

RedShift, Glue, S3, Athena, lambda, EMR, EC2, SQS, SNS, CloudWatch

Azure Cloud Services

Synapse Analytics, Databricks, ADLS, Dedicated SQL Pool, ADF

OTHER TOOLS

Git, BigBucket, JIRA, Jupyter Notebook, PyCharm

Education

Bachelor of Technology in Electronics and Communication Enghineering

Dr. A. P. J Abdul Kalam Technical University
2016 – 2020 | Agra, India

Percentage : 87%

SUMMARY

Data-driven professional with 3+ years of experience in designing, building, and maintaining data architectures and pipelines for large-scale data ecosystems. Proven expertise in utilizing various technologies and best practices to ensure data availability, quality, and security.

WORK EXPERIENCE

HCL TECHNOLOGIES PVT LTD

January 2021 - Present

SNOW MIGRATION

  • •Integrated and created ingestion pipelines in AWS Glue for migrating data from data sources like Azure SQL DB, Salesforce, Airwatch, DLP Agent, ServiceNow into data lake
  • •Migrated 200+ Logs and Compliance related reports from ServiceNow tool to ThoughtSpot BI tool
  • •Relocated 5,000+ GBs of historical data from Service Tables to AWS Redshift
  • •Comprehended Business Requirement Documents and bridged the gap between client need and project scope
  • •Performed Data Validations for validating/comparing source and target systems
  • •Created business transformation logic in PySpark and SQL as per the requirements provided
  • •Loaded the transformed data into RedShift and created Materialized Views for faster responses on dasboards.
  • •Connected the Redshift within AI enabled BI tool named ThoughtSpot and created visualization dashboard(liveboards).

    • SALES & RETAIL CONTROL TOWER

  • •Integrated multiple data sources like SAP S/4HANA, SNOW using AWS Glue, DMS & AppFlow and landed the source data into raw layer bucket in AWS S3
  • •Designed and implemented Medallion layered architecture for ensuring seamless data management, processing and BCP/DR
  • •Delivered successful client meetings to gather requirements and documented client needs for project success
  • •Applied analytical data modelling on flat De-normalized tables and implemented Star Schema
  • •Developed ETL pipelines for ingestion, processing and loading/storing data into data warehouse(Redshift).
  • •Crafted business transformation logic and SCD Type 2 transformations using PySpark and SQL
  • •Created templates for ensuring Data Quality as per business requirements and detailed data analysis
  • •Set up live connection between AWS Redshift and an AI enabled BI tool, ThoughtSpot and created liveboards with distinct visualizations as per business reporting requirements
  • •Worked on Cloud Formation Templates(CFTs) for creating CI/CD pipelines and deployed AWS infrastructure
  • •Collaborated with business analysts for creating business requirement documents(BRDs)

    • DATA QUALITY ASSURANCE PROCESS

  • •Crafted logic for validating Terabytes of Data using Apache Spark and Spark SQL
  • •Designed ETL framework coupled with logging mechanism to bring data from SAP tables and Flat-files in data warehouse

    • 12th Standard

    Queen Victoria Girls Inter College
    2015 – 2016 | Agra, India

    Percentage : 86%

    10th Standard

    St. Joseph's Girls Inter College
    2013 – 2014 | Agra, India

    Percentage : 82%

    CERTIFICATES
  • •Databricks Associate Developer for Apache Spark 3.0 Certification
  • •Databricks Data Engineer Associate Certification
  • •Databricks Certified Associate Developer - Apache Spark by Udemy
  • •Certified with CompTIA Security+
  • •Created multiple validation scenarios for verifying the quality checks of ingested data before loading it into silver layer

    • QUERY PARSER

  • •Implemented logic to validate and run SQL-style queries on unprocessed tables and data files
  • •Included Snowflake and AWS EMR for the execution of given queries and configured AWS SNS for email report
    • Internship

    509 ARMY BASE WORKSHOP

    05/2019 – 06/2019 | Agra, India

    AUTOMATIC DOOR OPENING SYSTEM

  • •System featured with android application device remote control that overrides the signal timings by immediately giving green signal in the vehicle direction and red signal for all others