FlowCV Logo
Profile

Dedicated and results-driven Data Engineer with 4.6 years of experience specializing in data analytics across diverse domains. Proficient in data manipulation, ingestion, visualization, validation and dashboard development, utilizing tools such as Tableau, Python(Pandas & Pyspark), and SQL. Experienced in managing databases, particularly MySQL, and adept at optimizing data processes for enhanced efficiency. Skilled in agile project management and version control with Git, with a proven track record of delivering actionable insights. Committed to driving innovation and contributing to informed decision-making through advanced data analytics techniques. Seeking to leverage expertise in ETL pipeline enhancement and data quality assurance to excel in a dynamic role.

Skills
Technical Skills

Data Ingestion, Data manipulation, Data Preprocessing, Data Mining, Data Cleaning, Data Profiling, Data Processing, Data Interpretation, Dashboard Creation, ETL, ELT, Data Warehousing, Data Insight, Reporting, MatplotLib, Pandas, Seaborn, NumPy, Story Creation, Flask, Git, Python, Azure Data Bricks, Azure Data Factory, Microsoft Azure.

Tools

Azure Storage Explorer, Google Collaborator, PyCharm, MySQL Workbench, SQL Server Management Studio, VScode, CLI, Mongosh, Atlas CLI, Tableau, Jupyter.

Scripting Languages

Python, HTML5, BootStrap, CSS 3, Slash, JavaScript, Vue.JS

Database

Azure Data Lake (ADLS), Azure Blob Storage, SQL, MySQL, AWS S3, NO-SQL, MongoDB, MongoDB Atlas, JSON.

Projects
TD Bank (Canadian Bank), Data Engineer
  • •Worked on more than 4 projects for TD bank using different data analystical tools like ADB, Pandas, SQL, PySpark and ETL.
  • •Developed and maintained daily data pipelines for seamless raw-to-curated data transfer and created automation scripts utilizing the existing in-house framework.
    • Jan 2024 – present
  • •Maintain Dashboard for the Analytical zone using Tableau.
  • •Performed Data ingestion to facilitate comprehensive data validation and ensure accuracy and consistency across datasets.
  • •Collaborated on Data streaming analytical processes (DSAP) for data validation using Pandas, SQL, and PySpark.
  • •Conducted ETL pipeline testing to ensure data accuracy and integrity.
  • •Utilized SQL queries, Pandas, and PySpark for data validation and transformation.
  • •Managed banking data storage with MySQL for efficiency and security.
  • •Worked on big data projects for banks requiring high-end technology and security measures.
  • •Implemented Azure Databricks to scale ETL processes.
  • •Led data Ingestion and processing through Azure Data Factory (ADF).
  • •Created ADF pipelines and performed regression testing for validation.
  • •Enhanced ETL processes to meet banking regulatory standards and business goals, including using Azure tools for database validations.
    • Telecommunication, Data Manipulation
  • •Proficient in SQL for retrieving, manipulating, and transforming data across diverse databases, ensuring accuracy and integrity for analytics.
  • •Created interactive data dashboards and reports using Tableau, effectively visualizing insights for non-technical stakeholders.
    • Jan 2022 – Apr 2023
  • •Used Python libraries like Pandas and NumPy for data analysis on Data Brcks and performed advanced analytics to streamline processing efficiency.
  • •Organized data and communicated insights using Excel’s reporting and visualization features, including charts and graphs.
  • •Implemented data validation, cleaning, enrichment, and pre-processing procedures to improve data quality and reliability.
  • •Experience on AWS S3 for data lake storage and retrieval of data.
    • Abhilash Yadav
  • •Managed projects within Agile frameworks like Scrum and Jira, facilitating iterative development and project transparency.
  • •Utilized Git for version control of code and data, ensuring a collaborative and organized development environment.
    • Ford Motor (USA), Automation & Data Visualization
  • •Developed Python automation scripts to significantly reduce manual testing efforts, leading to improved accuracy and efficiency within the testing system.
  • •Implemented GitHub for version control, enhancing code management, promoting collaboration, and ensuring organized and secure development processes.
    • Dec 2019 – Dec 2021
  • •Proficiently tracked and analyzed team performance metrics using Excel, enabling data-driven insights that contributed to continuous improvements and informed decision-making.
  • •Utilized Tableau for creating interactive and visually appealing data dashboards and reports, tracking internal team performance and integrating Excel data.
  • •Successfully applied Agile methodology principles to ensure efficient project management, meeting project milestones effectively, and ensuring timely deliveries of project objectives.
  • •Incorporated MongoDB for data storage and retrieval, expanding data management capabilities.
    • Laptop Price Prediction, ML project
  • •Utilized Pandas and NumPy for data processing.
  • •Implemented linear regression and K-nearest neighbors for laptop price prediction.
    • May 2023 – Dec 2023
  • •Created an interactive web application with Streamlit.
  • •Employed Matplotlib for effective data visualization.
  • •Demonstrated practical machine learning application.
  • •Enhanced model accuracy using various techniques.
  • •Enabled user input for personalized predictions.
    • Professional Experience
    Senior Software Engineer, CGI

    Data Analyst/Engineer for BFSI domain.

    Skills involved- Python, PySpark, Pandas, Azure Data Bricks, Azure Data Factory, SQL, Matplotlib, Tableau, Excel, Jira.

    Jan 2024 – presentBangalore, India
    Senior Software Engineer, HCL Techonologies

    Worked on - Data Bricks, Pandas, Numpy, Matplotlib, Seaborn, AWS S3, Pyspark, Python, MySQL, Tableau, Workbench, Excel, MongoDB ATLAS.

    Jan 2022 – Jul 2023Bangalore, India
    Project Engineer, Wipro Technologies Pvt Ltd

    Worked on - Python, SQL, Excel, Github, Tableau, Automation, Scripting, MongoDB.

    Sep 2019 – Dec 2021Bangalore, India
    Education
    Bachelors Of Technology, MMDU

    Scored- 7.49 CGPA

    Aug 2015 – May 2019Ambala cantt, India
    Senior Secondary, Delhi Pubic School

    Scored- 72.4%

    Mar 2013 – May 2014Bilaspur, India
    Secondary, Delhi Public School

    Scored- 7.6 CGPA

    Apr 2011 – May 2012Bilaspur(CG), India
    Certificates
    Language
    English
    Hindi
    Interests
    Football, Riding MotorBike
    Abhilash Yadav