FlowCV Logo
Profile

Dedicated Data Engineer with a passion for overcoming challenges and delivering impactful results. Proficient in Hadoop, Python3, Scala, Apache Spark, and other leading-edge technologies. Skilled in creative problem-solving and committed to continuous learning and growth

Skills
Programming Language: Python, Scala, Java, Groovy, C, C++
Big Data Technologies: Hadoop, Apache Spark, Apache Airflow, PySpark, Azure DataBricks
Data Engineering Tools:  Apache Kafka, Google BigQuery
Scripting Languages: Shell Scripting, JSON, XML
Databases: Apache Druid, MySQL, MongoDB, Google BigQuery, SQL, DB Designing, HL7 Formatting
Web Technologies: Flask, Spring Boot, Hibernate, J2EE, HTML5, JavaScript, Bootstrap, PHP
General Tools: MS Excel, PowerPoint, Word, OneNote
Data Analysis and Manipulation: Pandas, NumPy, SciPy
Development Tools: Git, Docker, Kubernetes,
General Skills: Data Modeling, Deployment, Optimization, Data Wrangling, ETL/ELT
Projects - Github(for more projects)
Mar 2023 – present

Cohort Intelligence

Data Engineer - JIO
  • Managed pipeline for cohort intelligence, enhancing targeted advertising effectiveness.
  • Led end-to-end product development lifecycle, ensuring robust and scalable solutions.
  • Automated monitoring tasks, improving performance by 36.8% and reducing manual effort by 35%.
  • Feb 2024 – present

    Point Of Interest

    Data Engineer - JIO
  • Designed and implemented ETL flows to integrate diverse datasets into the Cohort Intelligence system.
  • Conducted data flow analysis and visualization to optimize user interest mapping.
  • Enhanced system scalability and performance for seamless data processing.
  • Nov 2023 – present

    Retargeting

    Data Engineer -JIO
  • Developed ETL pipeline for precise user targeting using identifiers like BPID and IFA.
  • Streamlined user segmentation strategies, improving marketing efficiency.
  • Implemented automated processes for timely and personalized user engagement.
  • Jul 2023 – present

    Custom Audience

    Data Engineer -JIO
  • Designed and implemented a Flask API to trigger Spark jobs for personalized campaign targeting.
  • Enabled SMS/RCS communication based on cohort conditions, ensuring timely and relevant messaging to users
  • May 2023 – present

    UIDUpload

    Data Engineer - JIO
  • Developed and maintained a Flask API to facilitate targeted user identification based on BPID, IFA, or secondary ID criteria.
  • Implemented robust data handling processes to ensure accurate and efficient user targeting.
  • Technologies used: Flask, Python, Apache Kafka, Apache Spark, Apache Druid, MySQL, Hadoop
  • Akhilesh Pratap Shahi
    Jan 2022 – Feb 2022

    Intercambio

    Data Engineer -MpHrx
  • Developed a data ingestion pipeline to unify claims data from multiple sources.
  • Optimized the pipeline using Azure Databricks, reducing processing time by 45% and improving data accuracy by 20%.
  • Dec 2022 – Feb 2022

    Patient Data Visibility

    Backend Developer - MpHrx
  • Engineered a data processing application to efficiently retrieve patient information.
  • Implemented a data storage strategy using Hibernate and MongoDB, reducing query time by 50%.
  • Mar 2022 – Jul 2022

    Mooving

    Backend Developer - SAR
  • Developed APIs using JPA Repository, Maven, Spring Boot, and MongoDB.
  • Implemented CRUD operations and integrated them into live projects.
  • Professional Experience ~ 5YOE
    Mar 2023 – presentBanglore, India

    Reliance Jio Infocomm Pvt Ltd

    Deputy Manager - Data Engineer
  • Utilized Hadoop, Apache Spark, Airflow, Kafka, Python, Scala, and FastAPI for diverse projects.
  • Managed the entire product development lifecycle for cohort intelligence pipelines.
  • Enhanced automation scripts, improving performance by 36.8% and reducing manual effort by 35%.
  • Oct 2022 – Feb 2023Gurgaon, India

    MpHrx

    Software Engineer
  • Developed and maintained systems using Java, Groovy, Python, Data Bricks, Shell scripting, and SOAP APIs.
  • Focused on data ingestion and automation processes to streamline operations.
  • Mar 2022 – Jul 2022Gurgaon, India

    SAR GROUP(Lectrix E-Vehicle)

    Software Developer
  • Created applications with Java, Spring Boot, Hibernate, Maven, HTML, CSS, JavaScript, and Thymeleaf.
  • Worked on enhancing user interfaces and backend processes for improved efficiency.
  • Fintree Global Research
    May 2021 – Mar 2022Lucknow, India
    Software Developer
  • Specialized in Java, Spring Boot, Hibernate, and Spring framework.
  • Improved system performance and streamlined backend processes.
  • Jan 2020 – May 2021Lucknow, India
    Jr. Software Developer
  • Worked along with Java, Spring Boot, Hibernate, and Spring framework.
  • Education
    Aug 2024 – presentValletta, Malta

    Woolf University

    M.S. in Computer Science

    Specialized in ML/AI

    Aug 2015 – Apr 2019Ambala, India

    Maharishi Markandeshwar (Deemed to be University)

    B.Tech

    Major in Computer Science

    Recognition and Achievements
  • Former Member of Computer Society of India
  • Python Guest Lecturer at BSA Engineering College
  • Former Vice President of Trojan Society and President of Pratibimb Theatre Club
  • Won multiple awards in inter-college hackathons, stage plays, and mono acts
  • Certificates
    Akhilesh Pratap Shahi