career_pipeline.yml · 2 runs · 0 errors

Professional Experience

My track record of building data solutions, optimizing cloud infrastructure, and driving engineering excellence.

career_dag · vishal_prajapati
RUNNING2 stages
STAGINGRUNNING

Associate Engineer (Data Engineer)

Virtusa Consulting Services Pvt. Ltd.
Jan 2024 - Present
execution_log · virtusa.sh
in progress
Led the end-to-end migration of legacy data pipelines from SQL Server Stored Procedures to AWS Athena using dbt, delivering four production-grade data products.
Engineered a reusable union relation dbt macro, reducing code redundancy by 40%.
Developed a Python automation tool to generate dbt schema.yml files, cutting manual documentation time by 50% across 200+ models.
Optimized pipeline performance by implementing incremental models, reducing AWS Athena compute costs by 35% and decreasing query runtime by 60%.
Orchestrated Apache Airflow workflows with dynamic DAGs, achieving 99.9% pipeline reliability.
TRANSFORM

Intern

Virtusa Consulting Services Pvt. Ltd.
Jan 2023 - April 2023
Source Layer · Education
SOURCE

B.Tech in Computer Science and Engineering

Lovely Professional University

2019 - 2023
–Graduated with a CGPA of 8.02.
–Built foundational knowledge in Data Structures, Algorithms, and System Design.
Completed 2 pipeline stages · 0 errors · 0 warnings