Skip to content
View The-Vector-007's full-sized avatar
✌️
✌️

Block or report The-Vector-007

Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
The-Vector-007/README.md

Ajay Singh

Software Engineer · Data & AI

Building large-scale data pipelines and lakehouse systems on Azure Databricks. Currently focused on the intersection of data engineering and AI.

Email LinkedIn Portfolio


About

3 years building enterprise data systems at UBS and Credit Suisse — Kafka-based streaming, medallion lakehouses on Azure Databricks, metadata catalogs, and data quality platforms. I care about systems that are observable, recoverable, and actually understood by the teams that run them.


Stack

Layer Tools
Languages Python · SQL · C++
Data Engineering PySpark · Kafka · Delta Lake · dbt · Airflow
Cloud & Infra Azure Databricks · ADLS · ADF · Docker · GitLab CI/CD
Backend FastAPI · REST APIs · Microservices
Concepts Medallion Architecture · Metadata Catalogs (DCAT/DQV) · Disaster Recovery

Experience

Software Engineer, Data Platforms — UBS, Pune Nov 2024 – Present

Lakehouse pipelines processing 50M+ records/day across 6 applications and 200+ downstream consumers. Built a Kafka DataMesh notification framework with exactly-once processing, cut critical pipeline latency from 8 hours to 90 minutes, co-designed an enterprise metadata catalog using DCAT/DQV standards, and improved platform DR coverage from 40% to 90%.

Data Engineer (Technology Analyst) — Credit Suisse, Pune Jul 2023 – Nov 2024

ETL pipelines for analytics and reporting, data modeling, schema design, and APIs serving curated datasets to downstream applications.


Projects

Promptathon — UBS Hackathon React · FastAPI · PostgreSQL · Azure OpenAI

LLM-powered prompt evaluation platform with automated scoring and real-time leaderboard. Built and demoed at the UBS internal hackathon — reached semi-finals in both 2023 and 2024 global editions.

More projects coming — currently building in public.


Education

B.E. Information Technology · Army Institute of Technology, Pune · 2023 · CGPA 9.47


📍 Pune, India

Popular repositories Loading

  1. Image-Gallery Image-Gallery Public

    Image Gallery (background selected via Background Generator)

    HTML 2

  2. Smartbrain-Api Smartbrain-Api Public

    Back-end for the smart brain project

    JavaScript 2

  3. Problem-Solving Problem-Solving Public

    This is my personal coding library where i have written the implementation of various data structures and algorithms as well as some tips & tricks related to CP.

    C++ 2 1

  4. commudle-ng commudle-ng Public

    Forked from commudle/commudle-ng

    World's first community management platform. And it's free!

    TypeScript 2

  5. freeCodeCamp freeCodeCamp Public

    Forked from freeCodeCamp/freeCodeCamp

    freeCodeCamp.org's open-source codebase and curriculum. Learn to code for free.

    TypeScript 2

  6. developer-roadmap developer-roadmap Public

    Forked from nilbuild/developer-roadmap

    Roadmap to becoming a developer in 2022

    TypeScript 2