Blog: https://muhtasham.github.io/blog/
🔗 More about work experience in my LinkedIn
- Master’s degree at Technical University of Munich
- Sequential Multi-task Learning in NLP with Focus on RegTech Domain
- Bachelor's degree at Sabanci University
- Diploma thesis: "A Deep Neural Network for SSVEP-based 🧠 Computer Interfaces"
- Featured in ML Monthly YouTube Show
-
📑 StarCoder- May the Source be with you - The StarCoder models are 15.5B parameter models trained on 80+ programming languages from The Stack (v1.2), with opt-out requests excluded. The model uses Multi Query Attention, a context window of 8192 tokens, and was trained using the Fill-in-the-Middle objective on 1 trillion tokens.
-
📑 ECOC based Multi-Class Classification for BCI - Developed DNN, under ECOC framework to detect the character out of 40 possibilities that the (disabled) subject wants to communicate via Brain Computer Interface (BCI).
-
📑 Fault-Tolerant Strassen-Like Matrix Multiplication - Designed parity calculations to make matrix multiplication calculations, using Strassen-Like algorithms on cloud computing environment (with parallel setting) fault-tolerant.
-
📑 TajGPT and TajBERTo - Developed first ever RoBERTa-like language model based on Tajik language after extensive filtering of the dataset. The model can be used for masked text generation or fine-tune it to a downstream task.