Skip to content
View ubermenchh's full-sized avatar
🎯
🎯
  • 22:26 (UTC +05:30)

Block or report ubermenchh

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
ubermenchh/README.md

Hi, I’m @ubermenchh (Umang Kaushik)

Projects:

1. Compilers, Interpreters, Programming Language, Virtual Machine

2. Deep Learning

  • flash-attention: Flash Attention implemented from sratch in CUDA and PyTorch
  • chotagrad: A grad engine written in Python
  • Soma/paligemma: PaliGemma model Architecture implemented in PyTorch
  • llms: Little GPT2 and LLama2 trained on TinyShakespeare Dataset
  • BytePairEncoding: Byte-Pair Encoding for encoding text
  • vit-pytorch: Implementation of ViT architecture for Image Classification
  • DeIT: Implementation of DeIT architecture for Image Classification
  • xLSTM: Implemenation of xLSTM model in PyTorch
  • clip: Implmentation of CLIP model in PyTorch
  • moe: Implmentation of Mixture-of-Experts Transformers model
  • ArticleChat: A gradio app that lets you chat with an article on HuggingFace
  • ArxivChat: A gradio app that lets you chat with an arXiv paper on HuggingFace

3. CUDA

  • flash-attention: Flash Attention implemented from sratch in CUDA and PyTorch
  • dream-cu: A Ray-Tracer implemented in CUDA
  • cu-jutsu: Various parallel-programming algorithms implemented in CUDA

4. Miscellaneous

  • Flash: A Linear Algebra library in C
  • dream: A Ray-Tracer in C
  • (WIP) void: A PyTorch-like autograd engine in C
  • adderall/adderall.rs: A Brainf*ck interpreter written in Rust
  • breakout: Breakout game written in Zig

Pinned Loading

  1. Flash Flash Public

    my little linear algebra library

    C 45 1

  2. llms llms Public

    lil' language models :)

    Python

  3. dream.cu dream.cu Public

    Port of dream (my own ray-tracing framework) in CUDA

    C++

  4. dream dream Public

    a small ray tracing library

    C

  5. clox clox Public

    lox library in c from crafting interpreters book

    C 2

  6. pycc pycc Public

    a c compiler written in python

    Python