MicroJax
MicroJax is a minimal implementation of JAX in pure Python. It is a fun project to learn about JAX and how it works under the hood.
Read more →Latest
Notes on AI, machine learning and Python: building autograd engines from scratch, JAX internals, language-model experiments, and other things I find interesting.
Mixture of Depth is Vibe
Thought and code about mixture of depth
Read more →Experiments with Bitnet 1.5 (~ngmi~)
The blog explores implementing Bitnet 1.5, highlighting its efficiency gains and challenges in quantized neural network training.
Read more →Building autograd engine (tinytorch) 04
Building my own dl framework name tinytorch,
Read more →Building autograd engine (tinytorch) 03
Building my own dl framework name tinytorch,
Read more →