The Math Behind In-Context Learning Permalink
From attention to gradient descent: unraveling how transformers learn from examples
Posts by Category
Blog
Linearizing Attention Permalink
Breaking the quadratic barrier: modern alternatives to softmax attention
Deeper is better: Coding ResNet from scratch Permalink
Simple implementation of ResNet-50 from scratch using pytorch
Random Forest & AdaBoost: Coding Ensemble Methods from Scratch Permalink
Simple implementation of Random Forest & AdaBoost(SAMME)
Decision Trees: Branching Out Step by Step Permalink
Step-by-step guide on building a Decision Tree using Gini impurity
Principal Component Analysis: Reducing dimensionality from scratch Permalink
Simple implementation of Principal Component Analysis (PCA) from scratch in numpy
Multinomial Logistic Regression — coding classification from scratch Permalink
Simple implementation of gradient descent for multinomial logistic regression from scratch in numpy
Regularization: Coding a fix for overfitting in Regression from Scratch Permalink
Simple implementation of L1 and L2 regularization from scratch in python using numpy
Linear Regression: Coding the OG from Scratch Permalink
Simple implementation of SGD and closed form solution for linear regression using numpy
Project
Offline Reinforcement Learning for autonomous driving Permalink
EECS 545 Winter 2024 final project report and code. Using INTERACTION dataset to learn human driving behaviour using reinforcement learning
Hackathon
Flows - MongoDB GenAI Hackathon 2024 Permalink
Flows is a browser extension that turns inconsistent webpage UIs into standardized, streamlined action flows to blaze through every website on the Internet.