Search for a command to run...
Woohoo! This is my first blog post on Hashnode.
I plan to use this blog to document my thoughts and understanding of specific technical topics as I go deeper and deeper into AI and research. It will help me to push myself and explore/research topics I don’t fully understand.
This blog will also help me [and hopefully the readers (if any!)] to learn from my mistakes and experiences.
Okay bye ✌
I recently started learning Triton, OpenAI's Python-based language for writing GPU kernels. My project: build a matrix multiplication kernel from scratch, step by step, until it's competitive with PyT
You've probably used ChatGPT or Claude. Maybe you've even fine-tuned a small language model on your laptop. But have you ever wondered why training or even inferencing GPT or Claude requires tens of thousands of specialized chips aka GPUs instead of ...
Let's talk about speculative decoding. One of the most elegant optimization techniques in modern LLM inference. If you've ever wondered how to squeeze 2-3x more throughput from your language models without sacrificing output quality, you're in the ri...
Let’s talk about the different datatypes that are being used in modern LLMs like GPT, LLaMa and the like. The most common ones that you might have heard: FP32, BFloat16, Float16, INT8, etc. These are all standard data types and available in PyTorch a...
Unless you’re living under a rock, you’ve probably heard of Large Language Models (LLMs) and even used a few of the popular applications like ChatGPT, Claude, Perplexity, etc. powered by these LLMs. So without going too deep into what LLMs are, let’s...