Search for a command to run...
Let's talk about speculative decoding. One of the most elegant optimization techniques in modern LLM inference. If you've ever wondered how to squeeze 2-3x more throughput from your language models without sacrificing output quality, you're in the ri...
I recently started learning Triton, OpenAI's Python-based language for writing GPU kernels. My project: build a matrix multiplication kernel from scratch, step by step, until it's competitive with PyT
You've probably used ChatGPT or Claude. Maybe you've even fine-tuned a small language model on your laptop. But have you ever wondered why training or even inferencing GPT or Claude requires tens of thousands of specialized chips aka GPUs instead of ...
Let’s talk about the different datatypes that are being used in modern LLMs like GPT, LLaMa and the like. The most common ones that you might have heard: FP32, BFloat16, Float16, INT8, etc. These are all standard data types and available in PyTorch a...
Unless you’re living under a rock, you’ve probably heard of Large Language Models (LLMs) and even used a few of the popular applications like ChatGPT, Claude, Perplexity, etc. powered by these LLMs. So without going too deep into what LLMs are, let’s...
I have been working with Siamese Networks a lot in the past few months so I decided to write some articles on it that I would've liked to read the first time I got introduced to the topic. First, we will discuss Siamese networks in general and then h...
Popular deep-learning models like Resnet18, Resnet50, VGG16, etc. have achieved outstanding results in various image recognition tasks on benchmark datasets. These neural networks have been trained on mammoth datasets containing millions of labeled e...
Final week, the graduation ceremony, and games! So yes I am a little late for this I know. The prep fellowship ended on the 21st of April but I had my semester exams so I didn't get enough time. But we are here now... The final week was great and I'm...
All about React JS and APIs
