Build, Break, Learn.

How I Built BM25 from Scratch (And Why It's Better Than TF-IDF)
Okay so today I did another learning-based project. This time — BM25 from scratch. If you've heard of TF-IDF, BM25 is basically the upgraded version of it. Let me explain why. What's wrong with TF-ID
Jul 7, 20265 min read2
How I Built a BPE Tokenizer from Scratch (Part 3: Encode & Decode)
Okay we're back. If you haven't read Part 1 and Part 2, go check those out first — we built the training loop and the merge step there. This part is where it actually feels complete. Today I added enc
Jul 4, 20262 min read
B
Build, Break, Learn.
4 posts
I'm learning AI from the ground up by building the core stuff myself. This series tracks my progress — the code, the bugs, and everything in between.
BPE Tokenization: Mistakes I Made (and How I Fixed Them)
Building a BPE tokenizer from scratch sounds straightforward until you actually do it. I ran into a bunch of small bugs that took way longer to debug than I'd like to admit. Here are the ones that got
Jul 4, 20263 min read
How I Built a BPE Tokenizer from Scratch (Part 1: Training)
Okay so before we get into the code, let me tell you why I even did this. I could've just used a library. tiktoken exists. HuggingFace tokenizers exist. But I wanted to actually get it — like really u
Jun 28, 20265 min read3