LLM Loves Tokenizers! Implementing BPE from Zero

LLM is the main tool behind most of the things nowadays. For example, an agent has different loops connected via graphs, but the brain is…