Word Embedding
2025-09-20
2026-09-20
This is part of the down-introspect series on ML/AI on Word Embedding. In this post, we will go over the concept of embedding, one of the fascinating ideas in machine learning, and the mechanics of generating embeddings with word2vec.
2639 words
|
13 minutes
Cover Image of the Post
PyTorch
To install PyTorch on ny Apple Silicon Mac, e.g. M5, we don’t need a special version. PyTorch natively supports Apple’s GPU acceleration out of the box using Metal Performance Shaders (MPS).
229 words
|
1 minute
Cover Image of the Post
Structured Outputs
"Structured Outputs" itself has largely become the standard industry-wide term adopted by open-source libraries, academic papers, and competing cloud providers (such as Google Cloud Vertex AI, Anthropic integrations, and AWS Bedrock). It refers broadly to the developer pattern of supplying a schema (e.g., JSON Schema, Pydantic model, or Zod schema) to guarantee an API or local runner returns valid, structured data instead of free-form text.
1045 words
|
5 minutes
Cover Image of the Post
KV Cache
Specifically created to solve the massive memory bottleneck and inefficiency of serving Large Language Models in production, vLLM at its core resolves the problem of LLM serving and inferencing. Before vLLM, the bottleneck in serving LLMs wasn't just the model weights themselves, but the KV Cache (Key-Value Cache) - the memory required to store the attention context for generating tokens sequentially. This posts helps us systematically learn KV cache.
932 words
|
5 minutes
Cover Image of the Post
AI Agent - ReAct: Reasoning and Acting
2026-05-05
2026-05-22
The ReAct paradigm bridges the gap between digital reasoning and purposeful action by giving agents a digital form of inner speech. By generating internal thought traces before executing tasks, AI can plan, observe, and self-correct in a continuous loop. This approach moves us away from black-box automation and toward building transparent, deliberate agents that can navigate complex problems with genuine logical integrity.
1237 words
|
6 minutes
Cover Image of the Post
AI Agent - Inner Speech
AI agents are finding their inner speech. By "talking to themselves" to plan and self-correct before taking an action, they mirror the way we use internal monologues to navigate complex choices. This shift from reactive automation to deliberate reasoning marks the evolution of AI from a simple tool into a truly metacognitive collaborator.
1918 words
|
10 minutes
Cover Image of the Post
Why Do People Study Ancient Languages?
2025-08-03
2026-03-02
A fascination with things from the past, like ancient languages, is a common and deeply rooted human interest. There are a number of reasons for this, ranging from the intellectual and practical to the emotional and psychological.
9357 words
|
47 minutes
Cover Image of the Post
The Universal Approximation Theorem - The Mathematical Guarantee of Learnability for Neural Networks
2025-06-05
2026-01-30
This theorem serves as the fundamental existence proof for deep learning, demonstrating that a standard neural network with sufficient neurons has the theoretical capacity to approximate any continuous function. It assures engineers that the architecture itself is capable of modeling any complex real-world pattern, shifting the challenge from "is this representable?" to "how do we find the parameters to represent it?"
3869 words
|
19 minutes
Cover Image of the Post