About
Word Embedding
This is part of the down-introspect series on ML/AI on Word Embedding. In this post, we will go over the concept of
embedding, one of the fascinating ideas in machine learning, and the mechanics of generating embeddings with word2vec.
2639 words
|
13 minutes
PyTorch
2026-09-14
To install PyTorch on ny Apple Silicon Mac, e.g. M5, we don’t need a special version. PyTorch natively supports Apple’s
GPU acceleration out of the box using Metal Performance Shaders (MPS).
229 words
|
1 minute
Structured Outputs
2026-09-14
"Structured Outputs" itself has largely become the standard industry-wide term adopted by open-source libraries,
academic papers, and competing cloud providers (such as Google Cloud Vertex AI, Anthropic integrations, and AWS
Bedrock). It refers broadly to the developer pattern of supplying a schema (e.g., JSON Schema, Pydantic model, or Zod
schema) to guarantee an API or local runner returns valid, structured data instead of free-form text.
1045 words
|
5 minutes
KV Cache
2026-07-15
Specifically created to solve the massive memory bottleneck and inefficiency of serving Large Language Models in
production, vLLM at its core resolves the problem of LLM serving and inferencing. Before vLLM, the bottleneck in
serving LLMs wasn't just the model weights themselves, but the KV Cache (Key-Value Cache) - the memory required to
store the attention context for generating tokens sequentially. This posts helps us systematically learn KV cache.
932 words
|
5 minutes
AI Agent - ReAct: Reasoning and Acting
The ReAct paradigm bridges the gap between digital reasoning and purposeful action by giving agents a digital form of
inner speech. By generating internal thought traces before executing tasks, AI can plan, observe, and self-correct in
a continuous loop. This approach moves us away from black-box automation and toward building transparent, deliberate
agents that can navigate complex problems with genuine logical integrity.
1237 words
|
6 minutes
AI Agent - Inner Speech
2026-05-05
AI agents are finding their inner speech. By "talking to themselves" to plan and self-correct before taking an action,
they mirror the way we use internal monologues to navigate complex choices. This shift from reactive automation to
deliberate reasoning marks the evolution of AI from a simple tool into a truly metacognitive collaborator.
1918 words
|
10 minutes
Why Do People Study Ancient Languages?
A fascination with things from the past, like ancient languages, is a common and deeply rooted human interest. There
are a number of reasons for this, ranging from the intellectual and practical to the emotional and psychological.
9357 words
|
47 minutes
The Universal Approximation Theorem - The Mathematical Guarantee of Learnability for Neural Networks
This theorem serves as the fundamental existence proof for deep learning, demonstrating that a standard neural network
with sufficient neurons has the theoretical capacity to approximate any continuous function. It assures engineers that
the architecture itself is capable of modeling any complex real-world pattern, shifting the challenge from "is this
representable?" to "how do we find the parameters to represent it?"
3869 words
|
19 minutes