Browsing: RAG

Retrieval is where most RAG systems quietly break. Traditional pipelines rely on vector similarity—embedding queries and document chunks into the same space and fetching the “closest”…

TL;DR: a controlled four-phase experiment in pure Python, with real benchmark numbers. No API key. No GPU. Runs in under 10 seconds. As memory grows from…

class QwenChat: def __init__(self, model, processor, system=None, tools=None): self.model, self.processor = model, processor self.tokenizer = processor.tokenizer self.history: list[dict] = [] if system: self.history.append({“role”: “system”, “content”: system})…

import subprocess, sys, os, shutil, glob def pip_install(args): subprocess.run([sys.executable, “-m”, “pip”, “install”, “-q”, *args], check=True) pip_install([“huggingface_hub>=0.26,<1.0”]) pip_install([ “-U”, “transformers>=4.49,<4.57”, “accelerate>=0.33.0”, “bitsandbytes>=0.43.0”, “peft>=0.11.0”, “datasets>=2.20.0,<3.0”, “sentence-transformers>=3.0.0,<4.0”, “faiss-cpu”, ])…

In my previous article, I introduced Proxy-Pointer RAG — a retrieval document structure directly into a vector index, achieving the surgical precision of “Vectorless RAG” systems…

section(“7 · Q1_0_g128 Quantization — What’s Happening Under the Hood”) print(textwrap.dedent(“”” ╔══════════════════════════════════════════════════════════════╗ ║ Bonsai Q1_0_g128 Weight Representation ║ ╠══════════════════════════════════════════════════════════════╣ ║ Each weight = 1 bit: 0…

The Exactly as Designed. The Answer Was Still Wrong. I want to tell you about the moment I stopped trusting retrieval scores. I was running a…

we shipped the first version of our internal knowledge base, I received a Slack message from a colleague in the compliance team. She had asked the…

TL;DR a full working implementation in pure Python, with real benchmark numbers. RAG systems break when context grows beyond a few turns. The real problem is…

Semantic search, or embedding-based retrieval, has been a key component within many AI applications. Yet, a surprising number of applications I’ve seen still don’t do reranking, despite…