Semantic chunking
Splitting documents along meaning boundaries — sections, topics, complete ideas — rather than at fixed character counts, to produce…
Retrieving individual segments of a document rather than whole pages, which is how most AI search and RAG systems select what to feed a model.
Because context windows are finite and precision matters, retrieval systems index documents as chunks and return the best-matching ones. A chunk that depends on context stated elsewhere on the page — a pronoun, an implicit subject, a figure whose units appear in a distant heading — can be retrieved and then misinterpreted. Writing sections that stand alone, restating key entities and units, is the practical response, and it also improves featured snippet and passage ranking outcomes.
A pricing table without a currency symbol in the same block is retrieved and summarised with the wrong currency.
Splitting documents along meaning boundaries — sections, topics, complete ideas — rather than at fixed character counts, to produce…
An architecture where a system retrieves relevant documents or passages first and then has a language model generate an answer conditioned…
Constraining a language model's output to information retrieved from a specified source — a search index, a document set or a database —…
Google's ability to rank a page based on the relevance of a specific passage within it, even when the page overall is about something…
A numerical vector representing the meaning of text, an image or another item, positioned so that semantically similar items lie close…