Skip to main content

AI and Automation

Embeddings

Embeddings turn text into numbers that capture meaning, which is what lets a search find the right document when it shares no words with the question.

Definition

An embedding turns a piece of text into a list of numbers that represents its meaning. Passages about similar things produce similar numbers, even when they share no vocabulary at all.

What It Actually Means

That last point is the whole value. Traditional search matches words: ask about “staff leaving” and a document about “employee attrition” is invisible, because no word overlaps. Embeddings place both near each other, because the meaning is close, and the search finds it.

You do not need to understand the mathematics. You need to know that this is what lets software find things by what they are about rather than by what they literally say.

Where You Encounter It

Embeddings sit underneath most of the AI features businesses actually adopt.

Search that works how people ask. Someone types a question in their own words and gets the relevant document rather than nothing.

Retrieval for AI answers. Before a model answers from your material, something has to find the right passages. That step is embeddings, which makes them responsible for whether the answer is grounded in the correct source.

Grouping and routing. Clustering similar support tickets, spotting duplicate records, routing an enquiry to the right team by what it is about.

Recommendations, on the basis of similarity rather than only what other people clicked.

What Goes Wrong

Similar is not the same. Embeddings find things that are alike, and two documents can be highly similar while one is current policy and the other was superseded two years ago. Nothing about the numbers indicates which. Retrieval needs filters for date, status and source, not similarity alone.

Chunking decides quality. Long documents are cut into passages before embedding, and how that cut is made governs the result. Split mid-argument and every piece loses the point. This is unglamorous and it is where most of the quality in a retrieval system is won or lost.

Domain language. General-purpose embedding models handle ordinary English well and can miss the distinctions that matter inside a specialist field, where two terms a practitioner treats as quite different look nearly identical.

Changing the model invalidates everything. Embeddings from different models are not comparable. Switching means regenerating all of them, which is a real cost worth knowing about in advance.

What To Ask

  • How is our content split before embedding? The most consequential decision, and rarely discussed.
  • Can retrieval filter by permissions, date and status as well as similarity? Necessary for anything real.
  • What happens when nothing relevant is close enough? There must be a threshold and a graceful answer, rather than returning the least-bad match.
  • How is superseded content removed from the index? Otherwise old material keeps surfacing confidently.

Why It Matters To You

For a business the practical significance is that this is what makes your own accumulated material searchable by meaning: years of documents, tickets, notes and correspondence that were only ever findable if you remembered the words used.

That is often the highest-value AI project available to an established business, and it depends far more on the state of the underlying content than on the sophistication of the model.

More terms are in the glossary.

Portrait of Alexander De Sousa, founder of Digital Royalty
Founder-led
“I’ve put everything I know into how this company works — the standards, the method, the care on every project. It runs through the whole team, and I hold us all to it.”

Alexander De Sousa · Founder LinkedIn

Featured on BBC Radio Solent

Get started

Tell us what you need

A few quick questions, then a straight answer from a real person — usually within a few hours.

Tell us what you're working on

Whether it's a new site, a platform, or a process that shouldn't be manual any more — we'll tell you honestly if we can help.