Glossary

Technology and models

Hallucination: definition, use and limits

Topic: Hallucination

Definition

A hallucination is an answer from a language model that sounds plausible but is factually wrong or invented. The model fills gaps with statistically likely text even when it lacks a reliable basis. On the phone this means the assistant states a price, a slot or a commitment that is not true. Without a safeguard the statement sounds convincing and still causes harm.

Why the Term Matters

On the phone there is no scrolling back. What the assistant says counts as binding to the caller, and an invented opening time or a wrong price costs trust and sometimes money. Who understands hallucination builds the call flow so the assistant answers only from checked sources and hands over when unsure rather than guessing.

When It Is Relevant

  • The assistant gives information on prices, availability or terms.
  • Callers ask questions whose answers change often.
  • Commitments on the phone have legal or financial consequences.
  • The assistant works without a firm link to a knowledge source.

When Not

For purely routing conversations, such as asking the request and forwarding to the right place, the topic barely matters because the assistant claims no facts. For plain bookings against a real calendar the risk is low too, as long as no free-form answers are added.

Industries That Use It

  • Insurance and financial advice: avoid false statements on tariffs or deadlines on the phone, because they carry direct liability.
  • Healthcare: no invented medical or scheduling claims, but a clear handover to the practice.
  • E-commerce and retail: price and delivery answers must match real stock, not probability.
  • Travel and mobility: availability and booking rules change constantly and must not be guessed.

Typical Use Cases

  • Price information the assistant reads only from a maintained list.
  • Availability query checked against the real calendar.
  • Question on terms where the assistant deliberately hands over instead of guessing.
  • Logging of every answer so false statements can be traced.
  • A fallback line when no source applies, instead of an invented answer.

Decision Guide

Decision Guide
Signal Safeguard fits Alternative
Assistant gives out facts bind answers to a source a free model invents details
Information changes often live check against the system a static answer goes stale
A statement has consequences hand over when unsure guessing damages trust
Only call routing risk is low no fact check needed

Example

[Example]

A retail business has incoming calls answered by the assistant. When a caller asks for delivery time, the assistant reads only the value from the connected system. If the value is missing, it says so openly and offers a callback from a staff member instead of inventing a number. Every answer is logged. This describes the method, not an asserted client metric.

Service Connection

Safeguarded phone information comes from the AI phone assistant, for outbound the AI phone sales, technically a voice agent linked to checked sources.

Sources

This framing describes common practice in handling language models. How strongly an assistant tends to hallucinate depends on the model, the integration and the prompt and must be tested case by case.

Related topicsRetrievalData qualityKnowledge base

Booking

Book a strategy call

Check where your call flow risks invented answers. Book a slot directly in the embedded calendar (Book a strategy call). Alternatively: info@ki-telefonassistent.co.

Or send an email to info@ki-telefonassistent.co

Review your call use case

FAQ

Frequently asked questions

01 Can an AI phone assistant avoid hallucinations entirely?
It cannot be ruled out completely, but it can be reduced sharply. Binding answers to checked sources and handing over when unsure keeps the risk small.
02 How do I notice the assistant is hallucinating?
By answers that sound convincing but do not match your system. That is why logging every answer matters so much.
03 Is an invented price on the phone legally binding?
That depends on the case and must be checked. Exactly for that reason the assistant should state facts only from maintained sources and otherwise hand over.