Skip to content

RETRAYA

Answers with sources: RETRAYA checks every sentence against the original

A chatbot sounds convincing even when it is wrong. RETRAYA delivers the passage in the original document for every sentence and stays silent when it finds none.

In short

The source check in RETRAYA is a step that compares every generated answer with the archive, sentence by sentence. It is meant for archives and newsrooms that pass answers on and need proof for them.

Updated: November 2026

Evidence or abstention as the principle

Ask a language model for facts and you get fluent sentences. Whether they are true stays open. In an archive that is a problem, because the answer gets quoted, printed or reused in an expert report.

RETRAYA works with a fixed rule. Every answer comes with the sentence in the original that supports it. A click on the source number opens the document at that spot. If the system finds no supporting passage, there is no answer.

The rule applies sentence by sentence, before the answer is assembled. A paragraph in which three sentences are right and one is invented is therefore trimmed before you see it.

The three lines of the check

The check consists of three steps that build on each other.

  1. Answer only from the passages. The model receives only the documents found and may not mix in general knowledge. Every sentence has to end with a source number. If the sources do not hold up, the model returns a fixed refusal.
  2. Sentence-by-sentence comparison. Next, every sentence of the answer is compared with the source sentences closest to it in meaning. Two checks decide whether the sentence follows from them and whether it is similar enough. Only the sentences that pass are delivered.
  3. Controlled stop. If nothing citable is found, the model itself declines or no sentence passes, RETRAYA stops and says there is not enough evidence.

The same kind of check also applies wherever else the system asserts something, for example to the connections in the knowledge network and in the fact check.

When RETRAYA stops

The three cases in which RETRAYA withholds the answer
SituationTriggerResult
No source The search finds no citable documents. No answer, note about missing evidence.
Model declines The texts found do not support the question. No answer, note about missing evidence.
Check fails Not a single sentence passes the comparison. No answer, note about missing evidence.

The confidence level for each statement

RETRAYA shows a level for each statement: high, medium or low. It results from the quality of the best hit, the share of sentences with sources and the number of sources.

Next to the level you see the strength of each source relative to the strongest. Anyone passing an answer on can tell at a glance whether it rests on a single source or on several.

For narrowly phrased factual questions a further step checks whether the sourced answer also fits the question. An answer that gives a name when asked for an age is not delivered, even if it is sourced.

An example with a swapped object

The trickiest error is the one where the source is right and a detail is not. The model writes that someone demanded the resignation of A. The article actually says the resignation of B.

This is how the check runs.

  1. The model words the sentence with the source number of the right article.
  2. RETRAYA fetches the source sentences closest to the sentence.
  3. The comparison recognises that the statement does not follow from the original.
  4. The similarity check also raises a flag, because the swapped object shifts the meaning.
  5. The sentence is removed. If no sentence is left, the answer says that evidence is missing.

The sentence is only delivered if the check finds it covered by the source. This lowers the risk of invented statements. There is no guarantee.

When nothing is sourced, RETRAYA says so

An answer such as “I cannot find sufficient evidence for this in the archive” is what an archive should give. It keeps out a sentence that sounds plausible but is not in any source.

The message is the same in all three cases. It does not tell apart whether the archive is silent on the topic or whether the check discarded a sentence. If you want to know what the collection holds on a keyword, there is the overview, which shows the sourced events with dates, or the complete list of released hits.

Follow-up questions such as “And what did he say about it?” are resolved by RETRAYA using the conversation so far and then checked like any other question. The demand for sources holds throughout the conversation.

Limits of the source check

The source check lowers the risk of invented statements. There is no guarantee. When in doubt the system leaves a sentence out, but some uncertainty remains.

Verbatim quotations appear only if they stand word for word in the article.

What the check covers and what it does not

Scope of the source check
QuestionAnswer
Does the sentence follow from the sources found? Yes, RETRAYA checks this for every sentence.
Is the source itself correct? RETRAYA does not check that. It reports what the collection says.
Are there statements outside the archive? The collection is not meant for that. The fact check then reports no evidence, which says nothing about whether the claim is true.
Does a person review the result? The passage opens with one click, and the decision stays with you.

How RETRAYA works with other parts of Beyonetix OS

Documents handles invoices, contracts and other documents that first have to be read in. There, fields are read, cross-checked and given a source location. RETRAYA comes in later, when a collection exists and questions are asked of it.

RETRAYA calls language models through a dedicated access point in the operator's network. We clarify in a conversation how operation would look for you. The general approach is described on the page about sovereign infrastructure.

Frequently asked

Questions about the source check

How does this differ from a normal chat answer?

A chat may add from general knowledge and often names no source. RETRAYA uses only your collection and attaches the passage to every sentence.

What happens if no evidence is found?

RETRAYA reports that there is not enough evidence.

Does RETRAYA also check statements from outside sources?

It checks against the collection you place in RETRAYA. A claim on which the archive holds nothing gets the result no evidence.

Who is this for?

For newsrooms and publishers with a large archive, where answers are passed on. For companies and law firms it is a goal we are working toward, which we discuss on a sample.

See the source check on your collection

We take a sample of your archive and ask questions with you where the source matters.