For the complete documentation index, see llms.txt. This page is also available as Markdown.

Document processing

Review how Qore extracts, structures, tags, and summarizes each document.

Qore extracts text, identifies sections, applies tags, and creates a summary for each document. Review these results to confirm that agents can retrieve the right information.

Use document processing when an answer is incomplete or inaccurate. Check it before syncing important files.

Inspect a document

Open a knowledge base and select a document. Then choose an inspection view.

Review before sync. A warning indicator identifies a document that needs attention, such as a failed sync.

  • Select Content to review sections and chunks.

  • Select Tags, Raw extraction, or Summary to investigate a specific issue.

  • Open a dataset file with ⋮ → View extracted content.

Check structure

Review Content and Tags when answers miss or confuse a topic.

Check source text

Review Raw extraction when the file itself was read incorrectly.

Content

Content lists the sections Qore found in document order. Each section shows its chunk count. Select a section to review its extracted text and tags.

Retrieval uses this structure to locate relevant content. Clear, complete sections produce more accurate answers.

Tags

Tags label the document and its sections. They use the format NAMESPACE:VALUE. The namespace identifies the type of information.

Namespace
What it identifies

DOCUMENT_TYPE

The whole document

SECTION_TYPE

A chunk's location in the document

CONTENT_TYPE

What a chunk contains

FORMAT_TYPE

How content is organized

TIME_PERIOD

The time span a chunk references

Tags apply to individual chunks, not only to the document. A chunk can carry several tags that describe its document, position, meaning, and format.

  • SECTION_TYPE identifies where a chunk appears in the document.

  • CONTENT_TYPE identifies what a chunk is about.

Hover over a truncated tag to view its full value. You cannot add or edit tags in these views. Qore regenerates them during sync.

The available namespaces vary by document type. The table describes common namespaces, not a fixed set.

Raw extraction

Raw extraction contains the plain text Qore read before it created sections. Page breaks appear as [PAGE 1]. Select Download to save the extracted text.

Use this view when text is garbled, a scanned page has no text, or a table lost its structure. Problems here affect every later stage. Upload a better source file, then sync it. See Sync & versions.

Use Raw extraction for this review. The Preprocessed Files view is no longer available.

Summary

Summary provides a short description of the whole document. Use it as a quick check that Qore processed the expected content.

If the summary covers the wrong subject or omits part of the file, confirm the source in Raw extraction.

When you sync again

Qore regenerates the table of contents, tags, and summary during sync. Force re-sync everything replaces existing processing results. It does not merge them.


Maintained by Abhishek Paul AI-assisted, human-approved

Last updated

Was this helpful?