> For the complete documentation index, see [llms.txt](https://docs.uptiq.ai/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.uptiq.ai/ai-workbench-qore/console/knowledge/document-processing.md).

# Document processing

Review how Qore extracts, structures, tags, and summarizes each document.

Qore extracts text, identifies sections, applies tags, and creates a summary for each document. Review these results to confirm that agents can retrieve the right information.

Use document processing when an answer is incomplete or inaccurate. Check it before syncing important files.

### Inspect a document

Open a knowledge base and select a document. Then choose an inspection view.

{% hint style="info" %}
**Review before sync.** A warning indicator identifies a document that needs attention, such as a failed sync.
{% endhint %}

* Select **Content** to review sections and chunks.
* Select **Tags**, **Raw extraction**, or **Summary** to investigate a specific issue.
* Open a dataset file with **⋮** → **View extracted content**.

{% columns %}
{% column %}
**Check structure**

Review **Content** and **Tags** when answers miss or confuse a topic.
{% endcolumn %}

{% column %}
**Check source text**

Review **Raw extraction** when the file itself was read incorrectly.
{% endcolumn %}
{% endcolumns %}

{% tabs %}
{% tab title="Content" %}

### Content

**Content** lists the sections Qore found in document order. Each section shows its chunk count. Select a section to review its extracted text and tags.

Retrieval uses this structure to locate relevant content. Clear, complete sections produce more accurate answers.

{% hint style="warning" %}
If an expected section is missing, or topics are merged, retrieval cannot recover them. Upload a corrected file, then sync it.
{% endhint %}
{% endtab %}

{% tab title="Tags" %}

### Tags

**Tags** label the document and its sections. They use the format `NAMESPACE:VALUE`. The namespace identifies the type of information.

| Namespace       | What it identifies                 |
| --------------- | ---------------------------------- |
| `DOCUMENT_TYPE` | The whole document                 |
| `SECTION_TYPE`  | A chunk's location in the document |
| `CONTENT_TYPE`  | What a chunk contains              |
| `FORMAT_TYPE`   | How content is organized           |
| `TIME_PERIOD`   | The time span a chunk references   |

Tags apply to individual chunks, not only to the document. A chunk can carry several tags that describe its document, position, meaning, and format.

* `SECTION_TYPE` identifies where a chunk appears in the document.
* `CONTENT_TYPE` identifies what a chunk is about.

Hover over a truncated tag to view its full value. You cannot add or edit tags in these views. Qore regenerates them during sync.

{% hint style="info" %}
The available namespaces vary by document type. The table describes common namespaces, not a fixed set.
{% endhint %}
{% endtab %}

{% tab title="Raw extraction" %}

### Raw extraction

**Raw extraction** contains the plain text Qore read before it created sections. Page breaks appear as `[PAGE 1]`. Select **Download** to save the extracted text.

Use this view when text is garbled, a scanned page has no text, or a table lost its structure. Problems here affect every later stage. Upload a better source file, then sync it. See [Sync & versions](/ai-workbench-qore/console/knowledge/sync-and-versions.md).

{% hint style="info" %}
Use **Raw extraction** for this review. The **Preprocessed Files** view is no longer available.
{% endhint %}
{% endtab %}

{% tab title="Summary" %}

### Summary

**Summary** provides a short description of the whole document. Use it as a quick check that Qore processed the expected content.

If the summary covers the wrong subject or omits part of the file, confirm the source in **Raw extraction**.
{% endtab %}
{% endtabs %}

### When you sync again

Qore regenerates the table of contents, tags, and summary during sync. **Force re-sync everything** replaces existing processing results. It does not merge them.

### Related

<table data-view="cards"><thead><tr><th>Title</th><th>Description</th><th data-card-target data-type="content-ref">Target</th></tr></thead><tbody><tr><td><strong>Knowledge</strong></td><td>Create knowledge bases, query them, and attach them.</td><td><a href="/ai-workbench-qore/console/knowledge.md">Knowledge</a></td></tr><tr><td><strong>Knowledge Datasets</strong></td><td>Manage the source files Qore processes.</td><td><a href="/ai-workbench-qore/console/knowledge/datasets.md">Datasets</a></td></tr><tr><td><strong>Sync &#x26; versions</strong></td><td>Sync file updates and review knowledge versions.</td><td><a href="/ai-workbench-qore/console/knowledge/sync-and-versions.md">Sync &amp; versions</a></td></tr><tr><td><strong>Try Knowledge</strong></td><td>Inspect the chunks and tags behind an answer.</td><td><a href="/ai-workbench-qore/console/knowledge/try-knowledge.md">Try Knowledge</a></td></tr><tr><td><strong>Knowledge &#x26; Context</strong></td><td>Why agents search your knowledge instead of reading all of it.</td><td><a href="/ai-workbench-qore/core-concepts/knowledge-and-context.md">Knowledge &amp; Context</a></td></tr></tbody></table>

***

{% columns %}
{% column width="83.33333333333334%" %}

<p align="right"><em>Maintained by</em> <mark style="color:green;">Abhishek Paul</mark><br><code>AI-assisted, human-approved</code></p>
{% endcolumn %}

{% column width="16.666666666666664%" %}

<div align="left"><img src="https://1326225582-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F0qmgQjJ5aArDTj2ACFHG%2Fuploads%2Fgit-blob-d034645b4f8f8ee661985f5306b60ded3289653c%2Fmaintainer-abhishek-paul.png?alt=media" alt="" width="60"></div>
{% endcolumn %}
{% endcolumns %}


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation by asking a question.

Perform an HTTP GET request on the following URL with the `ask` and `goal` query parameters:

```
GET https://docs.uptiq.ai/ai-workbench-qore/console/knowledge/document-processing.md?ask=<question>&goal=<user_goal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is what the user is ultimately trying to achieve, the reason they need the answer. Sharing it helps GitBook give you a better, more relevant answer. A goal is most helpful when it describes the outcome the user wants rather than restating the question. For example, with `ask=how do I create an API token`, a goal like `automate deployments from our CI pipeline` lets GitBook tailor the answer to that use case.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
