Operating Knowledge Storage

Knowledge indexing stores searchable vectors in the selected vector store. These vectors are derived data: changing or resetting the store does not change the source files in the Workspace.


Before you begin

  • Required role: Workspace administrator
  • Check the current driver and connection state under Knowledge Services > Knowledge Storage.
  • Schedule migrations and resets for a suitable time because vector results may be incomplete while reindexing runs.

Choose a vector store

DriverStorage locationCollection preparationTypical use
Automatic (SQLite)SpaceBuilder internal storageNoneDefault embedded storage
Local (SQLite)local_vectors.db under a configured pathNoneSmaller installations that need a specific local path
QdrantExternal Qdrant serviceCreated on first indexingSeparate service or larger vector sets
MilvusExternal Milvus serviceCreate it before connectingExisting Milvus deployments and large clusters

Vector count means document chunks, not documents. A long document produces multiple vectors. Configure an embedding model even when the storage connection itself is healthy.

Operate Local (SQLite)

Local storage keeps vectors in local_vectors.db. Relative paths are resolved from the SpaceBuilder configuration directory. The status page also shows the SQLite database, WAL, SHM, and reusable free space.

Change the store or embedding model

Saving any of the following changes starts a full reindex from the source content:

  • driver, endpoint, collection, or local data path
  • embedding model or vector dimension

The migration proceeds as follows:

  1. Save the new configuration.
  2. The indexing scheduler detects the change and queues a full reindex.
  3. SpaceBuilder embeds every source document into the new store.
  4. After indexing and search validation finish, it removes the old vectors from their original store.

Keep the previous external store reachable until cleanup finishes. When changing vector dimensions, select a new compatible collection; an existing Qdrant or Milvus collection cannot accept vectors with a different dimension.

During migration, vector search may be paused briefly or return only content already written to the new store. Keyword search remains available.

Read operating state

Knowledge Storage shows connection state, driver, entity count, collection count, and collection compatibility.

StateMeaning and action
Compatible dimension and distanceThe collection is ready.
Not created; created on first indexingA Qdrant collection does not exist yet. This is expected before the first write.
Collection missingCreate the Milvus collection before indexing.
Check collection settingsDimension, distance metric, or vector layout does not match the SetFN configuration.

Use Ingestion & Indexing to review pending updates, pending embeddings, embedding totals, and pending vector deletions. Cleanup retries use increasing delays up to five minutes when an old store is unavailable.

Reindex or reset

Both administrator actions preserve source files.

ActionResultWhen to use it
Reindex all dataReads, chunks, and embeds every source againExtraction rules changed or search data needs rebuilding
Reset vectors and reindexDeletes this SpaceBuilder installation's vectors from the current store, then queues a full reindexThe derived store is inconsistent or must be rebuilt from zero

Completion is shown on Ingestion & Indexing. A reset does not delete vectors owned by another installation that shares the collection.

Share an external service safely

Every SpaceBuilder installation writes an isolation key and limits search, statistics, and reset operations to its own data. Separate collections are still recommended because they simplify capacity management, backups, and deletion. The settings page warns when another local SpaceBuilder project uses the same collection.

Back up and restore knowledge state

Stop the SpaceBuilder server before running these commands. The backup target must be a new path. Restore is limited to a backup from the same installation and home directory.

~/SetFnSpaceBuilder admin knowledge-backup <backup-directory>
~/SetFnSpaceBuilder admin knowledge-restore <backup-directory>

The backup includes team and personal indexing records. A local local_vectors.db is included only when it is under the SpaceBuilder home or configuration directory. Qdrant and Milvus vectors are excluded because they can be rebuilt from source files.

After restoring, start the server and run Reindex all data in Knowledge Storage.

Troubleshoot storage

SymptomWhat to check
DisconnectedEndpoint, port, firewall, service status, and credentials
Dimension mismatchConfigure the embedding dimension used by the collection, or use a new collection
Unnamed dense vector errorUse a single unnamed dense vector in Qdrant instead of a named or hybrid layout
Entity count does not increaseIndexing enabled, allowed schedule, required models, and pending errors
Cleanup retries continueRestore connectivity to the previous store so queued deletion can finish