This repository has been archived on 2026-09-03. You can view files and clone it, but you cannot make any changes to it's state, such as pushing and creating new issues, pull requests or comments.
open-brainy/src/import
David Snelling 364360d447 fix: exclude __words__ keyword index from corruption detection and getStats()
The __words__ keyword index stores 50-5000 entries per entity (one per
word), which inflated avg entries/entity well above the corruption
threshold of 100. This caused:

1. validateConsistency() to falsely detect corruption on every startup,
   triggering unnecessary clearAllIndexData() + rebuild() cycles
2. getStats() to log false "Metadata index may be corrupted" warnings
   and report inflated totalEntries/totalIds stats

Both methods now skip __words__ when counting, so stats and health
checks reflect metadata fields only (noun, type, createdAt, etc.).
Keyword search is unaffected since the __words__ field index itself
is not modified.
2026-01-27 15:38:21 -08:00
..
BackgroundDeduplicator.ts perf: optimize imports with background deduplication (12-24x speedup) 2025-11-11 14:10:14 -08:00
EntityDeduplicator.ts feat: add unified import system with auto-detection and dual storage 2025-10-08 16:55:30 -07:00
FormatDetector.ts fix: exclude __words__ keyword index from corruption detection and getStats() 2026-01-27 15:38:21 -08:00
ImportCoordinator.ts fix: exclude __words__ keyword index from corruption detection and getStats() 2026-01-27 15:38:21 -08:00
ImportHistory.ts feat: v5.1.0 - VFS auto-initialization and complete API documentation 2025-11-02 10:58:52 -08:00
index.ts perf: optimize imports with background deduplication (12-24x speedup) 2025-11-11 14:10:14 -08:00
InstancePool.ts feat: implement progressive flush intervals for streaming imports 2025-10-22 17:36:27 -07:00