David Snelling
a21a84545a
Critical fix for v3.37.1 GCS persistence bug where HNSW rebuild reported "Preloading 0 vectors" and hung indefinitely during container restarts. Root Cause: HNSW rebuild (hnswIndex.ts:835) calls storage.getStatistics() and expects stats.totalNodes to determine entity count for adaptive caching. When totalNodes was undefined, entityCount evaluated to 0, causing HNSW to report "0 vectors" and hang waiting for entities that it couldn't find. Fixes Applied: - GcsStorage: Populate totalNodes/totalEdges from this.totalNounCount/totalVerbCount - MemoryStorage: Populate totalNodes/totalEdges from in-memory counts - OPFSStorage: Populate totalNodes/totalEdges in ALL return paths (cache, current day, yesterday, legacy) - S3CompatibleStorage: Populate totalNodes/totalEdges in ALL return paths (cache, fresh stats, error fallback) Impact: - ✅ GCS container restarts now work correctly - ✅ HNSW rebuild correctly detects entity count - ✅ Adaptive caching strategy works as designed - ✅ All storage adapters now consistent Files exist in GCS, counts load correctly, but HNSW couldn't see them because getStatisticsData() didn't populate the totalNodes field that HNSW depends on. Closes: BRAINY_V3_37_1_INDEX_REBUILD_BUG.md Related: v3.37.0 (metadata reconstruction), v3.37.1 (getNoun_internal fix) |
||
|---|---|---|
| .. | ||
| api | ||
| augmentations | ||
| cli | ||
| config | ||
| cortex | ||
| critical | ||
| distributed | ||
| embeddings | ||
| errors | ||
| graph | ||
| hnsw | ||
| import | ||
| importers | ||
| interfaces | ||
| mcp | ||
| neural | ||
| patterns | ||
| scripts | ||
| shared | ||
| storage | ||
| streaming | ||
| triple | ||
| types | ||
| universal | ||
| utils | ||
| vfs | ||
| augmentationManager.ts | ||
| augmentationPipeline.ts | ||
| brainy.ts | ||
| coreTypes.ts | ||
| cortex.ts | ||
| index.ts | ||
| pipeline.ts | ||
| setup.ts | ||
| unified.ts | ||
| worker.ts | ||