This repository has been archived on 2026-09-03. You can view files and clone it, but you cannot make any changes to it's state, such as pushing and creating new issues, pull requests or comments.
open-brainy/src/hnsw
David Snelling 973b6aaa39 perf: defer HNSW persistence during addMany() batch operations
addMany() now temporarily switches the HNSW index to deferred persist
mode during the batch loop. Previously, each add() triggered ~16-20
saveHNSWData calls for modified neighbors (each a read→gzip→atomic-write
cycle). For 450 items this was ~8,100 individual storage writes.

With deferred mode, dirty node IDs are collected in a Set during the
batch and flushed once at the end — deduplicating repeated neighbor
updates. A node modified by insert #3 and again by insert #47 is
written only once.

Also adds setPersistMode() to TypeAwareHNSWIndex, propagating mode
changes to all existing type-specific sub-indexes.
2026-03-22 14:53:11 -07:00
..
hnswIndex.ts fix: flush all native providers on shutdown to prevent data loss 2026-02-01 16:23:49 -08:00
typeAwareHNSWIndex.ts perf: defer HNSW persistence during addMany() batch operations 2026-03-22 14:53:11 -07:00