brainy

soulcraft/brainy

Fork 0

Commit graph

Author	SHA1	Message	Date
David Snelling	773c5171c3	fix: flush all native providers on shutdown to prevent data loss Shutdown/close/flush now properly flushes all 4 components in parallel: metadataIndex, graphIndex, HNSW dirty nodes, and storage counts. Previously only counts were flushed, causing native provider data loss on restart. Also: - Wire roaring, msgpack, entityIdMapper provider consumption from plugins - Fix allOf filter O(n²) intersection → O(n) Set-based - Fix ne/exists negation filter to use Set-based exclusion - Add setMsgpackImplementation() swap in SSTable for native msgpack - Add setRoaringImplementation() swap for native CRoaring bitmaps - Add getAllIntIds() to EntityIdMapper for bitmap operations - Remove TypeAwareHNSWIndex from default index creation path - Export memory detection utilities from internals - Clean up 26 permanently-skipped dead tests	2026-02-01 16:23:49 -08:00
David Snelling	5d9ec5bb16	fix: resolve WASM loading for Bun --compile single-binary executables Both roaring-wasm and candle-wasm now work correctly in all environments: - Node.js (fs.readFileSync) - Bun runtime (Bun.file) - Bun --compile (embedded assets via import { type: 'file' }) - Browser (fetch) roaring-wasm: - Created src/utils/roaring/index.ts wrapper - Uses browser bundle which has WASM embedded as base64 - Top-level await ensures initialization before use - Zero environment detection needed (works everywhere) candle-wasm: - Created src/embeddings/wasm/wasmLoader.ts universal loader - Uses Bun's import { type: 'file' } to embed 93MB WASM in compiled binary - Fixed browser detection (Bun defines 'self', check for 'document' instead) - Simplified CandleEmbeddingEngine.ts to use wasmLoader Binary size verification: - Minimal Bun binary: 100MB (runtime only) - Brainy binary: 199MB (100MB runtime + 93MB WASM + 6MB JS) - No duplication: WASM embedded exactly once Test results: - Node.js: 1190/1190 tests pass - Bun runtime: 8/8 tests pass - Bun --compile: 8/8 tests pass 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2026-01-06 14:09:02 -08:00

Author

SHA1

Message

Date

David Snelling

773c5171c3

fix: flush all native providers on shutdown to prevent data loss

Shutdown/close/flush now properly flushes all 4 components in parallel:
metadataIndex, graphIndex, HNSW dirty nodes, and storage counts. Previously
only counts were flushed, causing native provider data loss on restart.

Also:
- Wire roaring, msgpack, entityIdMapper provider consumption from plugins
- Fix allOf filter O(n²) intersection → O(n) Set-based
- Fix ne/exists negation filter to use Set-based exclusion
- Add setMsgpackImplementation() swap in SSTable for native msgpack
- Add setRoaringImplementation() swap for native CRoaring bitmaps
- Add getAllIntIds() to EntityIdMapper for bitmap operations
- Remove TypeAwareHNSWIndex from default index creation path
- Export memory detection utilities from internals
- Clean up 26 permanently-skipped dead tests

2026-02-01 16:23:49 -08:00

David Snelling

5d9ec5bb16

fix: resolve WASM loading for Bun --compile single-binary executables

Both roaring-wasm and candle-wasm now work correctly in all environments:
- Node.js (fs.readFileSync)
- Bun runtime (Bun.file)
- Bun --compile (embedded assets via import { type: 'file' })
- Browser (fetch)

roaring-wasm:
- Created src/utils/roaring/index.ts wrapper
- Uses browser bundle which has WASM embedded as base64
- Top-level await ensures initialization before use
- Zero environment detection needed (works everywhere)

candle-wasm:
- Created src/embeddings/wasm/wasmLoader.ts universal loader
- Uses Bun's import { type: 'file' } to embed 93MB WASM in compiled binary
- Fixed browser detection (Bun defines 'self', check for 'document' instead)
- Simplified CandleEmbeddingEngine.ts to use wasmLoader

Binary size verification:
- Minimal Bun binary: 100MB (runtime only)
- Brainy binary: 199MB (100MB runtime + 93MB WASM + 6MB JS)
- No duplication: WASM embedded exactly once

Test results:
- Node.js: 1190/1190 tests pass
- Bun runtime: 8/8 tests pass
- Bun --compile: 8/8 tests pass

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

2026-01-06 14:09:02 -08:00

2 commits