brainy/src/storage
David Snelling 3456ba332a fix(storage): add universal batch metadata reading to ALL storage adapters
CRITICAL FIX: getMetadataBatch was only implemented in S3CompatibleStorage,
causing other adapters to fall back to individual calls = socket exhaustion\!

Universal Implementation:
- Add getMetadataBatch() to MemoryStorage (in-memory batch processing)
- Add getMetadataBatch() to FileSystemStorage (10 concurrent file reads)
- Add getMetadataBatch() to OPFSStorage (10 concurrent OPFS operations)
- Enhanced S3CompatibleStorage with adaptive delays and timeout handling

Enhanced Debugging:
- Log storage adapter type and batch availability
- Clear fallback warnings if batch processing unavailable
- Progress reporting with success rates
- Better timeout and error handling

This ensures socket exhaustion prevention works regardless of storage adapter.
Services using Memory/FileSystem/OPFS storage will now use batch processing
instead of 1400+ individual getMetadata() calls during initialization.

Expected result: Services initialize successfully across ALL storage types
2025-08-07 12:14:23 -07:00
..
adapters fix(storage): add universal batch metadata reading to ALL storage adapters 2025-08-07 12:14:23 -07:00
backwardCompatibility.ts feat: migrate system metadata from 'index' to '_system' directory with backward compatibility 2025-08-06 09:45:56 -07:00
baseStorage.ts feat: v0.49 - Filter discovery API, remove deprecated methods, improve performance 2025-08-06 14:39:33 -07:00
cacheManager.ts fix(core): resolve TypeScript compilation errors and test failures 2025-08-04 20:00:38 -07:00
enhancedCacheManager.ts feat(hnsw): implement comprehensive large-scale search optimizations 2025-08-03 16:41:11 -07:00
readOnlyOptimizations.ts fix(types): add explicit ArrayBuffer type assertions for compression 2025-08-03 16:56:09 -07:00
storageFactory.ts refactor: simplify build system and improve model loading flexibility 2025-08-05 16:09:30 -07:00