brainy/src/storage
David Snelling a0d736472c fix: implement high-volume optimizations to prevent socket exhaustion
- Add request coalescing to reduce S3 API calls by up to 90%
- Implement write buffering with automatic batch flushing
- Add operation deduplication to eliminate redundant requests
- Introduce high-volume mode that automatically activates under load
- Batch S3 operations to reduce from 16,000+ individual to ~160 batch operations
- Maintain zero-configuration approach with automatic adaptation

This fix addresses the socket exhaustion issue in bluesky-package where
16,000+ pending requests were overwhelming the system. The new buffering
and coalescing systems reduce S3 operations by 100x while maintaining
data consistency.
2025-08-07 09:09:43 -07:00
..
adapters fix: implement high-volume optimizations to prevent socket exhaustion 2025-08-07 09:09:43 -07:00
backwardCompatibility.ts feat: migrate system metadata from 'index' to '_system' directory with backward compatibility 2025-08-06 09:45:56 -07:00
baseStorage.ts feat: v0.49 - Filter discovery API, remove deprecated methods, improve performance 2025-08-06 14:39:33 -07:00
cacheManager.ts fix(core): resolve TypeScript compilation errors and test failures 2025-08-04 20:00:38 -07:00
enhancedCacheManager.ts feat(hnsw): implement comprehensive large-scale search optimizations 2025-08-03 16:41:11 -07:00
readOnlyOptimizations.ts fix(types): add explicit ArrayBuffer type assertions for compression 2025-08-03 16:56:09 -07:00
storageFactory.ts refactor: simplify build system and improve model loading flexibility 2025-08-05 16:09:30 -07:00