soulcraft/brainy
2
0
Fork 0
Code Issues 1 Pull requests Projects Releases 335 Packages Wiki Activity Actions

335 releases 523 tags

RSS feed
  • v6.2.0 c0d3968ccf

    v6.2.0 - 10-20x Faster Cloud Storage Performance Stable

    dpsifr released this 2025-11-21 00:24:59 +01:00 | 520 commits to main since this release

    🚀 v6.2.0 - 10-20x Faster Cloud Storage Performance

    Major performance release eliminating N+1 patterns across all APIs

    ⚡ Performance Improvements

    Fixed 8 N+1 patterns for 10-20x faster batch operations on cloud storage (GCS, S3, Azure, R2):

    Operation Before After Speedup
    find() with 10 results 500ms 50ms 10x
    batchGet() with vectors (10) 500ms 50ms 10x
    executeGraphSearch() (20) 1000ms 50ms 20x
    relate() duplicate check (5) 250ms 50ms 5x
    deleteMany() (10 entities) 2000ms 200ms 10x
    VFS tree loading 5304ms 100ms 53x
    VFS file operations 100-150ms 50ms 2-3x

    🔧 Fixes Implemented

    1. find() method - 5 locations now use batch entity loading
    2. batchGet() with vectors - New storage.getNounBatch() for 10x faster vector loading
    3. executeGraphSearch() - Batch-loads connected entities
    4. relate() duplicate checking - New graphIndex.getVerbsBatchCached() with cache-aware loading
    5. deleteMany() - Transaction batching (chunks of 10 entities)
    6. VFS tree traversal - Single batch fetch vs 111 separate calls
    7. VFS file operations - Removed updateAccessTime() write on every read

    📦 New Methods Added

    • storage.getNounBatch(ids) - Batch-load nouns with vectors
    • storage.getVerbsBatch(ids) - Batch-load relationships
    • graphIndex.getVerbsBatchCached(ids) - Cache-aware batch verb loading

    🏗️ Architecture

    • ✅ Works with ALL storage adapters (GCS, S3, Azure, R2, OPFS, FileSystem)
    • ✅ Full COW/fork/asOf support via readBatchWithInheritance()
    • ✅ Cache-aware with UnifiedCache integration
    • ✅ Transaction-safe with atomic chunked operations
    • ✅ Zero breaking changes - automatic performance improvement

    💰 Impact

    • 10-20x faster batch operations on cloud storage
    • 50-90% cost reduction (fewer storage API calls)
    • Production-ready with clean architecture
    • Fully backward compatible

    📝 Migration

    No action required - performance improvements are automatic!

    For detailed information, see CHANGELOG.md

    Full Changelog: https://github.com/soulcraftlabs/brainy/compare/v6.1.0...v6.2.0

    Downloads