• v3.50.1 52d1602907

    dpsifr released this 2025-10-17 01:13:00 +02:00 | 762 commits to main since this release

    Critical Bug Fix: Metadata Explosion

    Fixes the metadata explosion bug reported by Soulcraft Studio team where 69,429 chunk files were created for only 1,143 entities.

    Impact

    • File reduction: 69,429 → ~1,200 files (58x reduction)
    • Storage reduction: 3.3GB → ~10MB metadata (330x reduction)
    • Fixes server initialization hangs
    • Fixes VFS getDescendants() hanging
    • Fixes Graph View UI not loading

    Root Cause

    Vector embeddings (384-dimensional arrays) were being indexed in metadata, creating a separate chunk file for each dimension.

    Solution

    • Added NEVER_INDEX Set excluding vector fields
    • Added safety check for large arrays (>10 elements)
    • Preserves small array indexing (tags, categories)

    Test Results

    • 7/7 integration tests passing
    • Verified: 6 chunk files for 10 entities (was 7,210 before fix)
    • 611/622 unit tests passing

    For Soulcraft Studio Team

    To apply the fix to your existing data:

    1. Upgrade to v3.50.1: npm install @soulcraft/brainy@3.50.1
    2. Delete corrupted metadata: rm -rf brainy-data/_system/
    3. Restart your app - metadata will rebuild automatically

    See full CHANGELOG for details.

    Full Changelog: https://github.com/soulcraftlabs/brainy/compare/v3.50.0...v3.50.1

    Downloads