364360d447
fix: exclude __words__ keyword index from corruption detection and getStats()
...
The __words__ keyword index stores 50-5000 entries per entity (one per
word), which inflated avg entries/entity well above the corruption
threshold of 100. This caused:
1. validateConsistency() to falsely detect corruption on every startup,
triggering unnecessary clearAllIndexData() + rebuild() cycles
2. getStats() to log false "Metadata index may be corrupted" warnings
and report inflated totalEntries/totalIds stats
Both methods now skip __words__ when counting, so stats and health
checks reflect metadata fields only (noun, type, createdAt, etc.).
Keyword search is unaffected since the __words__ field index itself
is not modified.
2026-01-27 15:38:21 -08:00
d938a6bd4f
feat: progressive init and readiness API for cloud storage
...
- Add `initMode` option to all cloud storage adapters (GCS, S3, Azure)
- 'auto' (default): progressive in cloud, strict locally
- 'progressive': <200ms cold starts, lazy bucket validation
- 'strict': blocking validation (current behavior)
- Add cloud environment auto-detection for:
- Cloud Run (K_SERVICE, K_REVISION)
- AWS Lambda (AWS_LAMBDA_FUNCTION_NAME)
- Cloud Functions (FUNCTIONS_TARGET)
- Azure Functions (AZURE_FUNCTIONS_ENVIRONMENT)
- Add readiness API to Brainy class:
- `brain.ready`: Promise that resolves when init() completes
- `brain.isFullyInitialized()`: checks if background tasks done
- `brain.awaitBackgroundInit()`: waits for background tasks
- Lazy bucket validation on first write (not during init)
- Background count synchronization
- Update AWS/GCP deployment docs with readiness patterns
🤖 Generated with [Claude Code](https://claude.com/claude-code )
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-07 12:51:05 -08:00
00aae8023c
chore(release): 4.0.0
...
Major release: Enterprise-scale cost optimization and performance features
Features:
- Cloud storage lifecycle management (GCS Autoclass, AWS Intelligent-Tiering, Azure)
- Batch operations (1000x faster deletions: 533 entities/sec vs 0.5/sec)
- FileSystem compression (60-80% space savings with gzip)
- OPFS quota monitoring for browser storage
- Enhanced CLI system (47 commands, 9 storage management commands)
Cost Impact:
- Up to 96% storage cost savings
- $138,000/year → $5,940/year @ 500TB scale
Breaking Changes: NONE
- 100% backward compatible
- All new features are opt-in
- No migration required
2025-10-17 14:48:34 -07:00
0996c72468
feat: Brainy 3.0 - Production-ready Triple Intelligence database
...
Major improvements and simplifications:
- Simplified to Q8-only model precision (99% accuracy, 75% smaller)
- Removed WAL augmentation (not needed with modern filesystems)
- Eliminated all fake/stub code - 100% production-ready
- Added comprehensive cloud deployment support (Docker, K8s, AWS, GCP)
- Enhanced distributed system capabilities
- Improved Triple Intelligence find() implementation
- Added streaming pipeline for large-scale operations
- Comprehensive test coverage with new test suites
Breaking changes:
- Renamed BrainyData to Brainy (simpler, cleaner)
- Removed FP32 model option (Q8 provides 99% accuracy)
- Removed deprecated augmentations
Performance improvements:
- 10x faster initialization with Q8-only
- Reduced memory footprint by 75%
- Better scaling for millions of items
Co-Authored-By: Recovery checkpoint system
2025-09-11 16:23:32 -07:00
