Implements Phase 1 and Phase 2 of distributed enhancements for horizontal scaling: Phase 1 - Zero-Config Distributed Mode: - Add DistributedConfigManager for shared S3 configuration coordination - Implement explicit role configuration (reader/writer/hybrid) for safety - Add instance registration with heartbeat and health monitoring - Create hash-based partitioner for deterministic data distribution Phase 2 - Intelligent Data Management: - Add DomainDetector for automatic data categorization (medical, legal, product, etc.) - Implement domain-aware search filtering for improved relevance - Create role-based operational modes with specific optimizations - Add HealthMonitor for comprehensive metrics tracking Key Features: - Multi-writer support with consistent hash partitioning - Reader instances optimize for 80% cache utilization - Writer instances optimize for batched writes - Automatic domain detection and tagging - Real-time health monitoring across all instances - Cross-platform crypto utilities for browser compatibility Safety Improvements: - Require explicit role configuration (no automatic assignment) - Validate role compatibility on startup - Track instance health and performance metrics Testing: - Add comprehensive test suite for distributed features - All 25 distributed tests passing - Fixed domain filtering in search functionality Documentation: - Update README with distributed mode highlights - Add examples showing reader/writer setup - Document new capabilities and benefits 🤖 Generated with Claude Code https://claude.ai/code Co-Authored-By: Claude <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| mocks | ||
| api-integration.test.ts | ||
| core.test.ts | ||
| database-operations.test.ts | ||
| dimension-standardization.test.ts | ||
| distributed.test.ts | ||
| edge-cases.test.ts | ||
| environment.browser.test.ts | ||
| environment.node.test.ts | ||
| error-handling.test.ts | ||
| json-search-test.js | ||
| multi-environment.test.ts | ||
| opfs-storage.test.ts | ||
| package-size-breakdown.test.ts | ||
| package-size-limit.test.ts | ||
| performance.test.ts | ||
| s3-storage.test.ts | ||
| setup.ts | ||
| specialized-scenarios.test.ts | ||
| statistics-storage.test.ts | ||
| statistics.test.ts | ||
| storage-adapter-coverage.test.ts | ||
| storage-adapters.test.ts | ||
| tensorflow-patch.test.ts | ||
| test-matrix.md | ||
| type-utils.test.ts | ||
| vector-operations.test.ts | ||