feat: add distributed architecture with sharding and coordination

- Wire up distributed components (Coordinator, ShardManager, CacheSync)
- Implement automatic sharding for S3 storage (256 shards)
- Add read/write separation for operational modes
- Zero-config automatic detection for distributed mode
- Add mutex implementation for thread safety
- Fix metadata filtering in find operations
- Fix neural API vector similarity calculations
- Improve batch operations performance
- Add Bluesky distributed setup example

BREAKING CHANGE: None - backward compatible
This commit is contained in:
David Snelling 2025-09-22 15:45:35 -07:00
parent 8aafc769a3
commit ed64c266ec
30 changed files with 2084 additions and 439 deletions

View file

@ -157,14 +157,15 @@ export class NaturalLanguageProcessor {
/**
* Find similar queries from history (without using Brainy)
* NOTE: Currently unused - reserved for future query caching optimization
*/
private findSimilarQueries(embedding: Vector): Array<{
query: string
result: TripleQuery
similarity: number
}> {
// Simple similarity check against recent history
// This is just a placeholder - real implementation would use cosine similarity
// Not implemented - not required for core functionality
// Would implement cosine similarity against queryHistory if needed
return []
}