brainy/src/utils/index.ts

export * from './distance.js'
export * from './embedding.js'
export * from './workerUtils.js'
export * from './statistics.js'
Initial commit 2025-06-24 11:41:30 -07:00			`export * from './distance.js'`
			`export * from './embedding.js'`
feat(src/brainyData, src/utils): enhance embedding efficiency with batch processing and initialize safeguards - Added batch embedding support with `defaultBatchEmbeddingFunction`, leveraging shared model instances for optimized performance. - Integrated `isInitializing` flag to prevent recursive initialization and ensure smooth concurrent operation handling during `BrainyData` initialization. - Pre-loaded Universal Sentence Encoder in `BrainyData` to prevent delays during embedding. - Introduced fallback mechanisms in embedding initialization for better error resiliency and model reusability. - Updated `addBatch` with support for batchSize and refactored text/vector processing logic for clearer separation and memory management. - Improved GPU and CPU backend selection in Universal Sentence Encoder for compatibility across environments. - Enhanced memory management by cleaning tensors after embedding operations. - Updated README with instructions for batch embedding, threading updates, and GPU/CPU optimizations. 2025-06-27 14:06:59 -07:00			`export * from './workerUtils.js'`
feat(core, tests): add standalone getStatistics function and improve storage configuration - Core: Introduced a new `getStatistics` utility function in `statistics.ts` for fetching database statistics at the root level of the library. Enhanced `BrainyData` methods to ensure metadata includes `id` field and refined statistics calculations, excluding verbs from the noun count. - Tests: Added comprehensive test coverage in `statistics.test.ts` for the new utility function, validating proper error handling, statistics accuracy, and consistent results between instance methods and standalone function. - Storage Config: Enabled dynamic support for AWS S3, Cloudflare R2, and Google Cloud Storage in web service configuration, utilizing environment variables for adapter setup. Addressed a race condition in `FileSystemStorage` initialization by deferring path module imports. Purpose: Enhance database analytics by introducing a reusable `getStatistics` function, improve flexibility in storage configuration, and ensure robust testing for reliability and accuracy. 2025-07-23 16:26:59 -07:00			`export * from './statistics.js'`