brainy/src
David Snelling 71b5e09462 **refactor: remove simple embedding model and enhance UniversalSentenceEncoder implementation**
### Changes:
- Removed `SimpleEmbedding` class, including its character-based embedding functionality and associated utility methods.
- Refined the Universal Sentence Encoder (USE) implementation:
  - Added support for handling edge cases such as empty strings and arrays by returning zero vectors.
  - Filtered out invalid input, improving robustness.
  - Addressed `EPSILON` flag initialization and TensorFlow.js environment setup to prevent runtime errors.
- Updated error handling for embedding failures to provide more detailed traceability.
- Simplified `createEmbeddingFunction` and `defaultEmbeddingFunction` to focus solely on TensorFlow-based embeddings.

### Purpose:
Streamlined the embedding API by removing the outdated `SimpleEmbedding` class and fully transitioning to TensorFlow's Universal Sentence Encoder. These changes improve input validation, error resilience, and compatibility with TensorFlow.js, ensuring a more consistent and reliable embedding experience.
2025-06-19 15:02:39 -07:00
..
augmentations **remove: delete LLM augmentations implementation** 2025-06-19 15:00:26 -07:00
examples chore: remove examples/externalPlugins.js and pluginLoader.ts, update imports to .js 2025-05-29 09:52:30 -07:00
hnsw **feat: integrate optimized index functionality into BrainyData** 2025-06-19 15:02:25 -07:00
storage feat: add random graph generation and improve metadata vectorization 2025-06-05 14:04:29 -07:00
types **feat: introduce Optimized HNSW Index with product quantization and disk-based storage support** 2025-06-19 15:02:05 -07:00
utils **refactor: remove simple embedding model and enhance UniversalSentenceEncoder implementation** 2025-06-19 15:02:39 -07:00
augmentationPipeline.ts feat: implement SequentialPipeline with threading and WebSocket support 2025-06-04 10:01:46 -07:00
augmentationRegistry.ts chore: remove examples/externalPlugins.js and pluginLoader.ts, update imports to .js 2025-05-29 09:52:30 -07:00
augmentationRegistryLoader.ts chore: remove examples/externalPlugins.js and pluginLoader.ts, update imports to .js 2025-05-29 09:52:30 -07:00
brainyData.ts **feat: integrate optimized index functionality into BrainyData** 2025-06-19 15:02:25 -07:00
cli.ts **feat: add backup and restore commands for database operations** 2025-06-19 15:00:58 -07:00
coreTypes.ts **feat: introduce Optimized HNSW Index with product quantization and disk-based storage support** 2025-06-19 15:02:05 -07:00
index.ts **feat: add browser-compatible build configuration and environment detection** 2025-06-19 14:59:42 -07:00
sequentialPipeline.ts chore: update Node.js requirement to 23.11.0 and optimize pipelines and utilities 2025-06-05 14:51:21 -07:00
unified.ts **feat: add browser-compatible build configuration and environment detection** 2025-06-19 14:59:42 -07:00