David Snelling
71b5e09462
### Changes: - Removed `SimpleEmbedding` class, including its character-based embedding functionality and associated utility methods. - Refined the Universal Sentence Encoder (USE) implementation: - Added support for handling edge cases such as empty strings and arrays by returning zero vectors. - Filtered out invalid input, improving robustness. - Addressed `EPSILON` flag initialization and TensorFlow.js environment setup to prevent runtime errors. - Updated error handling for embedding failures to provide more detailed traceability. - Simplified `createEmbeddingFunction` and `defaultEmbeddingFunction` to focus solely on TensorFlow-based embeddings. ### Purpose: Streamlined the embedding API by removing the outdated `SimpleEmbedding` class and fully transitioning to TensorFlow's Universal Sentence Encoder. These changes improve input validation, error resilience, and compatibility with TensorFlow.js, ensuring a more consistent and reliable embedding experience. |
||
|---|---|---|
| .. | ||
| augmentations | ||
| examples | ||
| hnsw | ||
| storage | ||
| types | ||
| utils | ||
| augmentationPipeline.ts | ||
| augmentationRegistry.ts | ||
| augmentationRegistryLoader.ts | ||
| brainyData.ts | ||
| cli.ts | ||
| coreTypes.ts | ||
| index.ts | ||
| sequentialPipeline.ts | ||
| unified.ts | ||