- Remove @huggingface/transformers dependency (539MB native binaries) - Add direct ONNX Runtime Web embedding engine - Bundle all-MiniLM-L6-v2-q8 model (24MB, no runtime downloads) - Works with Node.js, Bun, and bun build --compile - Air-gap compatible: fully self-contained, no internet required New WASM embedding components: - WASMEmbeddingEngine: Main integration class - WordPieceTokenizer: Pure TypeScript tokenizer - EmbeddingPostProcessor: Mean pooling + L2 normalization - ONNXInferenceEngine: Direct ONNX Runtime Web wrapper - AssetLoader: Model file loading Tests added: - 11 WASM embedding integration tests - 8 Bun compatibility tests New npm scripts: - test:wasm - Run WASM embedding tests - test:bun - Run tests with Bun - test:bun:compile - Build and run compiled binary |
||
|---|---|---|
| .. | ||
| buildEmbeddedPatterns.ts | ||
| buildKeywordEmbeddings.ts | ||
| buildTypeEmbeddings.ts | ||
| check-keyword-embeddings.cjs | ||
| check-patterns.cjs | ||
| check-type-embeddings.cjs | ||
| create-models-release.sh | ||
| diagnose-workshop-issue.ts | ||
| download-model.cjs | ||
| download-models.cjs | ||
| ensure-models.js | ||
| migrate-to-structured-logger.ts | ||
| migrate-vfs-storage.ts | ||
| prepare-models.js | ||
| release.sh | ||
| setup-github-models.sh | ||
| test-with-memory.sh | ||
| update-augmentations-metadata.sh | ||