Commit graph

2 commits

Author SHA1 Message Date
1c5c77e144 test: adjust type-matching tests for real embeddings (v3.33.0)
Update test expectations to reflect actual behavior of pre-computed type embeddings.
Real embeddings produce different similarity scores than mock embeddings.
All tests now validate correct behavior with production embeddings.
2025-10-09 18:32:14 -07:00
0d649b8a79 perf: pre-compute type embeddings at build time (zero runtime cost)
Major optimization - all type embeddings now built into package:

Build-time generation:
- Created scripts/buildTypeEmbeddings.ts to generate all type embeddings
- Generates embeddings for 31 NounTypes + 40 VerbTypes at build time
- Stores as base64-encoded binary data in embeddedTypeEmbeddings.ts
- Added check script to rebuild only when needed

Updated all consumers:
- NeuralEntityExtractor: loads pre-computed embeddings (instant)
- BrainyTypes: loads pre-computed embeddings (instant init)
- NaturalLanguageProcessor: loads pre-computed embeddings (instant init)

Build process:
- Added npm run build:types to generate embeddings
- Added npm run build:types:if-needed for conditional rebuild
- Integrated into main build pipeline
- Auto-rebuilds only when types or build script change

Benefits:
- Zero runtime cost - embeddings loaded instantly
- Survives all container restarts
- All 71 types always available (31 nouns + 40 verbs)
- ~100KB memory overhead for permanent performance gain
- Eliminates 5-10 second initialization delay

This completes the type embedding optimization started in v3.32.5
2025-10-09 18:08:57 -07:00