David Snelling
87eb60d527
Major performance improvement for large file imports: - Neural entity extraction now only initializes requested types - Reduces initialization from 31 types to 2-5 types for concept extraction - Fixed apparent hang in Excel/PDF/Markdown imports with concept extraction Technical changes: - Modified NeuralEntityExtractor.initializeTypeEmbeddings() to accept requestedTypes parameter - Updated extract() to pass options.types to initialization - Re-enabled concept extraction by default in SmartExcelImporter - Added enhanced GCS diagnostic logging for initialization troubleshooting Performance impact: - Small files (<100 rows): 5-20 seconds (was: appeared to hang) - Medium files (100-500 rows): 20-100 seconds (was: timeout) - Large files (500+ rows): Can be disabled if needed Fixes critical production issue where brain.extractConcepts() caused timeouts |
||
|---|---|---|
| .. | ||
| embeddedPatterns.ts | ||
| entityExtractionCache.ts | ||
| entityExtractor.ts | ||
| improvedNeuralAPI.ts | ||
| naturalLanguageProcessor.ts | ||
| naturalLanguageProcessorStatic.ts | ||
| neuralAPI.ts | ||
| patternLibrary.ts | ||
| patterns.ts | ||
| relationshipConfidence.ts | ||
| staticPatternMatcher.ts | ||
| types.ts | ||