This repository has been archived on 2026-09-03. You can view files and clone it, but you cannot make any changes to it's state, such as pushing and creating new issues, pull requests or comments.
open-brainy/src/neural
David Snelling d5b24c3ad3 feat: implement production-ready type-aware NLP with zero hardcoded fields
🎯 COMPLETE TYPE-AWARE INTELLIGENCE SYSTEM:

## Type-Field Affinity Tracking:
- Track which fields actually appear with which NounTypes in real data
- Build affinity maps: Document → [title: 0.95, author: 0.87, publishDate: 0.82]
- Update tracking during all CRUD operations for real-time accuracy

## Dynamic Field Discovery:
- ZERO hardcoded fields except NounType/VerbType taxonomies (30+ noun, 40+ verb)
- Generate field variations algorithmically (camelCase, snake_case, suffixes)
- Remove all hardcoded abbreviations - purely linguistic pattern-based

## Type-Aware NLP Parsing:
- Detect NounType first using semantic similarity on pre-embedded types
- Get type-specific fields with affinity scores for context
- Prioritize field matching based on type relevance
- Boost confidence for fields with high type affinity

## Field-Type Validation:
- Validate field compatibility with detected types
- Provide intelligent suggestions for invalid combinations
- Auto-correct queries using most likely field alternatives
- Comprehensive validation warnings for debugging

## Smart Query Optimization:
- Type-context field prioritization
- Affinity-based confidence boosting
- Query plan optimization with type hints
- Performance metrics and cost estimation

## Production Features:
- All dynamic - learns from actual data patterns
- No stubs, fallbacks, or hardcoded lists
- Type-safe with comprehensive validation
- Real-time affinity tracking during CRUD
- Semantic matching for all field discovery

Example Intelligence:
Query: "documents by Smith with high citations"
→ Detects: NounType.Document (0.92 confidence)
→ Fields: "by" → "author" (0.87 type affinity boost)
→ Query: {type: "document", where: {author: "Smith", citations: {gt: 100}}}
→ Validates:  Documents have author field (87% affinity)
→ Optimizes: Process author first (lower cardinality)

This creates TRUE artificial intelligence for query understanding.
2025-09-12 13:24:47 -07:00
..
embeddedPatterns.ts feat: implement incremental sorted indices and Triple Intelligence find() 2025-09-12 12:36:11 -07:00
entityExtractor.ts feat: Brainy 3.0 - Production-ready Triple Intelligence database 2025-09-11 16:23:32 -07:00
improvedNeuralAPI.ts feat: Brainy 3.0 - Production-ready Triple Intelligence database 2025-09-11 16:23:32 -07:00
naturalLanguageProcessor.ts feat: implement production-ready type-aware NLP with zero hardcoded fields 2025-09-12 13:24:47 -07:00
naturalLanguageProcessorStatic.ts feat: Brainy 3.0 - Production-ready Triple Intelligence database 2025-09-11 16:23:32 -07:00
neuralAPI.ts feat: Brainy 3.0 - Production-ready Triple Intelligence database 2025-09-11 16:23:32 -07:00
patternLibrary.ts feat: implement incremental sorted indices and Triple Intelligence find() 2025-09-12 12:36:11 -07:00
patterns.ts 🧠 Brainy 2.0.0 - Zero-Configuration AI Database with Triple Intelligence™ 2025-08-26 12:32:21 -07:00
staticPatternMatcher.ts feat: Brainy 3.0 - Production-ready Triple Intelligence database 2025-09-11 16:23:32 -07:00
types.ts feat: fix verb storage pipeline and implement relationship-aware neural clustering 2025-09-02 16:37:40 -07:00