Implements Phase 1.5 (Comprehensive MIME Type Detection) and adds built-in image processing support to IntelligentImportAugmentation.
**New Features:**
- ImageHandler: Extracts image metadata (dimensions, format, color space) using sharp
- EXIF extraction: Camera data, GPS, timestamps using exifr library
- Support for JPEG, PNG, WebP, GIF, TIFF, BMP, SVG, HEIC, AVIF formats
- MimeTypeDetector: Unified MIME type detection with magic byte support
- FormatDetector: Enhanced with image format detection via MIME + magic bytes
**Architecture Fixes:**
- Fixed brain.import() augmentation pipeline integration (src/brainy.ts:3140-3154)
- Added parameter spreading for ImportSource objects to enable augmentation access
- Fixed metadata propagation through ImportCoordinator to final results
- Added augmentation data check in ImportCoordinator.extract()
**Integration:**
- ImageHandler registered as built-in handler alongside CSV, Excel, PDF
- Images import as 'media' entities with 'image' subtype
- Full metadata preserved in knowledge graph entities
- Configuration options: enableImage, extractEXIF, imageDefaults
**Test Coverage:**
- 15 integration tests (image-import.test.ts) - 100% passing
- 27 unit tests (image-handler.test.ts) - 100% passing
- Format detection tests for all supported image types
- Error handling and resilience tests
**Breaking Changes:** None - backward compatible
Generated with Claude Code
Co-Authored-By: Claude <noreply@anthropic.com>
Extends the import progress callback system to provide real-time updates during
the relationship building phase, eliminating the 1-2 minute silent period for
large imports.
New Features:
- Progress callbacks now fire during relationship building (brain.relateMany)
- New 'phase' field distinguishes 'extraction' vs 'relationships' phases
- Chunk-based progress emission (<0.01% overhead for 573 relationships)
- Works across all import paths: ImportCoordinator, SmartImportOrchestrator, UniversalImportAPI
API Enhancements:
- ImportProgress: Added 'phase' and 'current' fields
- SmartImportProgress: Added 'relationships' phase
- NeuralImportProgress: New interface for UniversalImportAPI
- Refactored to use brain.relateMany() for batch operations
Examples:
- NEW: examples/import-with-progress.ts - Complete demo with progress bars and ETA
- UPDATED: examples/complete-import-demo.ts - Shows both extraction and relationship phases
Performance:
- Minimal overhead: 6 callbacks for 573 relationships = 0.6ms / 5730ms = 0.01%
- Chunk size: 100 relationships per batch (configurable)
- Storage agnostic: Works with all adapters (FileSystem, S3, R2, GCS, Memory, OPFS, TypeAware)
Backward Compatible:
- All new fields are optional
- Existing code continues to work unchanged
- Zero breaking changes
This addresses the UX issue where users couldn't tell if imports were frozen
during the relationship building phase for large datasets.
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <noreply@anthropic.com>
- Updated all fs, path, crypto, os, url, util, events, http, https, net, child_process, stream, and zlib imports
- Changed both static imports and dynamic imports to use node: protocol
- This makes Brainy more bundler-friendly by explicitly marking Node.js built-ins
- Prevents bundlers from attempting to polyfill or bundle these modules
- Reduces bundle size for web applications using Brainy
- Improves tree-shaking and dead code elimination
Benefits for external bundlers:
- Clear distinction between Node.js built-ins and external dependencies
- No ambiguity about what needs polyfilling
- Smaller bundles for browser builds
- Better compatibility with modern bundlers (Webpack 5, Vite, Rollup, esbuild)
🤖 Generated with Claude Code
Co-Authored-By: Claude <noreply@anthropic.com>
