brainy/src/importers
David Snelling bb46da2ee7 feat: extend batch processing and enhanced progress to CSV and PDF imports
Applies the same performance optimizations from v3.38.0 Excel improvements
to CSV and PDF importers:

- CSV: Batch processing with 10 rows per chunk
- PDF: Batch processing with 5 sections per chunk
- Both: Parallel entity + concept extraction
- Both: Enhanced progress reporting with throughput and ETA
- Performance tests for both formats

Performance results:
- CSV: 9,091 rows/sec with 93.8% cache hit rate
- PDF: 313 sections/sec with 90.2% cache hit rate

All formats now have consistent batch processing architecture
and real-time progress feedback.
2025-10-13 10:32:25 -07:00
..
index.ts feat: add unified import system with auto-detection and dual storage 2025-10-08 16:55:30 -07:00
SmartCSVImporter.ts feat: extend batch processing and enhanced progress to CSV and PDF imports 2025-10-13 10:32:25 -07:00
SmartExcelImporter.ts feat: massive performance improvements for Excel imports with AI extraction 2025-10-13 10:05:58 -07:00
SmartImportOrchestrator.ts feat: add unified import system with auto-detection and dual storage 2025-10-08 16:55:30 -07:00
SmartJSONImporter.ts feat: add unified import system with auto-detection and dual storage 2025-10-08 16:55:30 -07:00
SmartMarkdownImporter.ts feat: add unified import system with auto-detection and dual storage 2025-10-08 16:55:30 -07:00
SmartPDFImporter.ts feat: extend batch processing and enhanced progress to CSV and PDF imports 2025-10-13 10:32:25 -07:00
VFSStructureGenerator.ts feat: add unified import system with auto-detection and dual storage 2025-10-08 16:55:30 -07:00