soulcraft/brainy
2
0
Fork 0
Code Issues 1 Pull requests Projects Releases 335 Packages Wiki Activity Actions
brainy/examples
History
David Snelling 7e1f37e99a feat: add real-time progress callbacks for relationship building phase 
Extends the import progress callback system to provide real-time updates during
the relationship building phase, eliminating the 1-2 minute silent period for
large imports.

New Features:
- Progress callbacks now fire during relationship building (brain.relateMany)
- New 'phase' field distinguishes 'extraction' vs 'relationships' phases
- Chunk-based progress emission (<0.01% overhead for 573 relationships)
- Works across all import paths: ImportCoordinator, SmartImportOrchestrator, UniversalImportAPI

API Enhancements:
- ImportProgress: Added 'phase' and 'current' fields
- SmartImportProgress: Added 'relationships' phase
- NeuralImportProgress: New interface for UniversalImportAPI
- Refactored to use brain.relateMany() for batch operations

Examples:
- NEW: examples/import-with-progress.ts - Complete demo with progress bars and ETA
- UPDATED: examples/complete-import-demo.ts - Shows both extraction and relationship phases

Performance:
- Minimal overhead: 6 callbacks for 573 relationships = 0.6ms / 5730ms = 0.01%
- Chunk size: 100 relationships per batch (configurable)
- Storage agnostic: Works with all adapters (FileSystem, S3, R2, GCS, Memory, OPFS, TypeAware)

Backward Compatible:
- All new fields are optional
- Existing code continues to work unchanged
- Zero breaking changes

This addresses the UX issue where users couldn't tell if imports were frozen
during the relationship building phase for large datasets.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-16 12:08:46 -07:00
..
tests feat: remove legacy ImportManager, standardize getStats() API 2025-10-09 11:40:31 -07:00
api-server-example.ts fix: update all imports and references from BrainyData to Brainy 2025-09-30 17:09:15 -07:00
augmentations-zero-config.ts fix: update all imports and references from BrainyData to Brainy 2025-09-30 17:09:15 -07:00
bluesky-distributed-setup.js feat: add distributed architecture with sharding and coordination 2025-09-22 15:45:35 -07:00
brainy-backup.ts feat: Brainy 3.0 - Production-ready Triple Intelligence database 2025-09-11 16:23:32 -07:00
complete-import-demo.ts feat: add real-time progress callbacks for relationship building phase 2025-10-16 12:08:46 -07:00
debug-vector-similarity.js feat: Phase 3 - Unified Semantic Type Inference (Nouns + Verbs) 2025-10-16 10:59:26 -07:00
demo.ts feat: Brainy 3.0 - Production-ready Triple Intelligence database 2025-09-11 16:23:32 -07:00
directory-import-with-caching.ts feat: add progress tracking, entity caching, and relationship confidence 2025-10-01 15:12:54 -07:00
hybrid-type-inference-demo.js feat: Phase 3 - Unified Semantic Type Inference (Nouns + Verbs) 2025-10-16 10:59:26 -07:00
import-excel-pdf-csv.ts feat: add intelligent import for CSV, Excel, and PDF files 2025-10-01 16:51:03 -07:00
import-with-progress.ts feat: add real-time progress callbacks for relationship building phase 2025-10-16 12:08:46 -07:00
monitor-cache-performance.ts feat: implement always-adaptive caching with getCacheStats monitoring 2025-10-10 14:09:30 -07:00
production-ready-demo.js feat: Phase 3 - Unified Semantic Type Inference (Nouns + Verbs) 2025-10-16 10:59:26 -07:00
quick-import-test.ts feat: add unified import system with auto-detection and dual storage 2025-10-08 16:55:30 -07:00
README.md feat: Brainy 3.0 - Production-ready Triple Intelligence database 2025-09-11 16:23:32 -07:00
smart-import-example.ts feat: add unified import system with auto-detection and dual storage 2025-10-08 16:55:30 -07:00
test-csv-performance.ts feat: extend batch processing and enhanced progress to CSV and PDF imports 2025-10-13 10:32:25 -07:00
test-deduplication.ts feat: add unified import system with auto-detection and dual storage 2025-10-08 16:55:30 -07:00
test-excel-import.ts feat: add unified import system with auto-detection and dual storage 2025-10-08 16:55:30 -07:00
test-excel-performance.ts feat: massive performance improvements for Excel imports with AI extraction 2025-10-13 10:05:58 -07:00
test-pdf-performance.ts feat: extend batch processing and enhanced progress to CSV and PDF imports 2025-10-13 10:32:25 -07:00
test-threshold-tuning.js feat: Phase 3 - Unified Semantic Type Inference (Nouns + Verbs) 2025-10-16 10:59:26 -07:00
unified-import-example.ts feat: add unified import system with auto-detection and dual storage 2025-10-08 16:55:30 -07:00

README.md

Brainy Examples

This directory contains example code and test scripts for Brainy.

Structure

  • demo.ts - Basic demonstration of Brainy's core features
  • tests/ - Various test scripts demonstrating different aspects of Brainy
    • Performance tests
    • Memory tests
    • Storage adapter tests
    • API functionality tests
    • CLI tests

Running Examples

Basic Demo

npm run build
node dist/examples/demo.js

Test Scripts

The scripts in tests/ are standalone Node.js scripts that can be run directly:

node examples/tests/test-simple.js
node examples/tests/test-core-functionality.js

Note

These are examples and test scripts for reference. For production use, see the main documentation in the project root.