soulcraft/brainy
2
0
Fork 0
Code Issues 1 Pull requests Projects Releases 335 Packages Wiki Activity Actions
brainy/package.json

206 lines
6.7 KiB
JSON
Raw Normal View History

Initial commit
2025-06-24 11:41:30 -07:00
{
"name": "@soulcraft/brainy",
0.54.4
2025-08-07 11:07:14 -07:00
"version": "0.54.4",
Initial commit
2025-06-24 11:41:30 -07:00
"description": "A vector graph database using HNSW indexing with Origin Private File System storage",
refactor: simplify build system and improve model loading flexibility - Remove Rollup bundling in favor of direct TypeScript compilation - Move from bundled models to dynamic model loading with configurable paths - Add Docker deployment examples and documentation - Implement robust model loader with fallback mechanisms - Update storage adapters for better cross-environment compatibility - Add comprehensive tests for model loading and package installation - Simplify package.json scripts and remove complex build configurations - Clean up deprecated demo files and old bundling scripts BREAKING CHANGE: Models are no longer bundled with the package. They are now loaded dynamically from CDN or custom paths.
2025-08-05 16:09:30 -07:00
"main": "dist/index.js",
"module": "dist/index.js",
"types": "dist/index.d.ts",
Initial commit
2025-06-24 11:41:30 -07:00
"type": "module",
**refactor(tests): consolidate and replace outdated environment test scripts** - Removed obsolete scripts: `test-all-environments.js`, `test-fallback-function.js`, `test-fallback-simple.js`, `test-fix.js`, `test-tensorflow-textencoder.js`, `test-unified-encoding.js`, and `test-worker-utils.js`. - Introduced `scripts/comprehensive-test.js` as a unified testing script covering all environments: Browser, Node.js, and CLI. - Added `examples/cli-wrapper-example.js` to demonstrate a proper CLI implementation with TensorFlow.js initialization. This refactor simplifies the testing structure by consolidating redundant scripts into a single comprehensive script while ensuring robust cross-environment coverage.
2025-07-14 11:12:51 -07:00
"sideEffects": [
**chore: streamline documentation, refine shims, and update dependencies** - **Documentation Updates**: - Simplified server functionality details in `README.md`, removing cloud-specific deployment sections and focusing on core features for broader usability. - **Shim Enhancements**: - Improved `util` shim in `rollup.config.js` to include `TextEncoder`/`TextDecoder` support and enhanced `types` checks (e.g., `isFloat32Array`, `isUint8Array`). - **Dependency Updates**: - Added new dev dependencies (`@vitest/ui`, `jsdom`, `happy-dom`). - Updated `package-lock.json` with additional dependency resolutions and metadata for better compatibility and maintainability. This commit aligns documentation with current project focus, enhances cross-platform support via refined shims, and ensures updated dependencies for development and testing environments.
2025-07-15 11:53:26 -07:00
"./dist/setup.js",
**refactor(tests): consolidate and replace outdated environment test scripts** - Removed obsolete scripts: `test-all-environments.js`, `test-fallback-function.js`, `test-fallback-simple.js`, `test-fix.js`, `test-tensorflow-textencoder.js`, `test-unified-encoding.js`, and `test-worker-utils.js`. - Introduced `scripts/comprehensive-test.js` as a unified testing script covering all environments: Browser, Node.js, and CLI. - Added `examples/cli-wrapper-example.js` to demonstrate a proper CLI implementation with TensorFlow.js initialization. This refactor simplifies the testing structure by consolidating redundant scripts into a single comprehensive script while ensuring robust cross-environment coverage.
2025-07-14 11:12:51 -07:00
"./dist/utils/textEncoding.js",
"./src/setup.ts",
"./src/utils/textEncoding.ts"
],
Initial commit
2025-06-24 11:41:30 -07:00
"exports": {
".": {
refactor: simplify build system and improve model loading flexibility - Remove Rollup bundling in favor of direct TypeScript compilation - Move from bundled models to dynamic model loading with configurable paths - Add Docker deployment examples and documentation - Implement robust model loader with fallback mechanisms - Update storage adapters for better cross-environment compatibility - Add comprehensive tests for model loading and package installation - Simplify package.json scripts and remove complex build configurations - Clean up deprecated demo files and old bundling scripts BREAKING CHANGE: Models are no longer bundled with the package. They are now loaded dynamically from CDN or custom paths.
2025-08-05 16:09:30 -07:00
"import": "./dist/index.js",
"types": "./dist/index.d.ts"
Initial commit
2025-06-24 11:41:30 -07:00
},
**refactor(tests): consolidate and replace outdated environment test scripts** - Removed obsolete scripts: `test-all-environments.js`, `test-fallback-function.js`, `test-fallback-simple.js`, `test-fix.js`, `test-tensorflow-textencoder.js`, `test-unified-encoding.js`, and `test-worker-utils.js`. - Introduced `scripts/comprehensive-test.js` as a unified testing script covering all environments: Browser, Node.js, and CLI. - Added `examples/cli-wrapper-example.js` to demonstrate a proper CLI implementation with TensorFlow.js initialization. This refactor simplifies the testing structure by consolidating redundant scripts into a single comprehensive script while ensuring robust cross-environment coverage.
2025-07-14 11:12:51 -07:00
"./setup": {
"import": "./dist/setup.js",
"types": "./dist/setup.d.ts"
},
Initial commit
2025-06-24 11:41:30 -07:00
"./types/graphTypes": {
"import": "./dist/types/graphTypes.js",
"types": "./dist/types/graphTypes.d.ts"
},
"./types/augmentations": {
"import": "./dist/types/augmentations.js",
"types": "./dist/types/augmentations.d.ts"
**feat(tests): add tests for TextEncoder, TensorFlow.js, and fallback mechanisms** - Introduced `test-fallback-function.js` and `test-fallback-simple.js` to validate `executeInThread` fallback functionality with both named and anonymous compute-intensive functions. - Added `test-tensorflow-textencoder.js` for TensorFlow.js and TextEncoder tests in a Node.js environment. - Created `test-tensorflow-textencoder.html` for browser-based TensorFlow.js and TextEncoder tests. - Implemented cross-environment test support in `cli-package/src/test-tensorflow-textencoder.ts` for CLI functionality. - Enhanced `src/utils/embedding.ts`, `textEncoding.ts`, and `brainy-wrapper.js` to include updated global `TextEncoder` and `TextDecoder` utilities for compatibility and worker improvements. - Standardized and expanded utility methods in `PlatformNode` for broader support, including `isFloat32Array` and `isTypedArray` checks. - Updated Node.js requirement to `>= 24.4.0` across documentation and configuration files for compatibility improvements. This update introduces comprehensive testing for fallback mechanisms, TensorFlow.js, and TextEncoder across multiple environments, ensuring robustness and compatibility.
2025-07-11 11:11:56 -07:00
},
"./utils/textEncoding": {
"import": "./dist/utils/textEncoding.js",
"types": "./dist/utils/textEncoding.d.ts"
},
"./dist/utils/textEncoding.js": {
"import": "./dist/utils/textEncoding.js",
"types": "./dist/utils/textEncoding.d.ts"
**refactor(tests): consolidate and replace outdated environment test scripts** - Removed obsolete scripts: `test-all-environments.js`, `test-fallback-function.js`, `test-fallback-simple.js`, `test-fix.js`, `test-tensorflow-textencoder.js`, `test-unified-encoding.js`, and `test-worker-utils.js`. - Introduced `scripts/comprehensive-test.js` as a unified testing script covering all environments: Browser, Node.js, and CLI. - Added `examples/cli-wrapper-example.js` to demonstrate a proper CLI implementation with TensorFlow.js initialization. This refactor simplifies the testing structure by consolidating redundant scripts into a single comprehensive script while ensuring robust cross-environment coverage.
2025-07-14 11:12:51 -07:00
},
"./dist/setup.js": {
"import": "./dist/setup.js",
"types": "./dist/setup.d.ts"
Initial commit
2025-06-24 11:41:30 -07:00
}
},
"engines": {
**feat(tests): add tests for TextEncoder, TensorFlow.js, and fallback mechanisms** - Introduced `test-fallback-function.js` and `test-fallback-simple.js` to validate `executeInThread` fallback functionality with both named and anonymous compute-intensive functions. - Added `test-tensorflow-textencoder.js` for TensorFlow.js and TextEncoder tests in a Node.js environment. - Created `test-tensorflow-textencoder.html` for browser-based TensorFlow.js and TextEncoder tests. - Implemented cross-environment test support in `cli-package/src/test-tensorflow-textencoder.ts` for CLI functionality. - Enhanced `src/utils/embedding.ts`, `textEncoding.ts`, and `brainy-wrapper.js` to include updated global `TextEncoder` and `TextDecoder` utilities for compatibility and worker improvements. - Standardized and expanded utility methods in `PlatformNode` for broader support, including `isFloat32Array` and `isTypedArray` checks. - Updated Node.js requirement to `>= 24.4.0` across documentation and configuration files for compatibility improvements. This update introduces comprehensive testing for fallback mechanisms, TensorFlow.js, and TextEncoder across multiple environments, ensuring robustness and compatibility.
2025-07-11 11:11:56 -07:00
"node": ">=24.4.0"
Initial commit
2025-06-24 11:41:30 -07:00
},
"scripts": {
**refactor(core): remove generate-version script and update prebuild/version workflows** - **Removal of `generate-version.js`**: - Deleted `scripts/generate-version.js` as it is no longer required for version handling. - Removed associated output files, including `src/utils/version.ts`. - **Prebuild and Version Process Updates**: - Updated `prebuild` and `version` scripts in `package.json` to reflect the new workflow: - Replaced `generate-version.js` with simplified echo commands for version updates and build steps. - Adjusted deployment scripts (`deploy:cli` and `deploy:web-service`) to align with the removal of the script. - **Documentation and Config Updates**: - Cleaned up `README.md` by removing unused version badge references. - Updated `cli-package/package.json` to specify a version range (`^0.15.0`) for `@soulcraft/brainy`. **Purpose**: This refactor simplifies the version handling process by removing outdated scripts, reducing maintenance overhead, and aligning workflows with project conventions. Improves clarity and consistency in both configuration and documentation.
2025-07-22 10:43:19 -07:00
"prebuild": "echo 'Prebuild step - no version generation needed'",
refactor: simplify build system and improve model loading flexibility - Remove Rollup bundling in favor of direct TypeScript compilation - Move from bundled models to dynamic model loading with configurable paths - Add Docker deployment examples and documentation - Implement robust model loader with fallback mechanisms - Update storage adapters for better cross-environment compatibility - Add comprehensive tests for model loading and package installation - Simplify package.json scripts and remove complex build configurations - Clean up deprecated demo files and old bundling scripts BREAKING CHANGE: Models are no longer bundled with the package. They are now loaded dynamically from CDN or custom paths.
2025-08-05 16:09:30 -07:00
"build": "tsc",
chore(release): 0.43.0 [skip ci]
2025-08-05 16:10:18 -07:00
"build:framework": "tsc",
refactor: simplify build system and improve model loading flexibility - Remove Rollup bundling in favor of direct TypeScript compilation - Move from bundled models to dynamic model loading with configurable paths - Add Docker deployment examples and documentation - Implement robust model loader with fallback mechanisms - Update storage adapters for better cross-environment compatibility - Add comprehensive tests for model loading and package installation - Simplify package.json scripts and remove complex build configurations - Clean up deprecated demo files and old bundling scripts BREAKING CHANGE: Models are no longer bundled with the package. They are now loaded dynamically from CDN or custom paths.
2025-08-05 16:09:30 -07:00
"start": "node dist/framework.js",
"demo": "npm run build && cd demo/brainy-angular-demo && npm run build && npm run serve",
**feat(cli, scripts): introduce CLI package and automated publishing process** - Added a new `@soulcraft/brainy-cli` package to provide a dedicated CLI interface for the Brainy database. - Implemented a CLI wrapper script (`cli-wrapper.js`) to manage global package execution and version handling. - Introduced `scripts/publish-cli.js` to automate synchronized publishing of the main package and CLI, ensuring version consistency. - Created documentation for CLI usage and publishing workflow (`publishing-cli.md`). - Updated `package.json` to include CLI-related build and deploy scripts. - Adjusted `README.md` to document the CLI package, usage instructions, and build separation. This feature introduces a standalone CLI package, improves deployment automation, and enhances documentation to align with the updated architecture.
2025-07-02 11:32:06 -07:00
"prepare": "npm run build",
**chore: streamline documentation, refine shims, and update dependencies** - **Documentation Updates**: - Simplified server functionality details in `README.md`, removing cloud-specific deployment sections and focusing on core features for broader usability. - **Shim Enhancements**: - Improved `util` shim in `rollup.config.js` to include `TextEncoder`/`TextDecoder` support and enhanced `types` checks (e.g., `isFloat32Array`, `isUint8Array`). - **Dependency Updates**: - Added new dev dependencies (`@vitest/ui`, `jsdom`, `happy-dom`). - Updated `package-lock.json` with additional dependency resolutions and metadata for better compatibility and maintainability. This commit aligns documentation with current project focus, enhances cross-platform support via refined shims, and ensures updated dependencies for development and testing environments.
2025-07-15 11:53:26 -07:00
"test": "vitest run",
"test:watch": "vitest",
"test:ui": "vitest --ui",
"test:node": "vitest run tests/environment.node.test.ts tests/core.test.ts tests/vector-operations.test.ts tests/tensorflow-patch.test.ts",
**chore: update dependencies in package-lock.json** - **Added Dependencies**: - Introduced `@vitest/coverage-v8` for enhanced test coverage reporting. - Added various dev dependencies such as `@ampproject/remapping`, `@babel/parser`, `@babel/types`, and `ast-v8-to-istanbul` to support improved source mapping and code coverage analysis. - Included modules such as `html-escaper`, `path-scurry`, and `istanbul-lib-coverage` to align with updated testing and utility requirements. - **Purpose**: - This update ensures compatibility with modern testing tools, facilitates advanced debugging, and supports enhanced test coverage capabilities. It also updates metadata for package resolutions.
2025-07-16 11:40:24 -07:00
"test:browser": "vitest run tests/environment.browser.test.ts --environment jsdom",
**chore: streamline documentation, refine shims, and update dependencies** - **Documentation Updates**: - Simplified server functionality details in `README.md`, removing cloud-specific deployment sections and focusing on core features for broader usability. - **Shim Enhancements**: - Improved `util` shim in `rollup.config.js` to include `TextEncoder`/`TextDecoder` support and enhanced `types` checks (e.g., `isFloat32Array`, `isUint8Array`). - **Dependency Updates**: - Added new dev dependencies (`@vitest/ui`, `jsdom`, `happy-dom`). - Updated `package-lock.json` with additional dependency resolutions and metadata for better compatibility and maintainability. This commit aligns documentation with current project focus, enhances cross-platform support via refined shims, and ensures updated dependencies for development and testing environments.
2025-07-15 11:53:26 -07:00
"test:core": "vitest run tests/core.test.ts",
"test:coverage": "vitest run --coverage",
**feat(core): enhance logging, storage options, and testing coverage** - **Core Improvements**: - Refactored logging functions into a unified `logger` method for consistent output across the library. - Enabled the `forceMemoryStorage` option in `BrainyData` initialization for improved storage flexibility in tests and specific use cases. - **TensorFlow.js and Environment Updates**: - Clarified the dependency structure in `README.md` to emphasize bundled dependencies and remove legacy peer dependency instructions. - Simplified and reformatted environment detection logic for better maintainability and readability. - **Testing Enhancements**: - Added `tests/package-size-limit.test.ts` to monitor and validate npm package size against defined thresholds. - Updated `tests/environment.node.test.ts` and core tests to leverage `forceMemoryStorage` for better test setup standardization. - Improved test isolation with expanded `globalThis` utility definitions and cleanup logic. - **Documentation**: - Added detailed best practices for debugging and organizing tests in `DEVELOPERS.md`. - Removed outdated installation hints from `package.json` and streamlined scripts by including `test:size` for package size validation. **Purpose**: These changes unify core logging mechanisms, expand configurability of storage options, and improve testing reliability and coverage. Documentation and clarity are enhanced to align with updated functionality and best practices.
2025-07-17 10:00:28 -07:00
"test:size": "vitest run tests/package-size-limit.test.ts",
**test(api): add integration tests for API endpoints and core functionality** - **Integration Tests**: - Introduced `api-integration.test.ts` to validate API functionality: - Verifies text insertion, vector embedding generation, and search operations. - Confirms HNSW index correctness for vector similarity search. - Ensures no dimensional mismatches in embeddings. - **Test Server**: - Added test server utilizing Express for endpoint simulation (`/insert` and `/search/text`). - **Dependencies**: - Introduced `express` and `node-fetch` as new dependencies for testing purposes. - **Vitest Fix**: - Updated `vitest.config.ts` to resolve the `process.memoryUsage` error by setting `logHeapUsage: false`. - **Package Updates**: - Modified `package-lock.json` to include newly added dependencies and updates. **Purpose**: Guarantees the stability of core API endpoints and vector-related functionality, ensuring reliable behavior for end-to-end scenarios.
2025-07-28 10:04:45 -07:00
"test:all": "npm run build && vitest run",
**docs: remove outdated statistics-related documentation and add standards** - **Removed Files**: - Deleted outdated statistics documentation files (`statistics.md`, `statistics-flush-solution.md`, `statistics-summary.md`) to clean up the repository and avoid confusion. - **Added Standards**: - Introduced `DOCUMENTATION_STANDARDS.md` to outline naming conventions and troubleshooting practices for more consistent and maintainable project documentation. - **Tests**: - Added a new test file `edge-cases.test.ts` to verify handling of edge cases, ensuring robust behavior against boundary values and invalid inputs. **Purpose**: Cleans up deprecated documentation while introducing concrete standards for maintaining and updating documentation. Enhances test coverage for unusual or boundary inputs, improving overall system resilience.
2025-07-28 16:00:05 -07:00
"test:report:json": "vitest run --reporter json",
"test:error-handling": "vitest run tests/error-handling.test.ts",
"test:edge-cases": "vitest run tests/edge-cases.test.ts",
"test:storage": "vitest run tests/storage-adapter-coverage.test.ts",
"test:environments": "vitest run tests/multi-environment.test.ts",
"test:specialized": "vitest run tests/specialized-scenarios.test.ts",
"test:performance": "vitest run tests/performance.test.ts",
refactor: simplify build system and improve model loading flexibility - Remove Rollup bundling in favor of direct TypeScript compilation - Move from bundled models to dynamic model loading with configurable paths - Add Docker deployment examples and documentation - Implement robust model loader with fallback mechanisms - Update storage adapters for better cross-environment compatibility - Add comprehensive tests for model loading and package installation - Simplify package.json scripts and remove complex build configurations - Clean up deprecated demo files and old bundling scripts BREAKING CHANGE: Models are no longer bundled with the package. They are now loaded dynamically from CDN or custom paths.
2025-08-05 16:09:30 -07:00
"test:install": "vitest run tests/package-install.test.ts",
"test:docker": "vitest run tests/custom-models-path.test.ts",
"test:extraction": "node tests/auto-extraction.test.js",
"extract-models": "node scripts/extract-models.js",
**chore(scripts): prefix internal scripts with underscore for consistency** - Updated `package.json` in `web-service-package`, `cli-package`, and the root project to prefix internal NPM scripts with an underscore (`_`), such as `_version`, `_deploy`, `_dry-run`, etc. - Adjusted all relevant build, versioning, deployment, and test scripts to follow this convention. - Updated `.gitignore` to include `/brainy-models-package/node_modules/` for effective exclusion. **Purpose**: Standardize the naming of internal scripts to better differentiate them from user-facing commands and maintain consistency across packages.
2025-08-01 16:22:18 -07:00
"test:comprehensive": "npm run test:error-handling && npm run test:edge-cases && npm run test:storage && npm run test:environments && npm run test:specialized",
**feat(docs): add comprehensive architecture documentation for Brainy** - **Documentation Additions**: - Created `brainy_architecture_diagram.md` to detail Brainy's architecture using diagrams and structured descriptions: - Added overviews of the system, core architecture, and augmentation pipeline. - Defined data models, graph structures, storage architecture, and performance optimizations. - Explained vector search engine design, HNSW index structure, and usage flow examples. - Developed `brainy_architecture_visual.md` to complement the architecture with visual aids in Mermaid.js: - Provided detailed flowcharts, mind maps, and sequence diagrams for system components and data flow. - **Purpose**: - Provide in-depth technical insights into Brainy's architecture for developers and stakeholders. - Enhance understanding of the system's core design principles with easy-to-follow diagrams and examples.
2025-08-02 16:05:48 -07:00
"_generate-pdf": "node dev/scripts/generate-architecture-pdf.js",
**chore(scripts): prefix internal scripts with underscore for consistency** - Updated `package.json` in `web-service-package`, `cli-package`, and the root project to prefix internal NPM scripts with an underscore (`_`), such as `_version`, `_deploy`, `_dry-run`, etc. - Adjusted all relevant build, versioning, deployment, and test scripts to follow this convention. - Updated `.gitignore` to include `/brainy-models-package/node_modules/` for effective exclusion. **Purpose**: Standardize the naming of internal scripts to better differentiate them from user-facing commands and maintain consistency across packages.
2025-08-01 16:22:18 -07:00
"_release": "standard-version",
"_release:patch": "standard-version --release-as patch",
"_release:minor": "standard-version --release-as minor",
"_release:major": "standard-version --release-as major",
"_release:dry-run": "standard-version --dry-run",
"_github-release": "node scripts/create-github-release.js",
"_changelog:check": "echo 'Changelog is now automatically generated from commit messages'",
"_lint": "eslint --ext .ts,.js src/",
"_lint:fix": "eslint --ext .ts,.js src/ --fix",
"_format": "prettier --write \"src/**/*.{ts,js}\"",
"_check:format": "prettier --check \"src/**/*.{ts,js}\"",
"_check:style": "node scripts/check-code-style.js",
"_deploy": "npm run build && npm publish",
"_workflow": "node scripts/release-workflow.js",
"_workflow:patch": "node scripts/release-workflow.js patch",
"_workflow:minor": "node scripts/release-workflow.js minor",
"_workflow:major": "node scripts/release-workflow.js major",
"_workflow:dry-run": "npm run build && npm test && npm run _release:dry-run",
feat\!: migrate from TensorFlow.js to Transformers.js with ONNX Runtime BREAKING CHANGE: Complete migration from TensorFlow.js to Transformers.js for embedding generation This is a major architectural change that replaces TensorFlow.js (USE model) with Transformers.js (all-MiniLM-L6-v2) for significantly improved performance and reduced complexity. Key Changes: - Replace TensorFlow.js Universal Sentence Encoder with Transformers.js all-MiniLM-L6-v2 - Reduce model size from 525MB to 87MB (83% reduction) - Reduce embedding dimensions from 512 to 384 (faster distance calculations) - Remove TensorFlow.js Float32Array patching (caused ONNX conflicts) - Implement smart bundled model detection for offline operation - Add explicit model download script for Docker deployments - Remove complex environment variables in favor of simple configuration - Update all distance functions to use optimized pure JavaScript - Remove TensorFlow-specific utilities and type definitions Performance Improvements: - Model loading: 5x faster (87MB vs 525MB) - Memory usage: 75% reduction (~200-400MB vs ~1.5GB) - Distance calculations: Faster pure JS vs GPU overhead for small vectors - Cold start performance: Significantly improved Files Changed: - Updated package.json: New dependencies, simplified scripts - Rewrote src/utils/embedding.ts: Complete Transformers.js implementation - Updated src/utils/distance.ts: Optimized JavaScript distance functions - Simplified src/setup.ts: Removed TensorFlow-specific patching - Simplified src/utils/textEncoding.ts: Only Node.js TextEncoder/Decoder patches - Deleted src/utils/robustModelLoader.ts: TensorFlow-specific loader - Deleted src/types/tensorflowTypes.ts: TensorFlow type definitions - Added scripts/download-models.cjs: Docker-compatible model downloader - Added comprehensive documentation: README.md, OFFLINE_MODELS.md, analysis docs Testing: - All 19 tests passing - Removed test mocking in favor of real implementation testing - Updated test environment for Transformers.js compatibility - Performance tests validate improved efficiency This migration resolves production issues with Docker egress limitations and provides a more robust, performant foundation for vector operations.
2025-08-05 19:29:59 -07:00
"_dry-run": "npm pack --dry-run",
"download-models": "node scripts/download-models.cjs"
Initial commit
2025-06-24 11:41:30 -07:00
},
"keywords": [
"vector-database",
"hnsw",
"opfs",
"origin-private-file-system",
"embeddings",
"graph-database",
"streaming-data"
],
"author": "David Snelling (david@soulcraft.com)",
"license": "MIT",
"private": false,
"publishConfig": {
"access": "public"
},
"homepage": "https://github.com/soulcraft-research/brainy",
"bugs": {
"url": "https://github.com/soulcraft-research/brainy/issues"
},
"repository": {
"type": "git",
**chore(version): bump version to 0.9.30 and update package references** - Updated version to `0.9.30` in `package.json` and `cli-package/package.json`. - Synchronized `@soulcraft/brainy` dependency version to `0.9.30` in the CLI package for consistency. - Updated repository URL format to use `git+https` for both `package.json` files. This update ensures consistent versioning across the project, maintains alignment between main and CLI package dependencies, and standardizes repository URL formatting.
2025-07-02 16:27:53 -07:00
"url": "git+https://github.com/soulcraft-research/brainy.git"
Initial commit
2025-06-24 11:41:30 -07:00
},
"files": [
fix: include all JavaScript modules in npm package - Fixed missing setup.js issue by updating files field in package.json - Changed from selective file inclusion to including all JS/TS files - Excluded large framework bundles to keep package size reasonable - Updated package size test thresholds to match new structure - Package now correctly includes all necessary modules for installation
2025-08-05 16:20:36 -07:00
"dist/**/*.js",
"dist/**/*.js.map",
Initial commit
2025-06-24 11:41:30 -07:00
"dist/**/*.d.ts",
fix: include all JavaScript modules in npm package - Fixed missing setup.js issue by updating files field in package.json - Changed from selective file inclusion to including all JS/TS files - Excluded large framework bundles to keep package size reasonable - Updated package size test thresholds to match new structure - Package now correctly includes all necessary modules for installation
2025-08-05 16:20:36 -07:00
"dist/**/*.d.ts.map",
"!dist/framework.js",
"!dist/framework.js.map",
"!dist/framework.min.js",
"!dist/framework.min.js.map",
Initial commit
2025-06-24 11:41:30 -07:00
"LICENSE",
"README.md",
feat\!: migrate from TensorFlow.js to Transformers.js with ONNX Runtime BREAKING CHANGE: Complete migration from TensorFlow.js to Transformers.js for embedding generation This is a major architectural change that replaces TensorFlow.js (USE model) with Transformers.js (all-MiniLM-L6-v2) for significantly improved performance and reduced complexity. Key Changes: - Replace TensorFlow.js Universal Sentence Encoder with Transformers.js all-MiniLM-L6-v2 - Reduce model size from 525MB to 87MB (83% reduction) - Reduce embedding dimensions from 512 to 384 (faster distance calculations) - Remove TensorFlow.js Float32Array patching (caused ONNX conflicts) - Implement smart bundled model detection for offline operation - Add explicit model download script for Docker deployments - Remove complex environment variables in favor of simple configuration - Update all distance functions to use optimized pure JavaScript - Remove TensorFlow-specific utilities and type definitions Performance Improvements: - Model loading: 5x faster (87MB vs 525MB) - Memory usage: 75% reduction (~200-400MB vs ~1.5GB) - Distance calculations: Faster pure JS vs GPU overhead for small vectors - Cold start performance: Significantly improved Files Changed: - Updated package.json: New dependencies, simplified scripts - Rewrote src/utils/embedding.ts: Complete Transformers.js implementation - Updated src/utils/distance.ts: Optimized JavaScript distance functions - Simplified src/setup.ts: Removed TensorFlow-specific patching - Simplified src/utils/textEncoding.ts: Only Node.js TextEncoder/Decoder patches - Deleted src/utils/robustModelLoader.ts: TensorFlow-specific loader - Deleted src/types/tensorflowTypes.ts: TensorFlow type definitions - Added scripts/download-models.cjs: Docker-compatible model downloader - Added comprehensive documentation: README.md, OFFLINE_MODELS.md, analysis docs Testing: - All 19 tests passing - Removed test mocking in favor of real implementation testing - Updated test environment for Transformers.js compatibility - Performance tests validate improved efficiency This migration resolves production issues with Docker egress limitations and provides a more robust, performant foundation for vector operations.
2025-08-05 19:29:59 -07:00
"brainy.png",
"scripts/download-models.cjs",
"OFFLINE_MODELS.md"
Initial commit
2025-06-24 11:41:30 -07:00
],
"devDependencies": {
**test(api): add integration tests for API endpoints and core functionality** - **Integration Tests**: - Introduced `api-integration.test.ts` to validate API functionality: - Verifies text insertion, vector embedding generation, and search operations. - Confirms HNSW index correctness for vector similarity search. - Ensures no dimensional mismatches in embeddings. - **Test Server**: - Added test server utilizing Express for endpoint simulation (`/insert` and `/search/text`). - **Dependencies**: - Introduced `express` and `node-fetch` as new dependencies for testing purposes. - **Vitest Fix**: - Updated `vitest.config.ts` to resolve the `process.memoryUsage` error by setting `logHeapUsage: false`. - **Package Updates**: - Modified `package-lock.json` to include newly added dependencies and updates. **Purpose**: Guarantees the stability of core API endpoints and vector-related functionality, ensuring reliable behavior for end-to-end scenarios.
2025-07-28 10:04:45 -07:00
"@types/express": "^5.0.3",
**chore: streamline documentation, refine shims, and update dependencies** - **Documentation Updates**: - Simplified server functionality details in `README.md`, removing cloud-specific deployment sections and focusing on core features for broader usability. - **Shim Enhancements**: - Improved `util` shim in `rollup.config.js` to include `TextEncoder`/`TextDecoder` support and enhanced `types` checks (e.g., `isFloat32Array`, `isUint8Array`). - **Dependency Updates**: - Added new dev dependencies (`@vitest/ui`, `jsdom`, `happy-dom`). - Updated `package-lock.json` with additional dependency resolutions and metadata for better compatibility and maintainability. This commit aligns documentation with current project focus, enhances cross-platform support via refined shims, and ensures updated dependencies for development and testing environments.
2025-07-15 11:53:26 -07:00
"@types/jsdom": "^21.1.7",
**chore(deps): update dependencies and Node.js version requirements** - Updated Node.js version requirement to `>=24.3.0` in `README.md` and `package-lock.json`. - Upgraded `TypeScript` to version `5.4.5` and synced references. - Updated multiple dependencies, including: - `@aws-sdk/client-s3` to `^3.540.0`. - `uuid` to `^9.0.1`. - Development tools such as `eslint` to `^8.57.0`, `typescript-eslint` plugins to `^7.4.0`, and more. - Refreshed transitive dependencies with up-to-date versions for consistency and performance. This update ensures compatibility with the latest Node.js features, aligns TypeScript references, and keeps the project dependencies up-to-date for improved stability and functionality.
2025-07-04 12:19:48 -07:00
"@types/node": "^20.11.30",
Initial commit
2025-06-24 11:41:30 -07:00
"@types/uuid": "^10.0.0",
feat: add GPU acceleration for embeddings with smart device auto-detection Add comprehensive GPU support for embedding generation while maintaining optimized CPU processing for distance calculations: - Add device option to TransformerEmbeddingOptions (auto, cpu, webgpu, cuda, gpu) - Implement smart auto-detection of best available GPU (WebGPU for browsers, CUDA for Node.js) - Add automatic CPU fallback if GPU initialization fails - Fix misleading GPU acceleration claims in distance functions and HNSW search - Update documentation to accurately reflect GPU usage (embeddings only) - Add comprehensive example demonstrating GPU acceleration usage - Maintain full backward compatibility with existing code Performance improvements: 3-5x faster embedding generation when GPU is available, while keeping faster CPU processing for 384-dim vector distance calculations.
2025-08-05 20:00:04 -07:00
"@typescript-eslint/eslint-plugin": "^8.0.0",
"@typescript-eslint/parser": "^8.0.0",
**test(api): add integration tests for API endpoints and core functionality** - **Integration Tests**: - Introduced `api-integration.test.ts` to validate API functionality: - Verifies text insertion, vector embedding generation, and search operations. - Confirms HNSW index correctness for vector similarity search. - Ensures no dimensional mismatches in embeddings. - **Test Server**: - Added test server utilizing Express for endpoint simulation (`/insert` and `/search/text`). - **Dependencies**: - Introduced `express` and `node-fetch` as new dependencies for testing purposes. - **Vitest Fix**: - Updated `vitest.config.ts` to resolve the `process.memoryUsage` error by setting `logHeapUsage: false`. - **Package Updates**: - Modified `package-lock.json` to include newly added dependencies and updates. **Purpose**: Guarantees the stability of core API endpoints and vector-related functionality, ensuring reliable behavior for end-to-end scenarios.
2025-07-28 10:04:45 -07:00
"@vitest/coverage-v8": "^3.2.4",
**chore: streamline documentation, refine shims, and update dependencies** - **Documentation Updates**: - Simplified server functionality details in `README.md`, removing cloud-specific deployment sections and focusing on core features for broader usability. - **Shim Enhancements**: - Improved `util` shim in `rollup.config.js` to include `TextEncoder`/`TextDecoder` support and enhanced `types` checks (e.g., `isFloat32Array`, `isUint8Array`). - **Dependency Updates**: - Added new dev dependencies (`@vitest/ui`, `jsdom`, `happy-dom`). - Updated `package-lock.json` with additional dependency resolutions and metadata for better compatibility and maintainability. This commit aligns documentation with current project focus, enhances cross-platform support via refined shims, and ensures updated dependencies for development and testing environments.
2025-07-15 11:53:26 -07:00
"@vitest/ui": "^3.2.4",
feat: add GPU acceleration for embeddings with smart device auto-detection Add comprehensive GPU support for embedding generation while maintaining optimized CPU processing for distance calculations: - Add device option to TransformerEmbeddingOptions (auto, cpu, webgpu, cuda, gpu) - Implement smart auto-detection of best available GPU (WebGPU for browsers, CUDA for Node.js) - Add automatic CPU fallback if GPU initialization fails - Fix misleading GPU acceleration claims in distance functions and HNSW search - Update documentation to accurately reflect GPU usage (embeddings only) - Add comprehensive example demonstrating GPU acceleration usage - Maintain full backward compatibility with existing code Performance improvements: 3-5x faster embedding generation when GPU is available, while keeping faster CPU processing for 384-dim vector distance calculations.
2025-08-05 20:00:04 -07:00
"eslint": "^9.0.0",
**test(api): add integration tests for API endpoints and core functionality** - **Integration Tests**: - Introduced `api-integration.test.ts` to validate API functionality: - Verifies text insertion, vector embedding generation, and search operations. - Confirms HNSW index correctness for vector similarity search. - Ensures no dimensional mismatches in embeddings. - **Test Server**: - Added test server utilizing Express for endpoint simulation (`/insert` and `/search/text`). - **Dependencies**: - Introduced `express` and `node-fetch` as new dependencies for testing purposes. - **Vitest Fix**: - Updated `vitest.config.ts` to resolve the `process.memoryUsage` error by setting `logHeapUsage: false`. - **Package Updates**: - Modified `package-lock.json` to include newly added dependencies and updates. **Purpose**: Guarantees the stability of core API endpoints and vector-related functionality, ensuring reliable behavior for end-to-end scenarios.
2025-07-28 10:04:45 -07:00
"express": "^5.1.0",
**chore: streamline documentation, refine shims, and update dependencies** - **Documentation Updates**: - Simplified server functionality details in `README.md`, removing cloud-specific deployment sections and focusing on core features for broader usability. - **Shim Enhancements**: - Improved `util` shim in `rollup.config.js` to include `TextEncoder`/`TextDecoder` support and enhanced `types` checks (e.g., `isFloat32Array`, `isUint8Array`). - **Dependency Updates**: - Added new dev dependencies (`@vitest/ui`, `jsdom`, `happy-dom`). - Updated `package-lock.json` with additional dependency resolutions and metadata for better compatibility and maintainability. This commit aligns documentation with current project focus, enhances cross-platform support via refined shims, and ensures updated dependencies for development and testing environments.
2025-07-15 11:53:26 -07:00
"happy-dom": "^18.0.1",
"jsdom": "^26.1.0",
**test(api): add integration tests for API endpoints and core functionality** - **Integration Tests**: - Introduced `api-integration.test.ts` to validate API functionality: - Verifies text insertion, vector embedding generation, and search operations. - Confirms HNSW index correctness for vector similarity search. - Ensures no dimensional mismatches in embeddings. - **Test Server**: - Added test server utilizing Express for endpoint simulation (`/insert` and `/search/text`). - **Dependencies**: - Introduced `express` and `node-fetch` as new dependencies for testing purposes. - **Vitest Fix**: - Updated `vitest.config.ts` to resolve the `process.memoryUsage` error by setting `logHeapUsage: false`. - **Package Updates**: - Modified `package-lock.json` to include newly added dependencies and updates. **Purpose**: Guarantees the stability of core API endpoints and vector-related functionality, ensuring reliable behavior for end-to-end scenarios.
2025-07-28 10:04:45 -07:00
"node-fetch": "^3.3.2",
**feat(docs): add comprehensive architecture documentation for Brainy** - **Documentation Additions**: - Created `brainy_architecture_diagram.md` to detail Brainy's architecture using diagrams and structured descriptions: - Added overviews of the system, core architecture, and augmentation pipeline. - Defined data models, graph structures, storage architecture, and performance optimizations. - Explained vector search engine design, HNSW index structure, and usage flow examples. - Developed `brainy_architecture_visual.md` to complement the architecture with visual aids in Mermaid.js: - Provided detailed flowcharts, mind maps, and sequence diagrams for system components and data flow. - **Purpose**: - Provide in-depth technical insights into Brainy's architecture for developers and stakeholders. - Enhance understanding of the system's core design principles with easy-to-follow diagrams and examples.
2025-08-02 16:05:48 -07:00
"puppeteer": "^22.15.0",
chore(versioning): switch to standard-version for automated changelog generation This change implements standard-version for versioning and changelog management: - Adds standard-version as a dev dependency - Updates package.json scripts to use standard-version - Creates .versionrc.json configuration file - Updates CHANGELOG.md with instructions for conventional commits - Removes obsolete manual changelog update script
2025-07-31 13:15:04 -07:00
"standard-version": "^9.5.0",
**chore(deps): update dependencies and Node.js version requirements** - Updated Node.js version requirement to `>=24.3.0` in `README.md` and `package-lock.json`. - Upgraded `TypeScript` to version `5.4.5` and synced references. - Updated multiple dependencies, including: - `@aws-sdk/client-s3` to `^3.540.0`. - `uuid` to `^9.0.1`. - Development tools such as `eslint` to `^8.57.0`, `typescript-eslint` plugins to `^7.4.0`, and more. - Refreshed transitive dependencies with up-to-date versions for consistency and performance. This update ensures compatibility with the latest Node.js features, aligns TypeScript references, and keeps the project dependencies up-to-date for improved stability and functionality.
2025-07-04 12:19:48 -07:00
"tslib": "^2.6.2",
**chore: streamline documentation, refine shims, and update dependencies** - **Documentation Updates**: - Simplified server functionality details in `README.md`, removing cloud-specific deployment sections and focusing on core features for broader usability. - **Shim Enhancements**: - Improved `util` shim in `rollup.config.js` to include `TextEncoder`/`TextDecoder` support and enhanced `types` checks (e.g., `isFloat32Array`, `isUint8Array`). - **Dependency Updates**: - Added new dev dependencies (`@vitest/ui`, `jsdom`, `happy-dom`). - Updated `package-lock.json` with additional dependency resolutions and metadata for better compatibility and maintainability. This commit aligns documentation with current project focus, enhances cross-platform support via refined shims, and ensures updated dependencies for development and testing environments.
2025-07-15 11:53:26 -07:00
"typescript": "^5.4.5",
**test(api): add integration tests for API endpoints and core functionality** - **Integration Tests**: - Introduced `api-integration.test.ts` to validate API functionality: - Verifies text insertion, vector embedding generation, and search operations. - Confirms HNSW index correctness for vector similarity search. - Ensures no dimensional mismatches in embeddings. - **Test Server**: - Added test server utilizing Express for endpoint simulation (`/insert` and `/search/text`). - **Dependencies**: - Introduced `express` and `node-fetch` as new dependencies for testing purposes. - **Vitest Fix**: - Updated `vitest.config.ts` to resolve the `process.memoryUsage` error by setting `logHeapUsage: false`. - **Package Updates**: - Modified `package-lock.json` to include newly added dependencies and updates. **Purpose**: Guarantees the stability of core API endpoints and vector-related functionality, ensuring reliable behavior for end-to-end scenarios.
2025-07-28 10:04:45 -07:00
"vitest": "^3.2.4"
Initial commit
2025-06-24 11:41:30 -07:00
},
"dependencies": {
**chore(deps): update dependencies and Node.js version requirements** - Updated Node.js version requirement to `>=24.3.0` in `README.md` and `package-lock.json`. - Upgraded `TypeScript` to version `5.4.5` and synced references. - Updated multiple dependencies, including: - `@aws-sdk/client-s3` to `^3.540.0`. - `uuid` to `^9.0.1`. - Development tools such as `eslint` to `^8.57.0`, `typescript-eslint` plugins to `^7.4.0`, and more. - Refreshed transitive dependencies with up-to-date versions for consistency and performance. This update ensures compatibility with the latest Node.js features, aligns TypeScript references, and keeps the project dependencies up-to-date for improved stability and functionality.
2025-07-04 12:19:48 -07:00
"@aws-sdk/client-s3": "^3.540.0",
feat\!: migrate from TensorFlow.js to Transformers.js with ONNX Runtime BREAKING CHANGE: Complete migration from TensorFlow.js to Transformers.js for embedding generation This is a major architectural change that replaces TensorFlow.js (USE model) with Transformers.js (all-MiniLM-L6-v2) for significantly improved performance and reduced complexity. Key Changes: - Replace TensorFlow.js Universal Sentence Encoder with Transformers.js all-MiniLM-L6-v2 - Reduce model size from 525MB to 87MB (83% reduction) - Reduce embedding dimensions from 512 to 384 (faster distance calculations) - Remove TensorFlow.js Float32Array patching (caused ONNX conflicts) - Implement smart bundled model detection for offline operation - Add explicit model download script for Docker deployments - Remove complex environment variables in favor of simple configuration - Update all distance functions to use optimized pure JavaScript - Remove TensorFlow-specific utilities and type definitions Performance Improvements: - Model loading: 5x faster (87MB vs 525MB) - Memory usage: 75% reduction (~200-400MB vs ~1.5GB) - Distance calculations: Faster pure JS vs GPU overhead for small vectors - Cold start performance: Significantly improved Files Changed: - Updated package.json: New dependencies, simplified scripts - Rewrote src/utils/embedding.ts: Complete Transformers.js implementation - Updated src/utils/distance.ts: Optimized JavaScript distance functions - Simplified src/setup.ts: Removed TensorFlow-specific patching - Simplified src/utils/textEncoding.ts: Only Node.js TextEncoder/Decoder patches - Deleted src/utils/robustModelLoader.ts: TensorFlow-specific loader - Deleted src/types/tensorflowTypes.ts: TensorFlow type definitions - Added scripts/download-models.cjs: Docker-compatible model downloader - Added comprehensive documentation: README.md, OFFLINE_MODELS.md, analysis docs Testing: - All 19 tests passing - Removed test mocking in favor of real implementation testing - Updated test environment for Transformers.js compatibility - Performance tests validate improved efficiency This migration resolves production issues with Docker egress limitations and provides a more robust, performant foundation for vector operations.
2025-08-05 19:29:59 -07:00
"@huggingface/transformers": "^3.1.0",
feat: add automatic high-volume handling for S3 storage adapter - Configure AWS SDK with 500 max sockets (up from default 50) - Add intelligent backpressure with pending operation tracking - Implement dynamic batch sizing based on memory pressure - Auto-reduce operations when heap usage exceeds 80% - Gradually recover throughput when system stabilizes - Track and respond to consecutive error patterns - Fix S3 mock to not add ID to metadata objects - Add backpressure to metadata save operations - All changes are transparent - no configuration required
2025-08-07 06:09:00 -07:00
"@smithy/node-http-handler": "^4.1.1",
Initial commit
2025-06-24 11:41:30 -07:00
"buffer": "^6.0.3",
**docs: remove outdated statistics-related documentation and add standards** - **Removed Files**: - Deleted outdated statistics documentation files (`statistics.md`, `statistics-flush-solution.md`, `statistics-summary.md`) to clean up the repository and avoid confusion. - **Added Standards**: - Introduced `DOCUMENTATION_STANDARDS.md` to outline naming conventions and troubleshooting practices for more consistent and maintainable project documentation. - **Tests**: - Added a new test file `edge-cases.test.ts` to verify handling of edge cases, ensuring robust behavior against boundary values and invalid inputs. **Purpose**: Cleans up deprecated documentation while introducing concrete standards for maintaining and updating documentation. Enhances test coverage for unusual or boundary inputs, improving overall system resilience.
2025-07-28 16:00:05 -07:00
"dotenv": "^16.4.5",
**chore(deps): update dependencies and Node.js version requirements** - Updated Node.js version requirement to `>=24.3.0` in `README.md` and `package-lock.json`. - Upgraded `TypeScript` to version `5.4.5` and synced references. - Updated multiple dependencies, including: - `@aws-sdk/client-s3` to `^3.540.0`. - `uuid` to `^9.0.1`. - Development tools such as `eslint` to `^8.57.0`, `typescript-eslint` plugins to `^7.4.0`, and more. - Refreshed transitive dependencies with up-to-date versions for consistency and performance. This update ensures compatibility with the latest Node.js features, aligns TypeScript references, and keeps the project dependencies up-to-date for improved stability and functionality.
2025-07-04 12:19:48 -07:00
"uuid": "^9.0.1"
Initial commit
2025-06-24 11:41:30 -07:00
},
"prettier": {
"arrowParens": "always",
"bracketSameLine": true,
"bracketSpacing": true,
"htmlWhitespaceSensitivity": "css",
"printWidth": 80,
"proseWrap": "preserve",
"semi": false,
"singleQuote": true,
"tabWidth": 2,
"trailingComma": "none",
"useTabs": false
},
"eslintConfig": {
"root": true,
"extends": [
"eslint:recommended",
"plugin:@typescript-eslint/recommended"
],
"parser": "@typescript-eslint/parser",
"plugins": [
"@typescript-eslint"
],
"rules": {
"@typescript-eslint/no-explicit-any": "off",
"no-unused-vars": "off",
"@typescript-eslint/no-unused-vars": [
"warn",
{
"args": "after-used",
"argsIgnorePattern": "^_"
}
],
"semi": "off",
"@typescript-eslint/semi": [
"error",
"never"
],
"no-extra-semi": "off"
}
}
}
Reference in a new issue Copy permalink