Commit graph

4 commits

Author SHA1 Message Date
c474f3692a fix: improve NoSuchKey error handling in S3 mock 2025-08-09 14:36:54 -07:00
bb09706d96 feat: add automatic high-volume handling for S3 storage adapter
- Configure AWS SDK with 500 max sockets (up from default 50)
- Add intelligent backpressure with pending operation tracking
- Implement dynamic batch sizing based on memory pressure
- Auto-reduce operations when heap usage exceeds 80%
- Gradually recover throughput when system stabilizes
- Track and respond to consecutive error patterns
- Fix S3 mock to not add ID to metadata objects
- Add backpressure to metadata save operations
- All changes are transparent - no configuration required
2025-08-07 06:11:45 -07:00
3d46dea814 feat: implement pagination methods for OPFSStorage adapter
- Add getNounsWithPagination and getVerbsWithPagination methods
- Update mock to provide async iterators for entries/values/keys
- Fix compatibility with BaseStorage pagination requirements
- Resolve test failures related to getAllNouns/getAllVerbs deprecation
2025-08-06 15:00:34 -07:00
e3eebaf476 feat(tests): add robust mock implementations and expand test coverage for S3 and OPFS storage
- Introduced comprehensive mock for the Origin Private File System (OPFS) in `tests/mocks/opfs-mock.ts`, simulating environment for detailed storage testing.
- Added `tests/opfs-storage.test.ts`, containing extensive test cases for `OPFSStorage` operations including metadata, nouns, verbs, and storage status.
- Improved S3 mock implementation in `tests/mocks/s3-mock.ts` with better object persistence, validation, and logging to emulate real S3 behavior.
- Resolved issues related to metadata, nouns, verbs, and storage usage inconsistencies in mock storage adapters.
- Enhanced logging and error handling to aid in debugging and test reliability.

Purpose: Improve test completeness and reliability by introducing detailed mocks and extended test cases for S3 and OPFS storage systems.
2025-07-21 13:42:10 -07:00