fix(storage): resolve pagination warnings and improve S3 adapter performance

- Fix deprecated getAllNodes() warnings by using getNodesWithPagination() in S3 adapter
- Add getNounsWithPagination() method to S3CompatibleStorage for proper pagination support
- Create optimizedS3Search module for efficient pagination and filtering
- Update baseStorage to properly detect pagination support in adapters
- Add comprehensive documentation for performance and logging fixes
- Ensure backward compatibility with existing code

This resolves the following warnings in dependent projects:
- "getAllNodes() is deprecated and will be removed in a future version"
- "Storage adapter does not support pagination, falling back to loading all nouns"
- "Only returning the first 1000 nodes. There are more nodes available"
This commit is contained in:
David Snelling 2025-08-05 07:22:05 -07:00
parent 415e823004
commit 24b0df8df5
6 changed files with 825 additions and 118 deletions

View file

@ -21,6 +21,7 @@ export const STATISTICS_KEY = 'statistics'
*/
export abstract class BaseStorage extends BaseStorageAdapter {
protected isInitialized = false
protected readOnly = false
/**
* Initialize the storage adapter