feat: add automatic high-volume handling for S3 storage adapter

- Configure AWS SDK with 500 max sockets (up from default 50)
- Add intelligent backpressure with pending operation tracking
- Implement dynamic batch sizing based on memory pressure
- Auto-reduce operations when heap usage exceeds 80%
- Gradually recover throughput when system stabilizes
- Track and respond to consecutive error patterns
- Fix S3 mock to not add ID to metadata objects
- Add backpressure to metadata save operations
- All changes are transparent - no configuration required

package.json

@@ -156,6 +156,7 @@
   "dependencies": {
     "@aws-sdk/client-s3": "^3.540.0",
     "@huggingface/transformers": "^3.1.0",
+    "@smithy/node-http-handler": "^4.1.1",
     "buffer": "^6.0.3",
     "dotenv": "^16.4.5",
     "uuid": "^9.0.1"