fix: critical clear() data persistence regression (v5.10.4)

Workshop team reported that brain.clear() doesn't fully delete persistent storage.
After calling clear() and creating a new Brainy instance, all data was restored
from storage. This is a CRITICAL data integrity bug.

Root causes (3 bugs fixed):
1. **FileSystemStorage deleting wrong directory**: Data stored in branches/main/entities/
   but clear() was only deleting old pre-v5.4.0 structure (nouns/, verbs/, metadata/)
2. **COW reinitialization after clear()**: Setting cowEnabled=false on old instance
   doesn't affect new instances. Fixed with persistent marker file.
3. **Metadata index cache not cleared**: find() with type filters returned stale data
   after clear(). Fixed by recreating MetadataIndexManager.

Changes:
- FileSystemStorage: Clear branches/ directory (where data actually lives)
- All storage adapters: Add checkClearMarker()/createClearMarker() methods
- BaseStorage: Check for cow-disabled marker before initializing COW
- Brainy: Recreate metadataIndex after clear() to flush cached data
- Tests: Comprehensive regression suite (8 tests) to prevent recurrence

Fixes Workshop bug report: /media/dpsifr/storage/home/Projects/workshop/BRAINY_V5_10_2_CLEAR_BUG.md

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
David Snelling 2025-11-17 10:44:35 -08:00
parent 53420f6c9a
commit aba15638dc
11 changed files with 613 additions and 17 deletions

View file

@ -495,6 +495,12 @@ export class OPFSStorage extends BaseStorage {
this.blobStorage = undefined
this.commitLog = undefined
this.cowEnabled = false
// v5.10.4: Create persistent marker file (CRITICAL FIX)
// Bug: cowEnabled = false only affects current instance, not future instances
// Fix: Create marker file that persists across instance restarts
// When new instance calls initializeCOW(), it checks for this marker
await this.createClearMarker()
} catch (error: any) {
// Ignore if _cow directory doesn't exist (not all instances use COW)
if (error.name !== 'NotFoundError') {
@ -516,6 +522,53 @@ export class OPFSStorage extends BaseStorage {
}
}
/**
* Check if COW has been explicitly disabled via clear()
* v5.10.4: Fixes bug where clear() doesn't persist across instance restarts
* @returns true if marker file exists, false otherwise
* @protected
*/
protected async checkClearMarker(): Promise<boolean> {
await this.ensureInitialized()
try {
// Get system directory (may not exist yet)
const systemDir = await this.rootDir!.getDirectoryHandle('system', { create: false })
// Try to get the marker file
await systemDir.getFileHandle('cow-disabled', { create: false })
return true // Marker exists
} catch (error: any) {
if (error.name === 'NotFoundError') {
return false // Marker doesn't exist (or system dir doesn't exist)
}
// Other errors (permissions, etc.) - treat as marker not existing
console.warn('OPFSStorage.checkClearMarker: Error checking marker', error)
return false
}
}
/**
* Create marker indicating COW has been explicitly disabled
* v5.10.4: Called by clear() to prevent COW reinitialization on new instances
* @protected
*/
protected async createClearMarker(): Promise<void> {
await this.ensureInitialized()
try {
// Get or create system directory
const systemDir = await this.rootDir!.getDirectoryHandle('system', { create: true })
// Create empty marker file
const fileHandle = await systemDir.getFileHandle('cow-disabled', { create: true })
const writable = await fileHandle.createWritable()
await writable.write(new Uint8Array(0)) // Empty file
await writable.close()
} catch (error) {
console.error('OPFSStorage.createClearMarker: Failed to create marker file', error)
// Don't throw - marker creation failure shouldn't break clear()
}
}
// Quota monitoring configuration (v4.0.0)
private quotaWarningThreshold = 0.8 // Warn at 80% usage
private quotaCriticalThreshold = 0.95 // Critical at 95% usage