You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
feat: add self-calibration closed loop for navigation demo
Implement online self-calibration system that forms a local closed loop
within the navigation demo. The system learns from its own constitutional
evaluation results and improves decision quality within and across sessions.
New modules:
- calibrator.py: Session-level self-calibrator with dynamic threshold,
weight, and safety hint adjustment based on violation patterns
- learning_store.py: Cross-session JSON persistence for calibration
baselines, enabling progressive improvement across runs
- prompt_calibrator.py: Translates violation patterns into natural
language hints injected into VLM prompts
Modified:
- runner.py: Integrates calibrator into the propose→validate→feedback
loop with threshold sync and session finalization
- providers.py: Adds prompt_suffix parameter for calibrated hint injection
- config.py: Adds calibration config fields (enable_calibration,
calibration_interval, violation_count_trigger, learning_store_path)
Tests: 54 new tests (40 unit + 14 integration) covering calibration
logic, cross-session learning, prompt generation, and full closed-loop
flow verification.
@@ -623,6 +624,68 @@ proposes a short-horizon command, validates it through A-YLM's `CommandValidator
623
624
falls back to `alternative_decision` or a safe stop when needed, and can render an
624
625
annotated result video plus JSONL decision logs.
625
626
627
+
#### Self-Calibration Closed Loop
628
+
629
+
The navigation demo includes an **online self-calibration system** that forms a local closed loop — the system learns from its own evaluation results and improves within a session and across sessions:
-**Within a session**: Every 10 frames or 5 violations, the calibrator recalibrates — tightening approval threshold on declining safety trends, boosting scorer weights for frequently violated principles, and injecting safety hints into VLM prompts
661
+
-**Across sessions**: `LearningStore` persists the best-performing calibration configuration to a JSON file; the next run automatically loads and starts from this improved baseline
662
+
-**Prompt injection**: Violation patterns are translated into natural language hints appended to VLM prompts (e.g., "Principle 'no_collision' violated 7 times — increase caution")
Implementation of reinforcement learning for adaptive safety boundary optimization.
1240
+
Online self-calibration with threshold/weight/hint adjustment is implemented. Future work includes full reinforcement learning for adaptive safety boundary optimization with model fine-tuning.
1175
1241
1176
1242
### 10.2 Multi-Sensor Fusion
1177
1243
Integration with LiDAR for enhanced geometric accuracy in safety-critical scenarios.
0 commit comments