Skip to content

[codex] Add RL trajectory capture#83

Draft
Lixtt wants to merge 1 commit into
AI45Lab:mainfrom
Lixtt:codex/rl-trajectory-capture
Draft

[codex] Add RL trajectory capture#83
Lixtt wants to merge 1 commit into
AI45Lab:mainfrom
Lixtt:codex/rl-trajectory-capture

Conversation

@Lixtt

@Lixtt Lixtt commented Jun 24, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds opt-in RL trajectory capture to a3s-code so agent runs can emit structured JSONL records for downstream RL/SFT data construction.

Changes

  • add RlTrajectoryRecorder and a3s.rl_trajectory.v1 JSONL event schema
  • record execution lifecycle, LLM request/response, context compaction, tool calls, tool results, and parse/duplicate-call errors
  • expose trajectory controls through Rust session options and Python SDK session options
  • add focused tests for recorder behavior and Python SDK option mapping

Validation

  • cargo fmt --check
  • cargo test -p a3s-code-core rl_trajectory --lib
  • LD_LIBRARY_PATH=/mnt/shared-storage-user/lixiangtian/miniconda3/lib:${LD_LIBRARY_PATH:-} cargo test --manifest-path sdk/python/Cargo.toml session_options_map_rl_trajectory_controls --lib
  • git diff --check

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant