Releases: google/orbax
Releases · google/orbax
v0.12.0
Added
- Add
LatestDurationpreservation policy to support duration-based (TTL)
checkpoint retention. - Add
EveryNStepsClosestpreservation policy, which preserves checkpoints at
steps closest to multiples ofinterval_steps. - Add
SerializationStatusCallbackfor save operations to track transfer and
disk write events. While primarily intended as lightweight progress handles,
this callback system allows the potential to inject custom logic for
advanced monitoring and custom actions during checkpointing.
Changed
- #v1 Rename
save/load_pytreetosave/load. Eliminate most user-facing
"pytree" terminology in favor of "state" as a more specific term.
Adddeprecations.pyfor handling deprecated public functions.
Fixed
- Fix Pathways MTC Colocated worker initialization and save/restore PyTree bugs.
- Fix bug where TensorStore transaction was never used, due to byte_limiter
always having a non-None value.
v0.11.40
Removed
- #v1 Remove numpy and pytorch layouts, as these are insecure and not worth the
effort in maintaining. Safetensors is instead the recommended conversion case. - #v1 Remove
LeafHandleras a user-exposed layer (it remains as an internal layer).
Added
- #v1 Allow a context to be default-configured for all
Checkpointer
operations.
Changed
- Upgrade to TensorStore>=0.1.84 (and Python>=3.11 as a consequence.)
v0.11.39
Release v0.11.37
Added
- Add colocated runtime helpers for Pathways MTC.
- #v1 Centralize
StorageOptionsintoArrayOptionsand implement field-level
merging. - Add Patch for Pathways CPU ids.
- Add sidecar MTC backend support
- Add Colocated Python Sidecar MTC Checkpoint Manager
- Add Colocated Python Orchestration handling
- #v1 Add
LeafHandleras aCheckpointableHandler, so that ordinary PyTree
leaves can also be saved as individual checkpointables. - Move MTC files to multi_tier_checkpointing and use local checkpoint engine
Changed
- Reduced default OCDBT target file size from 2GiB to 400MiB for GCS paths.