Skip to content

Iterative json read#210

Merged
tomli380576 merged 3 commits into
mainfrom
iterative-json-read
Jun 4, 2026
Merged

Iterative json read#210
tomli380576 merged 3 commits into
mainfrom
iterative-json-read

Conversation

@tomli380576

Copy link
Copy Markdown
Collaborator

No description provided.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR introduces an iterative (streaming) reader for Checkbox session JSON using ijson, aiming to avoid loading the entire gzipped session file into memory and enabling alternative session-reading implementations behind a shared interface.

Changes:

  • Add ijson as a runtime dependency (and update uv.lock) to support streaming JSON parsing.
  • Refactor Checkbox session reading into an AbstractCheckboxSession interface with two implementations: in-memory and iterative.
  • Update app state logic to rely on the new session interface and use the new list_jobs(...) API.

Reviewed changes

Copilot reviewed 3 out of 4 changed files in this pull request and generated 3 comments.

File Description
uv.lock Locks ijson and its distribution artifacts for reproducible installs.
src/bugit_v2/models/app_state.py Uses the new session abstraction and switches job listing to list_jobs(...).
src/bugit_v2/checkbox_utils/checkbox_session.py Introduces AbstractCheckboxSession and the new streaming CheckboxSessionIterative implementation.
pyproject.toml Adds ijson>=3.5.0 to project dependencies.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread src/bugit_v2/checkbox_utils/checkbox_session.py Outdated
Comment thread src/bugit_v2/checkbox_utils/checkbox_session.py
Comment thread src/bugit_v2/checkbox_utils/checkbox_session.py
@tomli380576 tomli380576 merged commit 037fc63 into main Jun 4, 2026
1 check passed
@tomli380576 tomli380576 deleted the iterative-json-read branch June 4, 2026 06:30
@tomli380576 tomli380576 linked an issue Jun 4, 2026 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Reduce memory usage

2 participants