Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/paperbench_tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ jobs:

- name: Hydrate PaperBench data
run: |
git lfs fetch --include "project/paperbench/data/**"
git lfs fetch --include "project/paperbench/data/**" --exclude ""
git lfs checkout project/paperbench/data

- name: Install uv
Expand Down
2 changes: 1 addition & 1 deletion project/paperbench/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,7 @@ step above. Hydrate it manually and point PaperBench at the hydrated directory:
```console
git clone https://github.com/openai/frontier-evals.git --filter=blob:none
cd frontier-evals
git lfs fetch --include "project/paperbench/data/**"
git lfs fetch --include "project/paperbench/data/**" --exclude ""
git lfs checkout project/paperbench/data
export PAPERBENCH_DATA_DIR="$(pwd)/project/paperbench/data" # add to your shell profile
```
Expand Down
2 changes: 1 addition & 1 deletion project/paperbench/paperbench/utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ def __init__(self, candidate: Path):
"If you installed PaperBench from a git dependency, the dataset is not pulled "
"automatically. Set the PAPERBENCH_DATA_DIR environment variable to point to a "
"clone of `frontier-evals` where you've run `git lfs fetch --include "
'"project/paperbench/data/**"` (and `git lfs checkout`), or hydrate the data in '
'"project/paperbench/data/**" --exclude ""` (and `git lfs checkout`), or hydrate the data in '
"another location and point PAPERBENCH_DATA_DIR at it."
)
super().__init__(message)
Expand Down