Skip to content

Add wikipedia loss during eval #20

@TimKoornstra

Description

@TimKoornstra

To monitor catastrophic forgetting, we should also evaluate on some "normal" dataset. We can take a random subset of English wikipedia pages from here: https://huggingface.co/datasets/wikimedia/wikipedia/viewer/20231101.en

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions