Skip to content

Refactor argilla/ directory to extralit/#78

Merged
JonnyTran merged 18 commits into
developfrom
refactor-argilla-to-extralit
Jun 19, 2025
Merged

Refactor argilla/ directory to extralit/#78
JonnyTran merged 18 commits into
developfrom
refactor-argilla-to-extralit

Conversation

@JonnyTran

Copy link
Copy Markdown
Member

Summary

This PR addresses Issue #62 by refactoring the codebase from argilla/ to extralit/ directory structure at the repository root.

Changes Made

Directory Structure

  • Moved the entire argilla/ directory to extralit/ at repo root
  • Maintained backward compatibility with the existing argilla module structure inside extralit/src/
  • Preserved the extralit module structure inside extralit/src/extralit/

Configuration Updates

  • Updated Tiltfile to reference new extralit/ directory paths for Docker builds and live updates
  • Updated GitHub workflows:
    • argilla.yml: Changed all path references from argilla/ to extralit/
    • argilla.docs.yml: Updated documentation build paths to use extralit/
  • Updated README.md files to reference new logo paths under extralit/docs/assets/

Build & Deployment

  • Updated Docker build contexts and file paths in Tiltfile
  • Updated GitHub Actions workflows for package publishing and documentation
  • Updated artifact names and paths in CI/CD pipelines

Motivation

As mentioned in Issue #62, this refactoring helps:

  • Make extralit-specific code easily identifiable for new contributors
  • Prepare the codebase for significant development in OCR extraction and schema UI projects
  • Align directory structure with the project's identity while maintaining compatibility

Testing

  • All configuration files have been updated to reflect the new directory structure
  • GitHub workflows have been updated to use the correct paths
  • Docker builds and development workflows should continue to work with the new structure

Backward Compatibility

  • The argilla Python module remains accessible within the extralit/ directory
  • No breaking changes to the Python API
  • Existing import statements and module usage remain unchanged

Fixes #62

Checklist

  • Moved argilla/ directory to extralit/
  • Updated Tiltfile paths
  • Updated GitHub workflows
  • Updated README files
  • Maintained module structure for backward compatibility
  • Tested configuration file updates

@JonnyTran can click here to continue refining the PR

- Move argilla/ directory to extralit/ at repo root
- Update Tiltfile to reference new extralit/ directory paths
- Update GitHub workflows (argilla.yml, argilla.docs.yml) to use extralit/ paths
- Update README.md files to reference new logo paths
- Maintain backward compatibility with argilla module structure inside extralit/

Fixes #62
Comment thread .github/workflows/argilla.docs.yml Fixed
Comment thread .github/workflows/argilla.yml Fixed
@JonnyTran JonnyTran marked this pull request as ready for review June 18, 2025 00:36
@JonnyTran JonnyTran requested review from a team as code owners June 18, 2025 00:36
@JonnyTran JonnyTran requested review from jonnywireless and prakharsingh-74 and removed request for a team June 18, 2025 00:36
@JonnyTran JonnyTran changed the base branch from main to develop June 18, 2025 00:36
@JonnyTran JonnyTran requested review from Copilot and removed request for jonnywireless and prakharsingh-74 June 18, 2025 00:37

This comment was marked as outdated.

- Modify .gitignore to exclude extralit/site instead of argilla/site
- Update .pre-commit-config.yaml to target extralit paths for various hooks
- Adjust codecov.yml to point to extralit source directories
- Change devcontainer settings to use extralit environment files
- Update CODEOWNERS to reflect new extralit directory structure
- Modify scorecard.yml to track changes in the extralit directory
- Update frontend translation links to point to the new extralit demo
- Update mkdocs configuration for extralit documentation
- Adjust changelog generation script to reference extralit paths
- Update deployment helper to use the new extralit template repository
@codecov

codecov Bot commented Jun 18, 2025

Copy link
Copy Markdown

Codecov Report

Attention: Patch coverage is 83.33333% with 3 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
...server/src/argilla_server/api/handlers/v1/files.py 60.00% 2 Missing ⚠️
...erver/src/argilla_server/api/handlers/v1/models.py 88.88% 1 Missing ⚠️
Flag Coverage Δ
argilla 71.50% <ø> (ø)
argilla-server 86.78% <83.33%> (?)
frontend 7.34% <ø> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines Coverage Δ
...er/src/argilla_server/api/handlers/v1/documents.py 37.75% <100.00%> (ø)
...rgilla-server/src/argilla_server/contexts/files.py 23.30% <100.00%> (ø)
argilla-server/src/argilla_server/contexts/hub.py 92.41% <100.00%> (ø)
argilla-server/src/argilla_server/settings.py 87.06% <100.00%> (ø)
...erver/src/argilla_server/api/handlers/v1/models.py 75.43% <88.88%> (ø)
...server/src/argilla_server/api/handlers/v1/files.py 64.81% <60.00%> (ø)

... and 666 files with indirect coverage changes

Components Coverage Δ
extralit ∅ <ø> (∅)
argilla 71.50% <ø> (∅)
argilla_v1 ∅ <ø> (∅)
argilla-server 86.78% <83.33%> (∅)
argilla-frontend 7.34% <ø> (∅)
🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

- Deleted `argilla.docs.yml` and `argilla.yml` workflows as part of the transition to the `extralit` structure.
- Updated README.md to reflect the new `extralit.yml` workflow name.
…tralit/public-demo" to "argilla/argilla-template-space"
@JonnyTran JonnyTran self-assigned this Jun 19, 2025
…81)

* refactor:  update the `CONFIG_REPO_DIR` path from `.argilla` to .`extralit`

- Changed database URLs in .env.dev and .env.test files to point to .extralit directory.
- Updated default home path in settings.py to use .extralit.
- Modified temporary directory creation in hub.py to reflect new path.
- Adjusted logging configuration in models.py.
- Updated development setup documentation to reference the new directory structure.
- Changed default configuration repository directory in _disk.py to .extralit.

* refactor:  update the `CONFIG_REPO_DIR` path from `.argilla` to .`extralit`

- Changed database URLs in .env.dev and .env.test files to point to .extralit directory.
- Updated default home path in settings.py to use .extralit.
- Modified temporary directory creation in hub.py to reflect new path.
- Adjusted logging configuration in models.py.
- Updated development setup documentation to reference the new directory structure.
- Changed default configuration repository directory in _disk.py to .extralit.

* update CHANGELOG
@JonnyTran JonnyTran added this to the v0.5.0 milestone Jun 19, 2025
- Update dependencies in pyproject.toml to align with project requirements
- Modify the `argilla-v1` workflow to include additional commands for installing `extralit`, cleaning the environment, and pruning the cache.
- Add a deprecation notice for `argilla-v1` in the CHANGELOG, indicating it will be removed in the next major release in favor of `extralit`.
@JonnyTran JonnyTran requested a review from Copilot June 19, 2025 08:07

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR refactors the Python SDK directory from argilla/ to extralit/, updating all code, configuration, documentation, and CI references to the new structure while preserving backward compatibility.

  • Relocated argilla/ into extralit/src/argilla/ and updated module imports.
  • Updated configuration files (pyproject, Tiltfile, mkdocs, workflows, codecov).
  • Adjusted documentation and changelog paths; removed obsolete test fixtures.

Reviewed Changes

Copilot reviewed 105 out of 582 changed files in this pull request and generated 1 comment.

Show a summary per file
File Description
extralit/src/argilla/_helpers/_deploy.py Update copyright to Extralit Labs
extralit/pyproject.toml Pin versions for python-dotenv, html5lib, tiktoken, pymupdf
extralit/mkdocs.yml Update edit_uri to new docs path
extralit/docs/scripts/gen_changelog.py Adjust repository name and changelog path
extralit/docs/getting_started/development_setup.md Change cd ../argilla to cd ../extralit and update DB path
extralit/CHANGELOG.md Add entries for refactor and cache-dir changes
codecov.yml Redirect coverage paths to extralit/src/...
argilla-v1/tests/unit/labeling/text_classification/conftest.py Remove obsolete fixture
Comments suppressed due to low confidence (2)

extralit/docs/scripts/gen_changelog.py:21

  • The repository string uses a capital "E"; GitHub URLs are case-insensitive but conventionally all lowercase. Consider using "extralit/extralit" to match other references and avoid confusion.
REPOSITORY = "Extralit/extralit"

@Extralit Extralit deleted a comment from Copilot AI Jun 19, 2025
@JonnyTran JonnyTran merged commit c18decc into develop Jun 19, 2025
22 checks passed
jonnywireless pushed a commit that referenced this pull request Jul 31, 2025
* Refactor argilla/ directory to extralit/

- Move argilla/ directory to extralit/ at repo root
- Update Tiltfile to reference new extralit/ directory paths
- Update GitHub workflows (argilla.yml, argilla.docs.yml) to use extralit/ paths
- Update README.md files to reference new logo paths
- Maintain backward compatibility with argilla module structure inside extralit/

Fixes #62

* refactor: update `argilla/` paths to `extralit/` for some CI

- Modify .gitignore to exclude extralit/site instead of argilla/site
- Update .pre-commit-config.yaml to target extralit paths for various hooks
- Adjust codecov.yml to point to extralit source directories
- Change devcontainer settings to use extralit environment files
- Update CODEOWNERS to reflect new extralit directory structure
- Modify scorecard.yml to track changes in the extralit directory
- Update frontend translation links to point to the new extralit demo
- Update mkdocs configuration for extralit documentation
- Adjust changelog generation script to reference extralit paths
- Update deployment helper to use the new extralit template repository

* refactor: rename argilla Github Actions workflows to extralit

- Deleted `argilla.docs.yml` and `argilla.yml` workflows as part of the transition to the `extralit` structure.
- Updated README.md to reflect the new `extralit.yml` workflow name.

* ci: fix tests by reverting Argilla space template repository from "extralit/public-demo" to "argilla/argilla-template-space"

* ci: fix integration tests

* refactor: logging.getLogger

* refactor: revert changing `argilla.context` from `files` to `storage` due to import issues

* Refactor the `CONFIG_REPO_DIR` path from `.argilla/` to `.extralit/` (#81)

* refactor:  update the `CONFIG_REPO_DIR` path from `.argilla` to .`extralit`

- Changed database URLs in .env.dev and .env.test files to point to .extralit directory.
- Updated default home path in settings.py to use .extralit.
- Modified temporary directory creation in hub.py to reflect new path.
- Adjusted logging configuration in models.py.
- Updated development setup documentation to reference the new directory structure.
- Changed default configuration repository directory in _disk.py to .extralit.

* refactor:  update the `CONFIG_REPO_DIR` path from `.argilla` to .`extralit`

- Changed database URLs in .env.dev and .env.test files to point to .extralit directory.
- Updated default home path in settings.py to use .extralit.
- Modified temporary directory creation in hub.py to reflect new path.
- Adjusted logging configuration in models.py.
- Updated development setup documentation to reference the new directory structure.
- Changed default configuration repository directory in _disk.py to .extralit.

* update CHANGELOG

* ci: fix tests in `argilla-v1`

- Update dependencies in pyproject.toml to align with project requirements

* Update GitHub Actions workflow and CHANGELOG

- Modify the `argilla-v1` workflow to include additional commands for installing `extralit`, cleaning the environment, and pruning the cache.
- Add a deprecation notice for `argilla-v1` in the CHANGELOG, indicating it will be removed in the next major release in favor of `extralit`.

* ci: optimize argilla-v1 workflows

* ci: streamline argilla-v1 workflow by removing caching steps

* pin pdf package in `extralit` package

* readded `argilla-v1/src/extralit` from `v0.2.2`

* refactor: `extralit_v1` package name in `argilla_v1`

* refactor: `extralit_v1` package name in `argilla_v1`

* fix: tests

* ci: update argilla-v1 tests

---------

Co-authored-by: openhands <openhands@all-hands.dev>
JonnyTran added a commit that referenced this pull request Jul 31, 2025
* Refactor argilla/ directory to extralit/

- Move argilla/ directory to extralit/ at repo root
- Update Tiltfile to reference new extralit/ directory paths
- Update GitHub workflows (argilla.yml, argilla.docs.yml) to use extralit/ paths
- Update README.md files to reference new logo paths
- Maintain backward compatibility with argilla module structure inside extralit/

Fixes #62

* refactor: update `argilla/` paths to `extralit/` for some CI

- Modify .gitignore to exclude extralit/site instead of argilla/site
- Update .pre-commit-config.yaml to target extralit paths for various hooks
- Adjust codecov.yml to point to extralit source directories
- Change devcontainer settings to use extralit environment files
- Update CODEOWNERS to reflect new extralit directory structure
- Modify scorecard.yml to track changes in the extralit directory
- Update frontend translation links to point to the new extralit demo
- Update mkdocs configuration for extralit documentation
- Adjust changelog generation script to reference extralit paths
- Update deployment helper to use the new extralit template repository

* refactor: rename argilla Github Actions workflows to extralit

- Deleted `argilla.docs.yml` and `argilla.yml` workflows as part of the transition to the `extralit` structure.
- Updated README.md to reflect the new `extralit.yml` workflow name.

* ci: fix tests by reverting Argilla space template repository from "extralit/public-demo" to "argilla/argilla-template-space"

* ci: fix integration tests

* refactor: logging.getLogger

* refactor: revert changing `argilla.context` from `files` to `storage` due to import issues

* Refactor the `CONFIG_REPO_DIR` path from `.argilla/` to `.extralit/` (#81)

* refactor:  update the `CONFIG_REPO_DIR` path from `.argilla` to .`extralit`

- Changed database URLs in .env.dev and .env.test files to point to .extralit directory.
- Updated default home path in settings.py to use .extralit.
- Modified temporary directory creation in hub.py to reflect new path.
- Adjusted logging configuration in models.py.
- Updated development setup documentation to reference the new directory structure.
- Changed default configuration repository directory in _disk.py to .extralit.

* refactor:  update the `CONFIG_REPO_DIR` path from `.argilla` to .`extralit`

- Changed database URLs in .env.dev and .env.test files to point to .extralit directory.
- Updated default home path in settings.py to use .extralit.
- Modified temporary directory creation in hub.py to reflect new path.
- Adjusted logging configuration in models.py.
- Updated development setup documentation to reference the new directory structure.
- Changed default configuration repository directory in _disk.py to .extralit.

* update CHANGELOG

* ci: fix tests in `argilla-v1`

- Update dependencies in pyproject.toml to align with project requirements

* Update GitHub Actions workflow and CHANGELOG

- Modify the `argilla-v1` workflow to include additional commands for installing `extralit`, cleaning the environment, and pruning the cache.
- Add a deprecation notice for `argilla-v1` in the CHANGELOG, indicating it will be removed in the next major release in favor of `extralit`.

* ci: optimize argilla-v1 workflows

* ci: streamline argilla-v1 workflow by removing caching steps

* pin pdf package in `extralit` package

* readded `argilla-v1/src/extralit` from `v0.2.2`

* refactor: `extralit_v1` package name in `argilla_v1`

* refactor: `extralit_v1` package name in `argilla_v1`

* fix: tests

* ci: update argilla-v1 tests

---------

Co-authored-by: openhands <openhands@all-hands.dev>
jonnywireless pushed a commit that referenced this pull request Aug 2, 2025
* Refactor argilla/ directory to extralit/

- Move argilla/ directory to extralit/ at repo root
- Update Tiltfile to reference new extralit/ directory paths
- Update GitHub workflows (argilla.yml, argilla.docs.yml) to use extralit/ paths
- Update README.md files to reference new logo paths
- Maintain backward compatibility with argilla module structure inside extralit/

Fixes #62

* refactor: update `argilla/` paths to `extralit/` for some CI

- Modify .gitignore to exclude extralit/site instead of argilla/site
- Update .pre-commit-config.yaml to target extralit paths for various hooks
- Adjust codecov.yml to point to extralit source directories
- Change devcontainer settings to use extralit environment files
- Update CODEOWNERS to reflect new extralit directory structure
- Modify scorecard.yml to track changes in the extralit directory
- Update frontend translation links to point to the new extralit demo
- Update mkdocs configuration for extralit documentation
- Adjust changelog generation script to reference extralit paths
- Update deployment helper to use the new extralit template repository

* refactor: rename argilla Github Actions workflows to extralit

- Deleted `argilla.docs.yml` and `argilla.yml` workflows as part of the transition to the `extralit` structure.
- Updated README.md to reflect the new `extralit.yml` workflow name.

* ci: fix tests by reverting Argilla space template repository from "extralit/public-demo" to "argilla/argilla-template-space"

* ci: fix integration tests

* refactor: logging.getLogger

* refactor: revert changing `argilla.context` from `files` to `storage` due to import issues

* Refactor the `CONFIG_REPO_DIR` path from `.argilla/` to `.extralit/` (#81)

* refactor:  update the `CONFIG_REPO_DIR` path from `.argilla` to .`extralit`

- Changed database URLs in .env.dev and .env.test files to point to .extralit directory.
- Updated default home path in settings.py to use .extralit.
- Modified temporary directory creation in hub.py to reflect new path.
- Adjusted logging configuration in models.py.
- Updated development setup documentation to reference the new directory structure.
- Changed default configuration repository directory in _disk.py to .extralit.

* refactor:  update the `CONFIG_REPO_DIR` path from `.argilla` to .`extralit`

- Changed database URLs in .env.dev and .env.test files to point to .extralit directory.
- Updated default home path in settings.py to use .extralit.
- Modified temporary directory creation in hub.py to reflect new path.
- Adjusted logging configuration in models.py.
- Updated development setup documentation to reference the new directory structure.
- Changed default configuration repository directory in _disk.py to .extralit.

* update CHANGELOG

* ci: fix tests in `argilla-v1`

- Update dependencies in pyproject.toml to align with project requirements

* Update GitHub Actions workflow and CHANGELOG

- Modify the `argilla-v1` workflow to include additional commands for installing `extralit`, cleaning the environment, and pruning the cache.
- Add a deprecation notice for `argilla-v1` in the CHANGELOG, indicating it will be removed in the next major release in favor of `extralit`.

* ci: optimize argilla-v1 workflows

* ci: streamline argilla-v1 workflow by removing caching steps

* pin pdf package in `extralit` package

* readded `argilla-v1/src/extralit` from `v0.2.2`

* refactor: `extralit_v1` package name in `argilla_v1`

* refactor: `extralit_v1` package name in `argilla_v1`

* fix: tests

* ci: update argilla-v1 tests

---------

Co-authored-by: openhands <openhands@all-hands.dev>
jonnywireless pushed a commit that referenced this pull request Aug 2, 2025
* Refactor argilla/ directory to extralit/

- Move argilla/ directory to extralit/ at repo root
- Update Tiltfile to reference new extralit/ directory paths
- Update GitHub workflows (argilla.yml, argilla.docs.yml) to use extralit/ paths
- Update README.md files to reference new logo paths
- Maintain backward compatibility with argilla module structure inside extralit/

Fixes #62

* refactor: update `argilla/` paths to `extralit/` for some CI

- Modify .gitignore to exclude extralit/site instead of argilla/site
- Update .pre-commit-config.yaml to target extralit paths for various hooks
- Adjust codecov.yml to point to extralit source directories
- Change devcontainer settings to use extralit environment files
- Update CODEOWNERS to reflect new extralit directory structure
- Modify scorecard.yml to track changes in the extralit directory
- Update frontend translation links to point to the new extralit demo
- Update mkdocs configuration for extralit documentation
- Adjust changelog generation script to reference extralit paths
- Update deployment helper to use the new extralit template repository

* refactor: rename argilla Github Actions workflows to extralit

- Deleted `argilla.docs.yml` and `argilla.yml` workflows as part of the transition to the `extralit` structure.
- Updated README.md to reflect the new `extralit.yml` workflow name.

* ci: fix tests by reverting Argilla space template repository from "extralit/public-demo" to "argilla/argilla-template-space"

* ci: fix integration tests

* refactor: logging.getLogger

* refactor: revert changing `argilla.context` from `files` to `storage` due to import issues

* Refactor the `CONFIG_REPO_DIR` path from `.argilla/` to `.extralit/` (#81)

* refactor:  update the `CONFIG_REPO_DIR` path from `.argilla` to .`extralit`

- Changed database URLs in .env.dev and .env.test files to point to .extralit directory.
- Updated default home path in settings.py to use .extralit.
- Modified temporary directory creation in hub.py to reflect new path.
- Adjusted logging configuration in models.py.
- Updated development setup documentation to reference the new directory structure.
- Changed default configuration repository directory in _disk.py to .extralit.

* refactor:  update the `CONFIG_REPO_DIR` path from `.argilla` to .`extralit`

- Changed database URLs in .env.dev and .env.test files to point to .extralit directory.
- Updated default home path in settings.py to use .extralit.
- Modified temporary directory creation in hub.py to reflect new path.
- Adjusted logging configuration in models.py.
- Updated development setup documentation to reference the new directory structure.
- Changed default configuration repository directory in _disk.py to .extralit.

* update CHANGELOG

* ci: fix tests in `argilla-v1`

- Update dependencies in pyproject.toml to align with project requirements

* Update GitHub Actions workflow and CHANGELOG

- Modify the `argilla-v1` workflow to include additional commands for installing `extralit`, cleaning the environment, and pruning the cache.
- Add a deprecation notice for `argilla-v1` in the CHANGELOG, indicating it will be removed in the next major release in favor of `extralit`.

* ci: optimize argilla-v1 workflows

* ci: streamline argilla-v1 workflow by removing caching steps

* pin pdf package in `extralit` package

* readded `argilla-v1/src/extralit` from `v0.2.2`

* refactor: `extralit_v1` package name in `argilla_v1`

* refactor: `extralit_v1` package name in `argilla_v1`

* fix: tests

* ci: update argilla-v1 tests

---------

Co-authored-by: openhands <openhands@all-hands.dev>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Refactor] Refactor argilla/ to extralit/

4 participants