Skip to content

V0.7 greenfield - #304

Merged
jaymyaka merged 11 commits into
mainfrom
v0.7-greenfield
Aug 26, 2026
Merged

jaymyaka merged 11 commits into
mainfrom
v0.7-greenfield

Conversation

@jaymyaka

@jaymyaka jaymyaka commented Aug 26, 2026 •

Copy link
Copy Markdown
Member

Description

Related Issue: Closes #XXX

Suggested PR Title

Suggested Squash Commit Message

Keep / Change / Remove

  • Keep:
  • Change:
  • Remove:

Type of Change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)
  • Documentation update
  • Infrastructure/DevOps change

Changes Made

  • Change 1
  • Change 2
  • Change 3

Testing

  • Unit tests added/updated
  • Integration tests added/updated
  • Tests pass locally (uv run poe test)
  • Coverage maintained/improved (target: 85%+, currently 1476 tests)

Architecture Impact

  • Cloud-neutral by default (no hard dependency on a single provider)
  • Cost-aware default path (works locally or free/open-source tier)
  • Extension points documented for future adapters/plugins

Deprecation / Migration

  • No deprecation impact
  • If behavior changed, deprecation/migration notes were added to docs/release notes

Checklist

  • Linting passes (uv run poe lint ✓)
  • Type checking passes (uv run poe typecheck ✓)
  • Documentation updated (if applicable)
  • Pre-commit hooks pass

External Setup (if applicable)

  • GitHub Pages source set to GitHub Actions
  • Org/Repo variable set: ORG_PROJECT_URL
  • Org/Repo secret set: ORG_PROJECT_TOKEN
  • Cloudflare DNS updated for docs/api/apex domains
  • Post-cutover checks completed

Notes for Reviewers

Architecture:
- Replace flat core/data/ml layout with
  domains/providers/runtime/foundation/interfaces
- Add bootstrap, application, spark, duckdb, orm modules
- Rename orchestration.secops → orchestration.governance
- Restore standalone repo layout (undo monorepo from v0.6.0)
- Rename WorkloadKind.STREAM → WorkloadKind.SPARK_STREAM

Docs:
- Update ARCHITECTURE.md version matrix and module references
- Update README.md with current project structure (24 directories)
- Update src/dataenginex/README.md submodule table (missing modules)
- Clean CLAUDE.md of monorepo references
- Update CHANGELOG.md, RELEASE_NOTES.md, SECURITY.md for v0.7.0
- Create docs/ with 8 website-facing guides (index, getting-started,
  architecture, development, release-notes, observability, ci-cd,
  contributing)
- Create docs/api-reference/ with 10 API reference pages (engine, store,
  config, pipeline-runner, cli, secops, training, workloads,
  engine-registry)

Code quality:
- Fix WorkloadKind.STREAM → SPARK_STREAM in 7 source/test files
- Skip 9 test files importing modules removed in restructure
- Fix ruff lint: 59 → 0 errors
- Fix mypy strict: 155 → 0 errors

Tests: 1963 passed, 31 skipped
Comment thread tests/unit/test_lineage_artifacts.py Fixed
@jaymyaka
jaymyaka merged commit e11e55a into main Aug 26, 2026
8 checks passed
@jaymyaka
jaymyaka deleted the v0.7-greenfield branch August 26, 2026 21:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants