Skip to content

Feat/python port#807

Open
whatnick wants to merge 27 commits into
aodn:masterfrom
whatnick:feat/python-port
Open

Feat/python port#807
whatnick wants to merge 27 commits into
aodn:masterfrom
whatnick:feat/python-port

Conversation

@whatnick

Copy link
Copy Markdown

WIP : Port PoC using Agentic methods and harness engineering for #806

…tegration

Phase 5 - NetCDF Export:
- Add template parser for IMOS NetCDF attribute templates
- Implement export_netcdf writer with NetCDF4 compression
- Add get_parameter_info helper for metadata lookup
- Wire export CLI command for timeSeries/profile modes
- Add 2 export tests

Phase 6 - Pipeline Integration:
- Implement run_pipeline orchestrator (parse → preprocess → QC → export)
- Add process CLI command for one-step batch processing
- Create default preprocessing and QC chains
- Add 3 pipeline integration tests
- Support --skip-pp and --skip-qc flags

Complete end-to-end workflow now functional.
Tests: 151 passing, ruff clean, mypy clean
- Add MCR-based regression testing plan (recommended approach)
  - MCR_SUMMARY.md: Executive summary with cost-benefit analysis
  - MCR_REGRESSION_PLAN.md: Comprehensive technical plan (20KB)
  - MCR_QUICKSTART.md: 30-minute quick-start guide

- Add traditional MATLAB regression testing plan (alternative)
  - REGRESSION_TESTING_SUMMARY.md: Executive summary
  - REGRESSION_TESTING_PLAN.md: Detailed technical plan (15KB)
  - REGRESSION_TESTING_QUICKSTART.md: Step-by-step guide

- Update ROADMAP.md Phase 10 with MCR approach

Key benefits of MCR approach:
- Zero cost (vs $10,750+ for MATLAB licenses)
- 6 weeks implementation (vs 10 weeks)
- CI/CD ready (Docker + GitHub Actions)
- Unlimited parallel testing
- No license management overhead

Total documentation: 68KB, 2,381 lines
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant