Skip to content

[codex] spec engine-native model backends#5

Draft
devteapot wants to merge 2 commits into
mainfrom
engine-agnostic-inference
Draft

[codex] spec engine-native model backends#5
devteapot wants to merge 2 commits into
mainfrom
engine-agnostic-inference

Conversation

@devteapot

Copy link
Copy Markdown
Owner

Summary

  • Add a future design spec for engine-native model backends alongside existing API adapters.
  • Define the proposed ModelTurnBackend, engine session protocol, wire envelope, tool dialect boundary, provider mirror, config shape, security notes, implementation phases, and test plan.
  • Link the spec from the README, docs map, architecture notes, and MVP non-MVP roadmap.

Impact

This documents a path for local/stateful inference engines such as DS4, llama.cpp, vLLM, MLX/oMLX, and SGLang without removing hosted/API backend support or moving Sloppy capabilities into inference engines.

Validation

Docs-only change; no runtime tests run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant