feat(backends): darwin/Metal builds for vision C++/ggml backends (depth-anything, locate-anything, rfdetr-cpp, sam3-cpp)#10511
Merged
Conversation
depth-anything-cpp, locate-anything-cpp, rfdetr-cpp and sam3-cpp already carry a Darwin/Metal path in their Makefiles (GGML_METAL=ON when build-type=metal), but were never wired into CI, so no Metal image was published and Apple Silicon could not install them. - .github/backend-matrix.yml: add the four to includeDarwin (build-type metal, lang go), matching the other go+ggml *-cpp Metal entries. - backend/index.yaml: add metal: to each backend's capabilities map (main and -development) plus concrete metal-<backend>(-development) entries pointing at the latest/master -metal-darwin-arm64-<backend> images. - backend/go/*/Makefile: a one-line note on the existing Darwin branch (also the per-backend change the CI path filter needs to actually build them here). Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Assisted-by: Claude:opus-4.8 [Claude Code]
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Wires the four vision/utility C++/ggml backends into the macOS (Apple Silicon / Metal) build matrix. Their Makefiles already carry a Darwin/Metal path (
GGML_METAL=ONwhenbuild-type=metal) - they were just never added to CI, so no Metal image was published and macOS users could not install them. This is the same mechanical wiring done for supertonic / trl / vllm / liquid-audio.Changes (additive, darwin-only)
.github/backend-matrix.yml: fourincludeDarwinentries (build-type: metal,lang: go), matching the existing go+ggml*-cppMetal entries.backend/index.yaml:metal:added to each backend's capabilities map (main +-development), plus concretemetal-<backend>(-development)entries pointing at the-metal-darwin-arm64-<backend>images.backend/go/*/Makefile: a one-line note on the existing Darwin branch - which doubles as the per-backend change the CI path filter (scripts/changed-backends.js) needs to actually build the four Metal variants on this PR.Verification
The CI darwin matrix builds each Metal image here (the Makefile touch ensures the path filter includes them). Live inference on an M4 to follow once the images are green.
Assisted-by: Claude:opus-4.8 [Claude Code]