Repository navigation
Feat/prompt cache gpt6.2 - #5
Merged
Merged
Conversation
Enable Chat Completions tool calling for both providers and accept DeepSeek DSML text tool calls as a fallback. Also read OpenRouter's non-streaming reasoning field and surface mid-stream provider errors instead of returning an empty successful answer. Bump version to 0.1.146.
- Register gpt-6.2-sol/gpt-6.2-astra with a known ~1.05M context window - Move the system prompt into the first developer message (GPT-6.2 never caches top-level instructions); keep instructions as a short constant - Add providerProfiles.<p>.promptCache settings (enabled/ttl/stableBreakpoint/ toolResultBreakpoints/key/prewarm) with validation; reject legacy 24h TTL - Send prompt_cache_options + explicit prompt_cache_breakpoint when enabled; account key derives a stable non-secret hash, never per-session - Typed PromptCacheUnsupportedError on 400/422 with one bounded retry without cache fields and a session fallback flag - Map xhigh->xhigh reasoning effort for 6.2; omit temperature/top_p for the family - Sort native tool definitions for a byte-stable cache prefix; emit prefixHash on provider request events; warn when toolOutputPruning conflicts with cache - Split cache-write telemetry by TTL (cacheWrite/cacheWrite30m/cacheWrite12h), add nonCachedInput and a separate 12h write price rate - One-time prompt_cache_options.prewarm at first prompt (best-effort) - Tests: settings validation, payload flags, fallback, prefix stability, compaction prefix reuse, telemetry split, model catalog; docs + CHANGELOG (no live benchmark performed)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.