Deferred Tool Schemas (ToolSearch)
- Entity ID:
ent-20260423-r31a000000004 - Type:
mechanism - Scope:
private - Status:
active
Description
Tools start as name-only placeholders in the initial API payload; full JSON schemas are injected only when the model invokes the ToolSearch tool to request them. Reduces initial tool-schema token consumption by approximately 85%. Built-in tools always ship full schemas; MCP tools and some built-ins are deferred.
Key claims
- Deferred tool schemas reduce initial token consumption by ~85%
- MCP tools ship lazy schemas; built-in tools ship full schemas every request
Relations
- Deferred Tool Schemas (ToolSearch) --[contains]--> Five Context-Conservation Mechanisms Beyond Compaction