Files
deepseek-harness/packages/llm
Yixiang Tu bc8c0dbf40 feat(llm): emit dynamic tool updates and project them per route
Log tool changes as developer messages independently of model capability,
fold committed headers and updates into Session.toolHistory(), and let the
LLM runtime construct deferred and retained declarations for routes that
declare a toolUpdate mode. DeepSeek serializes updates as system-role
tool_addition/tool_removal blocks with defer_loading and the tool-changes
beta header. An unchanged restored tool continues the series and is
re-offered through its recorded blocks instead of rewriting declarations.

Replace the obsolete rejection tests with wire assertions and add coverage
for the session fold, loop emission, route projection, config validation,
and the beta header. Chat and Trajectory changes land separately.
2026-09-23 22:39:26 +08:00
..

description, kind
description kind
The LLM capability group: a provider-neutral model-call service, the DeepSeek and pi-ai provider adapters, request-retry execution, and replay-aware token measurement. package-group

llm/ — LLM capability family

English | 中文

Summary

The llm group provides the harness's model-call capability: one provider-neutral service through which any composition streams requests to a model provider, plus adapters, provider-specific request metadata, retry execution, and measurement. The core llm package defines the message, content-block, and stream-chunk vocabulary every plugin and the session log use; provider adapters translate a provider's wire format into that vocabulary; DeepSeek request-extension plugins contribute lifecycle-owned metadata outside model input; llm-retry re-runs failed requests at durable agent-step boundaries; and token-meter measures request and context pressure from the durable log. This page maps the group; each package README owns its per-package contract.

Table of Contents


Packages

Package Role ctx key
llm/ Streams one model call through a registered provider adapter and shares the harness message, block, and chunk vocabulary ctx.llm
llm-deepseek/ Shared Messages protocol, request configuration, and model capabilities —
llm-deepseek-api-key/ API-key authentication and discovery for the official route ctx.llm
llm-deepseek-account/ Account-token authentication, invalidation, and discovery ctx.llm
llm-pi-ai/ Serves configured provider routes through pi-ai catalogs and wire protocols, including hand-declared gateways registers on ctx.llm
deepseek-llm-api-extensions/ Registers lifecycle-owned top-level fields on official DeepSeek requests ctx.deepseekLlmApiExtensions
plugin-package-inventory-deepseek/ Contributes the active Loader package inventory to official DeepSeek requests contributes dsh_plugin_packages
llm-retry/ Retries failed model requests under each provider's policy at durable agent-step boundaries listens to agent/request-error
token-meter/ Measures request and context pressure from the durable session log with a fixed heuristic ctx.tokenMeter

Dev Note

None.