# Simon Willison 发布了 llm-chat-completions-server 0.1a0，一个将 LLM 模型暴露为 OpenAI Chat Completions 兼容 API 的插件，利用内容可寻址日志优化对话状态管理

- 来源：Simon Willison
- 发布时间：2026-07-30 23:43
- AIWatch 分数：64
- AIWatch 标记：未精选
- AIWatch 链接：https://aiwatch.icu/events/evt_01kyts0kycrhaxdbdbjq9t95em
- 原文链接：https://simonwillison.net/2026/Jul/30/llm-chat-completions-server/#atom-everything

## 精选理由

常规快讯，保留列表

## AI 摘要

Simon Willison 发布了 llm-chat-completions-server 0.1a0，一个将 LLM 模型暴露为 OpenAI Chat Completions 兼容 API 的插件，利用内容可寻址日志优化对话状态管理。

## 正文

Release: llm-chat-completions-server 0.1a0

A key goal of the new content-addressable logs in LLM 0.32rc1 was being able to support OpenAI Chat Completion style requests where each incoming message extends the previous conversation, like this:

curl http://localhost:8002/v1/chat/completions \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "qwen3.5-4b",
    "messages": [
      {"role": "user", "content": "Capital of France?"},
      {"role": "assistant", "content": "Paris."},
      {"role": "user", "content": "Germany?"}
    ]
  }'

Here the conversation state is tracked by the client, so each of these requests gets longer and longer. The new schema design in LLM is designed to de-duplicate these using hashes of the individual message parts.

To test that out, I built this plugin:

uv tool install llm --pre
llm install llm-chat-completions-server
llm chat-completions-server -p 9001

Running this starts a localhost server on port 9001 that exposes your full collection of LLM models (from any plugins you have installed) using a ChatGPT Completions compatible endpoint.

GPT-5.6 Sol wrote the whole thing - it turns out it knows the OpenAI Chat Completions API shape really well.

Tags: projects, openai, llm