Skip to content

Add vLLM compatibility config options#262

Open
Slashtaker wants to merge 15 commits intoCortexReach:masterfrom
Slashtaker:vllm-compat-timeout
Open

Add vLLM compatibility config options#262
Slashtaker wants to merge 15 commits intoCortexReach:masterfrom
Slashtaker:vllm-compat-timeout

Conversation

@Slashtaker
Copy link

Summary

  • add embedding.requestDimensions to control whether dimensions are sent to embedding APIs while preserving local vector sizing
  • make rerank timeout configurable via retrieval.timeoutMs and clear timeout state on failures
  • update manifest, docs, and changelog; add vLLM local deployment guide

Test Plan

  • npm test (full suite; includes new regression coverage for config defaults, requestDimensions=false payload, rerank timeout, and manifest schema)

Changes

  • CHANGELOG.md
  • README.md
  • README_CN.md
  • docs/vllm-local-deployment.zh-CN.md
  • index.ts
  • openclaw.plugin.json
  • src/embedder.ts
  • src/retriever.ts
  • test/config-session-strategy-migration.test.mjs
  • test/embedder-error-hints.test.mjs
  • test/plugin-manifest-regression.mjs
  • test/retriever-rerank-regression.mjs

Related

Slashtaker and others added 14 commits March 18, 2026 14:02
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@Slashtaker Slashtaker changed the title Add vLLM compatibility config options fix: Add vLLM compatibility config options Mar 19, 2026
@Slashtaker Slashtaker changed the title fix: Add vLLM compatibility config options Add vLLM compatibility config options Mar 19, 2026
@rwmjhb
Copy link
Collaborator

rwmjhb commented Mar 19, 2026

Review

requestDimensionstimeoutMs 实现干净,测试覆盖到位(默认值、显式值、无效值、payload 验证),finally { clearTimeout } 修复了 timer 泄漏。vLLM 部署文档实用。

应该修改

1. plugin-manifest-regression.mjs 替换了已有检查

embedding.chunking.defaultsessionMemory.enabled.default 的回归检查被新字段的检查替换了。回归测试应该累积覆盖,不应替换。请保留原有的两条,新增 requestDimensionstimeoutMs 的检查。

2. Rebase

  • package-lock.json 删除了 apache-arrowpeer: true(master 上有)
  • package.json test script 加 cjk-recursion-regression(master 已有)
  • CI 未跑(分支无 checks),rebase 后应触发

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants