Skip to content

feat: Autoswap functionality#2080

Merged
LostRuins merged 5 commits intoLostRuins:concedo_experimentalfrom
esolithe:autoswap
Mar 31, 2026
Merged

feat: Autoswap functionality#2080
LostRuins merged 5 commits intoLostRuins:concedo_experimentalfrom
esolithe:autoswap

Conversation

@esolithe
Copy link
Copy Markdown

TLDR

  • Adds the ability to dynamically swap between models within the same config based on the user requests through the router.

Limitations

  • Router mode must be enabled from the start (because it cannot be enabled during admin swapping)
  • When using an omni model (specifically one which supports audio in through it) I do not set the flag. With the way autoswap works, it assumes that if a model path is provided then the API should be enabled for that model when autoswap is on. With MMPROJ files, for vision I'd say it's fine as... well we don't really see any models with audio but not vision, but plenty are visa versa. I think it'll likely be a known limitation as it isn't safe to assume every MMPROJ supports audio.

Copilot AI and others added 5 commits March 28, 2026 23:53
Co-authored-by: esolithe <65901558+esolithe@users.noreply.github.com>
…timeout branch

Agent-Logs-Url: https://github.com/esolithe/esobold/sessions/1ddb3f88-43b4-4234-aa41-0fe6c9976db4

Co-authored-by: esolithe <65901558+esolithe@users.noreply.github.com>
…maining rows

Agent-Logs-Url: https://github.com/esolithe/esobold/sessions/6a2e4ec3-cb19-4f98-b00f-bdb13749ead3

Co-authored-by: esolithe <65901558+esolithe@users.noreply.github.com>
@LostRuins LostRuins added the enhancement New feature or request label Mar 31, 2026
@LostRuins LostRuins merged commit 79209a1 into LostRuins:concedo_experimental Mar 31, 2026
@esolithe esolithe deleted the autoswap branch March 31, 2026 17:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants