Skip to content

Add tool calling and structured outputs to FL SDK v2#456

Merged
kunal-vaishnavi merged 15 commits intomainfrom
kvaishnavi/tool-calling
Feb 26, 2026
Merged

Add tool calling and structured outputs to FL SDK v2#456
kunal-vaishnavi merged 15 commits intomainfrom
kvaishnavi/tool-calling

Conversation

@kunal-vaishnavi
Copy link
Contributor

@kunal-vaishnavi kunal-vaishnavi commented Feb 25, 2026

Description

This PR adds tool calling and structured outputs to Foundry Local SDK v2. Examples using the v2 SDK are shown via interop and HTTP in C#, JavaScript, and TypeScript.

Motivation and Context

Foundry Local SDK v1 supports tool calling and structured outputs. My internal PR adds this support for the v2 SDK and is a dependency for this PR to work.

@vercel
Copy link

vercel bot commented Feb 25, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
foundry-local Ready Ready Preview, Comment Feb 26, 2026 8:52pm

Request Review

Copy link
Contributor

@prathikr prathikr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

will also need to call out this feature in the incoming documentation files (can be in a follow up PR)

#453
#454

@kunal-vaishnavi kunal-vaishnavi merged commit 658e729 into main Feb 26, 2026
14 of 15 checks passed
@kunal-vaishnavi kunal-vaishnavi deleted the kvaishnavi/tool-calling branch February 26, 2026 21:42
prathikr pushed a commit that referenced this pull request Feb 26, 2026
* Add tool calling and structured outputs to FL C# SDK

* Fix JSON parsing and parameter order for unit tests

* Fix order of expected arguments

* Get FL C# SDK E2E samples via interop and web working

* Increase ORT GenAI version to 0.12.1

* Get FL JS SDK E2E samples via interop and web working

* Remove changes made for local testing purposes

* Add changes suggested during PR review

* Separate tool calling examples

* Remove unneeded param attribute

* Update FL Core versions

* Omit passing in FL Core version in C# YAML file for now

* Remove useNightly usage from JS build

* Remove nightly flag from npm install

* Put back useNightly usage in JS build
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants