consolidate between llguidance and xgrammar #1004
Description
Metadata
Metadata
Assignees
Labels
Provider-specific work: Ollama, HF, LiteLLM, OpenAI, Bedrock, vLLMOutput formatters, structured output, GraniteFormatter, JSON schema formattingGranite intrinsic adapters: RAG, Guardian, CoreCore abstractions: Context, MOT, SamplingStrategy, formatters, serializationNew feature or requestProblem is clear; implementation approach needs design discussion before work starts
Type
Fields
Give feedbackNo fields configured for Task.
For structured decoding, we utilize llguidance in our regular Mellea code. For intrinsics that utilize granite formatters, we utilize xgrammar. We should see if we can consolidate to llguidance.
The person who takes this task should check in with Fred to see why xgrammar was originally chosen.