Skip to content

Commit

Permalink
[Doc] Add xgrammar in doc (vllm-project#11549)
Browse files Browse the repository at this point in the history 
Signed-off-by: ccjincong <[email protected]>
Signed-off-by: xcnick <[email protected]>
  • Loading branch information
@Chen-0210 @xcnick
Chen-0210 authored and xcnick committed Dec 31, 2024
1 parent efea78d commit c715834
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/source/usage/structured_outputs.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

# Structured Outputs

vLLM supports the generation of structured outputs using [outlines](https://github.com/dottxt-ai/outlines) or [lm-format-enforcer](https://github.com/noamgat/lm-format-enforcer) as backends for the guided decoding.
vLLM supports the generation of structured outputs using [outlines](https://github.com/dottxt-ai/outlines), [lm-format-enforcer](https://github.com/noamgat/lm-format-enforcer), or [xgrammar](https://github.com/mlc-ai/xgrammar) as backends for the guided decoding.
This document shows you some examples of the different options that are available to generate structured outputs.

## Online Inference (OpenAI API)
Expand Down

0 comments on commit c715834

Please sign in to comment.