jp6/cu128/: xgrammar-0.1.5 metadata and description
Efficient, Flexible and Portable Structured Generation
author | MLC Team |
classifiers |
|
description_content_type | text/markdown |
keywords | machine learning inference |
license | Apache 2.0 |
requires_dist |
|
requires_python | >=3.8, <4 |
Because this project isn't in the mirror_whitelist
,
no releases from root/pypi are included.
File | Tox results | History |
---|---|---|
xgrammar-0.1.5-cp310-cp310-linux_aarch64.whl
|
|
XGrammar
Efficient, Flexible and Portable Structured Generation
Overview
XGrammar is an open-source library for efficient, flexible, and portable structured generation. It supports general context-free grammar to enable a broad range of structures while bringing careful system optimizations to enable fast executions. XGrammar features a minimal and portable C++ backend that can be easily integrated into multiple environments and frameworks, and is co-designed with the LLM inference engine and enables zero-overhead structured generation in LLM inference.
Get Started
Please visit our documentation to get started with XGrammar.