Skip to content

Pull requests: xorbitsai/inference

New pull request New
22 Open 808 Closed
22 Open 808 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

ENH: Supports generate interface for continuous batching enhancement New feature or request
#1621 opened Jun 12, 2024 by ChengjieLi28 Loading… v0.12.1
FEAT: Auto Benchmark for serving feature
#1618 opened Jun 12, 2024 by wxiwnd Loading… v0.12.1
FEAT: glm4-chat support tool call feature
#1617 opened Jun 11, 2024 by codingl2k1 • Draft v0.12.1
1
Remove selected cache models
#1613 opened Jun 11, 2024 by hainaweiben Loading… v0.12.1
ENH: quantization for glm-4v enhancement New feature or request
#1610 opened Jun 10, 2024 by Minamiyama Loading… v0.12.1
1
BUG: Filtering Step for Streaming Responses to Qwen's Tool Calls when using vLLM bug Something isn't working
#1598 opened Jun 6, 2024 by zhanghx0905 Loading… v0.12.1
17
FEAT: tensorizer integration feature
#1579 opened Jun 3, 2024 by Zihann73 Loading… v0.12.1
7
FEAT: Code completions feature
#1476 opened May 11, 2024 by mikeshi80 Loading… v0.12.1
FEAT: theme switch feature
#1335 opened Apr 20, 2024 by Minamiyama Loading… v0.12.1
ENH: Added the check for reserved model uid like "instances", "prompts" etc. enhancement New feature or request
#1303 opened Apr 15, 2024 by mikeshi80 Loading… v0.12.1
ENH: MenuSide: log_out button and highlighting selected nav item enhancement New feature or request
#1285 opened Apr 11, 2024 by Minamiyama Loading… v0.12.1
Fetch from hub
#1160 opened Mar 19, 2024 by mikeshi80 Loading… v0.12.1
3
FEAT: Support TensorRT-LLM backend feature
#646 opened Nov 14, 2023 by aresnow1 • Draft
3 tasks
v0.12.1
1
ENH: sd auto select device enhancement New feature or request
#583 opened Oct 26, 2023 by UranusSeven • Draft v0.12.1
FEAT: Support RWKV Pile feature
#535 opened Oct 13, 2023 by Bojun-Feng • Draft v0.12.1
1
2
ENH: Add Language Settings to Theme enhancement New feature or request
#518 opened Oct 8, 2023 by Bojun-Feng Loading… v0.12.1
1
ENH: Disable 4-bit and 8-bit quantization on MacOS enhancement New feature or request
#507 opened Oct 6, 2023 by Bojun-Feng • Draft v0.12.1
1
2
FEAT: Support Phi-1 & Phi-1.5 feature
#506 opened Oct 5, 2023 by Bojun-Feng • Draft v0.12.1
1
4
ENH: use restful client for generate/chat in in cmdline enhancement New feature or request
#371 opened Aug 21, 2023 by jiayini1119 Loading… v0.12.1
FEAT: Support Launching Model with Uid feature
#358 opened Aug 16, 2023 by Bojun-Feng Loading… v0.12.1
1
1
ENH: Support concurrent embedding, update LangChain QA demo with multithreaded embedding creation enhancement New feature or request
#348 opened Aug 14, 2023 by jiayini1119 Loading… v0.12.1
6
ENH: Add old ui as example enhancement New feature or request
#344 opened Aug 11, 2023 by Bojun-Feng Loading… v0.12.1
4
ProTip! Updated in the last three days: updated:>2024-06-09.