Skip to content

Issues: xorbitsai/inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

354 Open 527 Closed
354 Open 527 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

launch beg-reranker-base error trust_remote_code
#1751 opened Jul 1, 2024 by opsvr202 v0.12.4
1
Gemma2 Supported ?
#1750 opened Jul 1, 2024 by HuuHuy227 v0.12.4
xinference 后端驱动chatglm4-9b-chat，接入到dify/lobe-chat时出错，不能正常回答
#1746 opened Jun 29, 2024 by knightcn1983 v0.12.4
@qinxuye
1
BUG Service Unresponsive with High Request Volume for Unavailable Models
#1743 opened Jun 28, 2024 by gahoo v0.12.4
[Suggestion]Enable Custom Model Store via loading llm_family.json from url.
#1742 opened Jun 28, 2024 by gahoo v0.12.4
BUG 使用glm4的tool call 当重新开始会问，提示报错
#1740 opened Jun 28, 2024 by 13428116504 v0.12.4
@codingl2k1
1
windows环境启动qwen2-instruct报错KeyError
#1739 opened Jun 28, 2024 by BarryCui v0.12.4
Any instruction for deploying faster-whisper question Further information is requested
#1738 opened Jun 28, 2024 by ruifengma v0.12.4
function call时如果问题中缺失参数怎么处理 question Further information is requested
#1736 opened Jun 28, 2024 by mrkingsun v0.12.4
chatglm3 使用agent报错 unhashable type: 'slice'
#1729 opened Jun 27, 2024 by zmh2000829 v0.12.4
2
QUESTION：调用glm4-chat gpu占用100%卡死 gpu question Further information is requested
#1725 opened Jun 27, 2024 by jothewv v0.12.4
BUG 多个请求qwen2-7b模型时，推理会报错 probability tensor contains either inf, nan or element < 0 gpu
#1722 opened Jun 26, 2024 by kolagood v0.12.4
@qinxuye
1
请教大家，客户端数量暴增，并且一直在累计，是什么导致的呢，如何设置最大限制
#1720 opened Jun 26, 2024 by masktone v0.12.4
1
embedding model bge-m3 how to set return_sparse=True ? question Further information is requested
#1716 opened Jun 25, 2024 by colinTmx v0.12.4
2
ValueError: [address=127.0.0.1:37657, pid=3125985] User-specified max_model_len (4096) is greater than the derived max_model_len (seq_length=2048 or model_max_length=None in model's config.json). This may lead to incorrect model outputs or CUDA errors. Make sure the value is correct and within the model context size. gpu question Further information is requested
#1715 opened Jun 25, 2024 by wuliaodeashuai v0.12.4
【BUG】xinference升级0.12.2后运行glm4v出现OOM
#1712 opened Jun 24, 2024 by Yog-AI v0.12.4
5
A bug about the web ui and the llm model. gpu
#1711 opened Jun 24, 2024 by idiotTest v0.12.4
BUG xinference、glm4工具调用报错400
#1699 opened Jun 22, 2024 by JinCheng666 v0.12.4
qwen2工具调用，对话中输出了部分思考过程 gpu
#1696 opened Jun 22, 2024 by JinCheng666 v0.12.4
9
BUG：bce-reranker-base_v1 corpus tensor 超长
#1695 opened Jun 22, 2024 by linhao622 v0.12.4
下载 glm4-chat 提示 Distant resource does not have a Content-Length question Further information is requested
#1694 opened Jun 22, 2024 by 502647092 v0.12.4
1
是否考虑支持Sqlcoder
#1693 opened Jun 22, 2024 by leeyis v0.12.4
3
BUG - Using xinference to reason the qwen1.5 model, the react prompt that hides the "thought" reasoning process leads to a reasoning bug, which prevents the upper-level application layers of the reasoning engine from using the agent normally.
#1691 opened Jun 21, 2024 by okwinds v0.12.4
1
支持昇腾处理器
#1689 opened Jun 21, 2024 by zhubao315 v0.12.4
3
[Suggestion]Image and audio models should download necessary files only.
#1688 opened Jun 21, 2024 by gahoo v0.12.4
ProTip! Type g i on any issue or pull request to go back to the issue listing page.