Skip to content

Issues: triton-inference-server/server

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

476 Open 3,112 Closed
476 Open 3,112 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

How to create one line logs for each ID based on the result?
#7395 opened Jul 1, 2024 by junam2
Triton inference is slower than tensorRT
#7394 opened Jun 30, 2024 by namogg
load failed for model
#7393 opened Jun 28, 2024 by geraldstanje
Error: unpack_from requires a buffer of at least ... bytes for unpacking ... bytes at offset 4 (actual buffer size is ...)
#7391 opened Jun 28, 2024 by adisabolic
How do I optimize a Python BLS model orchestrating onnx models.
#7388 opened Jun 27, 2024 by JamesBowerXanda
1
Support method & signature name selection during Inference
#7387 opened Jun 27, 2024 by asamadiya
Triton Rust Crate as In-Process Inference Engine
#7386 opened Jun 27, 2024 by asamadiya
GPU Scaling issue : multi-gpu inference
#7385 opened Jun 27, 2024 by lionsheep24
Allow building with external dependencies
#7384 opened Jun 27, 2024 by asaff1
The input dimensions received by subsequent nodes in ensemble mode are incorrect
#7383 opened Jun 27, 2024 by SeibertronSS
Building from source fails with tensorrt_llm backend
#7382 opened Jun 27, 2024 by arya-samsung
2
Automatic model type detection
#7381 opened Jun 27, 2024 by dvirmor
Encountered ERROR: The NVIDIA Driver is present, but CUDA failed to initialize. GPU functionality will not be available. error after upgrading CUDA Toolkit to 12.5
#7379 opened Jun 26, 2024 by jackylu0124
Decoupled mode, dimensionality explosion
#7378 opened Jun 26, 2024 by SeibertronSS
Proposal for a Generic Custom Backend Template
#7377 opened Jun 26, 2024 by hrzhao76
Prebuilt Triton Server 24.05-trtllm-python-py3 does not have correct TensorRT version
#7374 opened Jun 25, 2024 by CarterYancey
1
As the number of CPU cores decreases, the BLS mode processing time increases
#7373 opened Jun 25, 2024 by callmezhangchenchenokay
What's the difference when starting tritonserver with mpirun --allow-run-as-root -n 1 /opt/tritonserver/bin/tritonserver vs. /opt/tritonserver/bin/tritonserver directly?
#7371 opened Jun 25, 2024 by so2bin
[k8s-on-prem] Timeout issue with Traefik deployment replicas more than 1
#7370 opened Jun 25, 2024 by Ryan-ZL-Lin
Better doc for different between timeout and client_timeout of grpc_client.infer
#7369 opened Jun 24, 2024 by ShuaiShao93
gRPC Segfaults in Triton 24.05 due to Request Cancellation
#7368 opened Jun 24, 2024 by AshwinAmbal
2
my label_filename don't read I have class0 for label
#7367 opened Jun 24, 2024 by davy-blavette
1
Handling Unsupported Input and Ensuring GPU Processing in Triton Inference Server
#7365 opened Jun 21, 2024 by Bycqg
1
Dynamic batching with OpenVINO backend
#7363 opened Jun 19, 2024 by voganesyan
Model 'tensorrt_llm' loading failed with error: key 'use_context_fmha_for_generation' not found
#7362 opened Jun 18, 2024 by jasonngap1
1
ProTip! Add no:assignee to see everything that’s not assigned.