Skip to content

Pull requests: triton-inference-server/tensorrtllm_backend

New pull request New
11 Open 90 Closed
11 Open 90 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Added documentation of using warmups to initialize lora weights
#515 opened Jun 27, 2024 by TheCodeWrangler Loading…
Replace subprocess.Popen with subprocess.run triaged Issue has been triaged by maintainers
#452 opened May 14, 2024 by rlempka Loading…
@byshiue
add speculative decoding example
#432 opened Apr 24, 2024 by XiaobingSuper Loading…
4
Fixed Whitespace Error in Streaming mode
#423 opened Apr 19, 2024 by enochlev Loading…
Update end_to_end_test.py
#409 opened Apr 14, 2024 by r0cketdyne Loading…
fix: add foreground argument
#343 opened Feb 21, 2024 by pfldy2850 Loading…
Expose verbose as pram in launch triton script
#295 opened Jan 12, 2024 by ekagra-ranjan Loading…
Add all_models/bert as an example for tensorrt-llm classification models
#269 opened Dec 31, 2023 by PingNie1 Loading…
@symphonylyh
Add example of tensorrt-llm usage
#225 opened Dec 15, 2023 by Pernekhan Loading…
4
Wrap long command-lines in README.md
#134 opened Nov 15, 2023 by wangkuiyi Loading…
draft pr about non-streaming output
#95 opened Nov 3, 2023 by BasicCoder Loading…
ProTip! Exclude everything labeled bug with -label:bug.