Skip to content

Issues: bentoml/OpenLLM

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

17 Open 255 Closed
17 Open 255 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

feat: OpenLLM integration with Microsoft Word
#1112 opened Nov 21, 2024 by GPTLocalhost
2
bug: there is no reply from ai chat on Safari Mac OS but ok on Chrome browser
#1101 opened Oct 21, 2024 by YuriyGavrilov
bug: llama3.1:8B maximum context length
#1083 opened Sep 18, 2024 by GaetanBaert
2
bug: openllm run phi3:3.8b-ggml-q4 build fails to find FOUNDATION_LIBRARY
#1064 opened Aug 16, 2024 by sij1nk
2
Can openllm support local path model?
#1044 opened Jul 18, 2024 by dsp6414
12
How to deploy a model using a single machine multi card approach?
#1026 opened Jun 25, 2024 by ttaop
1
feat: Include starcoder2
#1025 opened Jun 24, 2024 by kobiche
feat: any plan to support NPU
#951 opened Apr 13, 2024 by zhangxinyang97
1
Deploying LLM in On-Premises Server to Assist Users to Launch Locally in Work Laptop - Web Browser
#934 opened Mar 18, 2024 by sanket038
3
feat: support volta architecture GPUs for the vLLM backend
#930 opened Mar 12, 2024 by K-Mistele
feat: Document usage of request_id
#900 opened Feb 12, 2024 by AlexanderFillbrunn
How to run a docker image on multiple GPUs?
#872 opened Jan 30, 2024 by jeremyadamsfisher
Why change prompt_token_ids depending on encoder_decoder
#851 opened Jan 18, 2024 by meanwo
Docker image for version 0.4.41 not built
#827 opened Jan 4, 2024 by martinkozle
Question about multi-adapter
#656 opened Nov 15, 2023 by KyrieCui
1
feat(client): support wait time for serverless startup time
#607 opened Nov 10, 2023 by aarnphm
feat: support InternLM
#534 opened Oct 28, 2023 by vansin
1
ProTip! Adding no:label will show everything without a label.