Skip to content

Issues: InftyAI/llmlite

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

Support fall back across several providers feature Categorizes issue or PR as related to a new feature. important-longterm Important over the long term, but may not be staffed and/or may need multiple releases to complete.
#60 opened Jul 1, 2024 by kerthcet v0.0.16
Support counting tokens feature Categorizes issue or PR as related to a new feature.
#59 opened Jul 1, 2024 by kerthcet
vLLM not working as expected with ChatGLM2 bug Categorizes issue or PR as related to a bug.
#55 opened Dec 27, 2023 by kerthcet
Support Stream output
#52 opened Dec 27, 2023 by kerthcet
Support loading different adapter
#51 opened Dec 19, 2023 by kerthcet
Support serving via HTTP/RPC server enhancement New feature or request
#40 opened Nov 28, 2023 by kerthcet
Support serving fine-tuning layers easily enhancement New feature or request
#39 opened Nov 28, 2023 by kerthcet
Integration with langchain enhancement New feature or request
#38 opened Nov 28, 2023 by kerthcet
Support quantization enhancement New feature or request
#37 opened Nov 28, 2023 by kerthcet
support text-generation-inference enhancement New feature or request
#35 opened Nov 28, 2023 by kerthcet
Add codeLlama example documentation Categorizes issue or PR as related to documentation. good first issue Good for newcomers
#33 opened Nov 28, 2023 by kerthcet
Support system_prompt can be empty good first issue Good for newcomers
#31 opened Nov 11, 2023 by kerthcet
recognize model enhancement New feature or request
#30 opened Oct 31, 2023 by Jerry-Kon
Support for StableLM
#11 opened Sep 8, 2023 by kerthcet
Add support to Falcon LLM
#8 opened Sep 7, 2023 by kerthcet
Add support to Claude-2 LLM
#7 opened Sep 7, 2023 by kerthcet
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.