v0.5.0 - support GGUF models using llama-cpp-python
Breaking changes
completions
is not allowed to be an empty sequence
New features
-
Use GGUF models using the
cappr.llama_cpp.classify
module. Install using:pip install "cappr[llama-cpp]"
See this section of the docs. See this demo for an example.
Bug fixes
None