Skip to content

v0.5.0 - support GGUF models using llama-cpp-python

Compare
Choose a tag to compare
@kddubey kddubey released this 09 Oct 00:51
· 187 commits to main since this release

Breaking changes

  • completions is not allowed to be an empty sequence

New features

  • Use GGUF models using the cappr.llama_cpp.classify module. Install using:

    pip install "cappr[llama-cpp]"
    

    See this section of the docs. See this demo for an example.

Bug fixes

None