Running outside Docker

[SoftologyPro]

Any instructions for installing this without needing Docker?

I setup a new Python environment with these commands

python -m pip install --upgrade pip
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts wheel==0.41.2
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts faster-whisper==0.9.0
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts websockets==12.0
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts onnxruntime==1.16.0
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts ffmpeg-python==0.2.0
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts scipy==1.12.0
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts websocket-client==1.7.0
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts tiktoken==0.3.3
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts kaldialign==0.7.2
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts braceexpand==0.1.7
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts openai-whisper==20231117
python.exe -m pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts whisperspeech==0.6
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts soundfile==0.12.1
pip uninstall -y torch
pip install --no-cache-dir --ignore-installed --force-reinstall --no-warn-conflicts torch==2.1.1+cu118 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118

I change into the examples/chatbot/html directory and run python -m http.server
I can open the webpage and click the microphone, but when I speak it is not recognised and/or shown.

What else do I need to run outside Docker?

[makaveli10]

@SoftologyPro Okay, to run outside docker a few things:

• setup your cuda environment, cuda 12.3 preferably

• And install dependencies by running the docker/base-image/install-deps.sh

• Next install tensorrt-llm by running docker/base-image/install-trt-llm.sh

• If everything works as expected, you only need to convert whisper and phi to tensorrt. Use the scripts we provide for the same.

[twmht]

@makaveli10

May i ask how you build this docker image? http://ghcr.io/collabora/whisperbot-base:latest