Server
Clients
OS
Khoj version
1.42.10
Describe the bug
I have added llama.cpp and Ollama as AI models APIs.
Whenever I try to add a new model that is of either type, I'm getting a HTTP 500 error.
Current Behavior
The associated python trace is attached.
khoj.log
Expected Behavior
Being able to add a model through the web interface without getting this error
Reproduction Steps
- install khoj through pip as stated in the docs. I'm using
uv and chose the vulkan GPU interface: CMAKE_ARGS="-DGGML_VULKAN=on" FORCE_CMAKE=1 uv pip install 'khoj[local]'
- launch khoj with
USE_EMBEDDED_DB="true" khoj --anonymous-mode
- try to add a model through the web interface
Possible Workaround
No response
Additional Information
No response
Link to Discord or Github discussion
No response
Server
Clients
OS
Khoj version
1.42.10
Describe the bug
I have added llama.cpp and Ollama as AI models APIs.
Whenever I try to add a new model that is of either type, I'm getting a HTTP 500 error.
Current Behavior
The associated python trace is attached.
khoj.log
Expected Behavior
Being able to add a model through the web interface without getting this error
Reproduction Steps
uvand chose the vulkan GPU interface:CMAKE_ARGS="-DGGML_VULKAN=on" FORCE_CMAKE=1 uv pip install 'khoj[local]'USE_EMBEDDED_DB="true" khoj --anonymous-modePossible Workaround
No response
Additional Information
No response
Link to Discord or Github discussion
No response