@mention support (via user ID or phone number) Message history tracking Configurable logging system Full type annotations Pydantic-based data validation Once configured, the MCP server runs ...
I tried to run it on a Python 3.11.4 64-bit + CUDA 12.1 and then with the latest CUDA 12.4.1 environments with llama-cpp-python installed with the adequate wheels, and without wheels through ...