Package your Python applications for redistribution with one click, no compiling, and almost no additional software.

I love the ability to run 'cells' in .py files delimited with # %%. However, the output gets sent to the interactive window, losing the association between code and output. The proposal is the option ...

The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.