The open-source monitoring tool Glances can be used as a Python library in version 4.4.0. It also includes a snapshot mode and many bug fixes.
Mozilla relieves developers: any-llm provides a central API for many LLMs in the background. A multi-tenant gateway manages budgets and keys.