llamafile

https://github.com/Mozilla-Ocho/llamafile

llamafile lets you distribute and run LLMs with a single file. (announcement blog post)

Our goal is to make open source large language models much more accessible to both developers and end users. We're doing that by combining llama.cpp with Cosmopolitan Libc into one framework that collapses all the complexity of LLMs down to a single-file executable (called a "llamafile") that runs locally on most computers, with no installation.

The first compelling usage of Cosmopolitan that I've seen. I'm currently downloading mixtral to try it out and see how it works on my machine.