It's about time we build an easier UX for llama.cpp by @ggml_org 🤗 I've used llama.cpp for better part of last 2 years for playing with LLMs and use it in production too Whilst it takes a bit to setup llama.cpp, once done, it *just* works! Come along with your ideas/ solutions on how we can package it better, and make it easier for people to use llama.cpp with ease ❤️
2,71K