very cool, just used it with tiny llama. it's neat when you don't need internet for a quick task
These local LLMs might be a perfect mix of efficiency & privacy, guess I finally got to upgrade my 2015 Macbook
I've used this for almost two weeks with Mistral and other models and it's delightful.