LLM at home

I have been playing a little bit with LLMs at home, following this guide from the Register. That was simple and running slow. I do have some other scenarios where a suitable processor can add to the experience such as with Immich which can do face recognition and image classification. Buying a cheap videocard is an option but something like this looks very interesting. More to tinker with.
I do have to start reading up on performance and power draw and look at what kind of hardware I need to run this in a decent way.

More fun :-)

updatedupdated2024-04-072024-04-07