I’m interested in hosting something like this, and I’d like to know experiences regarding this topic.
The main reason to host this for privacy reasons and also to integrate my own PKM data (markdown files, mainly).
Feel free to recommend me videos, articles, other Lemmy communities, etc.
Programming is my main use case for LLMs and I think it’s too slow right now. In the 30 seconds it takes a local llama to give me an answer I’ve already figured it out.
I’m definitely keeping an eye on it though. Our org is really interesting in training models on our code base and customer data.