redballooon@lemmy.worldtoSelfhosted@lemmy.world•Is anyone self-hosting their own AI?English
22·
21 hours agoI run the AI service (OpenwebUi) myself, but buy the compute on OpenRouter. Self hosting models is not an economic viability for me.
I run the AI service (OpenwebUi) myself, but buy the compute on OpenRouter. Self hosting models is not an economic viability for me.
Drop chats, use a harness. Include somewhere the procedure instructions to always look up documentation before crafting the command. Add instructions somewhere what dependencies you tolerate. Then it’s really good.
Once your tasks get larger, you need additional checks.
They have a flag Zero Data Retention that cones with the promise that after a call no data is kept on any servers. I’m using that.
It’s contract level trust; I wouldn’t bet my life on it, but overall it’s a compromise I’m willing to make.