This entry was edited (10 months ago)
in reply to Micr0byte

Also here is a more detailed breakdown of the planned server specs and spending for Altbot’s transition to a local model:

Link to cost breakdown and planned server spec

reshared this

in reply to Micr0byte

What kind of local model are you planning to run? I'm thinking of doing similar things, and curious about which models are considered good enough for this purpose.

On the frugal end, there are tiny visual models like Florence-2 and SmolVLM that are in principle suitable for generating alt-text for images and that can be run on something like a Raspberry Pi 5 8GB, no GPU needed (though may be too slow for your throughput demands).

in reply to Micr0byte

This is absolutely amazing! we’ve raised 74% of the goal so far! After taxes, the total cost of the server will be $2,282.31, and I’m personally covering the rest beyond $2,000. That means we’re just $520 away from fully funding Altbot’s private, sustainable, and self-hosted future!

If you’d like to help push us to the finish line, you can donate here: ko-fi.com/micr0byte/goal?g=7

Thank you all so much for the overwhelming support. We’re almost there!!