I’m not an expert on the process, but anyone making a custom repo should be able to store the F-Droid repo on GitHub.
It looks like you wouldn’t need to make the app open-source either, as it should be capable of just accepting an apk file. (and possibly auto update from any GitHub releases page, not sure on that though)
Again, not an expert, I haven’t made an F-Droid repo yet myself, so I may have understood something wrong, but it looks relatively straightforward according to their guide
This wouldn’t make it available to users through the default preinstalled repo in F-Droid (which is heavily privacy-focused and limited in scale) but it would allow any user to just click a link or scan a QR code to add your repo to their F-Droid app.
I don’t know of any super high-quality ones that run well, but the Open Assistant project, (now archived) collected responses from voluntary participants (myself included) to build what is now considered a very high-quality dataset of chat conversation pairs, truly open source, and all voluntarily submitted instead of scraped.
The models are reasonable for fine-tuning, but aren’t very good compared to newer models from large companies.