4

As of today what would be the best AI to self-host on Linux

posted
by
Avatar
kremata@alien.topB
in
Avatar
main@selfhosted.forum
11 comments
hidereport

I will mainly use it for help in coding and general questions.

Sort:
HotTopControversialNewOld
Avatar
RedditSlayer2020@alien.topB
2 points

None, don’t host it yourself.
You will need a ton of ram and a really powerfull PC. Additionally your electricity bill will go up significantly

permalink
report
reply
Avatar
HoustonBOFH@alien.topB
3 points

You do know this is selfhosted, right? People tell us that what we do is “not a good idea” all the time.

permalink
report
parent
reply
Avatar
RedditSlayer2020@alien.topB
1 point

Im all for selfhosting but LLMs is just stupid. But go for it you do you and evite the ride ♥

permalink
report
parent
reply
Avatar
juanfdo82465@alien.topB
1 point

Agree people be selfhosting to save money in subscriptions but then spend a 4090 and tons of energy to use an LLM from time to time

permalink
report
parent
reply
Avatar
GJT11kazemasin@alien.topB
2 points

Text Generation WebUI, feature-rich. Download models by yourself.

permalink
report
reply
Avatar
MinallWch@alien.topB
2 points

Check ollama.

permalink
report
reply
Avatar
dbossman11@alien.topB
1 point

Ollama is great!

permalink
report
parent
reply
Avatar
kremata@alien.topOPB
1 point

Thanks

permalink
report
parent
reply
Avatar
terAREya@alien.topB
2 points

Cant say enough good things about Serge

​

https://github.com/serge-chat/serge

permalink
report
reply
Avatar
kremata@alien.topOPB
1 point

Look interesting

permalink
report
parent
reply
Avatar
terAREya@alien.topB
1 point

its great and has active development. Hit up the discord, lotta helpful folks in there

permalink
report
parent
reply

Self-Hosted Main

!main@selfhosted.forum

Create post

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don’t control.

For Example

  • Service: Dropbox - Alternative: Nextcloud
  • Service: Google Reader - Alternative: Tiny Tiny RSS
  • Service: Blogger - Alternative: WordPress

We welcome posts that include suggestions for good self-hosted alternatives to popular online services, how they are better, or how they give back control of your data. Also include hints and tips for less technical readers.

Useful Lists

Community stats

  • 1

    Monthly active users

  • 1.8K

    Posts

  • 11K

    Comments

Community moderators