1.2K

What is this? (Its OC!)(lemmy.world)

posted
*
by
Avatar
Smokeydope@lemmy.world
in
Avatar
linuxmemes@lemmy.world
108 comments
hidereport

List of icons/services suggested:

  • Calibre
  • Jitsi
  • Kiwix
  • Monero (Node)
  • Nextcloud
  • Pihole
  • Ollama (Should at least be able to run tiny-llama 1.1B)
  • Open Media Vault
  • Syncthing
  • VLC Media Player Media Server
Sort:
HotTopControversialNewOld
You are viewing a single thread.
View all comments View context
Avatar
brucethemoose@lemmy.world
2 points
*

Can you afford an Arc A770 or an old RTX 3060?

Used P100s are another good option. Even an RTX 2060 would help a ton.

27B is just really chunky on CPU, unfortunately. There’s no way around it. But you may have better luck with MoE models like deepseek chat or Mixtral.

permalink
report
parent
reply

linuxmemes

!linuxmemes@lemmy.world

Create post

I use Arch btw

Sister communities:
Community rules
  1. Follow the site-wide rules and code of conduct
  2. Be civil
  3. Post Linux-related content
  4. No recent reposts

Please report posts and comments that break these rules!

Community stats

  • 7.6K

    Monthly active users

  • 1.2K

    Posts

  • 68K

    Comments

Community moderators