There was a post asking people their opinions about Edge and many people seemed to liked the idea of Edge and seemed to be ok having it on Linux (Blasphemy)
Also, can we all agree how fast Edge went from joke to a threat? I mean, it’s good now alright! It was good back then, but it’s better now. Money man!!! Money!
Personally I hate MS, but I can’t help but see the fact that there is no alternative to Bing GPT and many features Bing offers on Linux.
If there is an open source ChatGPT how would it look? Who would bear the costs? How would we solve the server problem? i.e., it would take a ton of server space and bandwidth. Just wondering.
I am pretty sure MS products will improve greatly due to their integration with GPT what do us poor folks on Linux do?
Just want to know the answers, I don’t want to discuss (aka can’t comment, I need to study), but just curious!
what do us poor folks on Linux do?
Run llama.cpp and any of the models listed here, that stuff has been around for months.
TheBloke has a lot of models converted to GGUF format which you need for llama.cpp.
Quick Start Guide (requires Nix, otherwise compile llama.cpp manually):
$ GIT_LFS_SKIP_SMUDGE=1 git clone https://huggingface.co/TheBloke/guanaco-7B-GGUF
$ cd guanaco-7B-GGUF
$ git lfs pull --include=Guanaco-7B.Q4_0.gguf
$ nix run github:ggerganov/llama.cpp -- -m Guanaco-7B.Q4_0.gguf --instruct
> Write haiku about a penguin
A penguin walks on ice,
Takes a plunge in the sea,
Hides his feet from me!
I ran it on my pc with a gtx 1070 with cuda enabled and compiled with the cuda compile hint but it ran really slowly how do you get it to run fast?
To make use of GPU acceleration you have to compile it with the proper support (CUDA, OpenCL, ROCM) and add --gpu-layers 16 (or a larger number, however much your VRAM can handle). If that’s not enough, than the GPU/CPU is probably to slow.
You can try a smaller model, those run faster, but give worse results.
KoboldAI has an “KoboldGPT” mode, which is for answering questions. You can try it at https://lite.koboldai.net/ or run it on your own.
Here’s an example conversation I just had with it (emoji icons added):
🤖 Hello, I am KoboldGPT, your personal AI assistant. What would you like to know?
🧑 What is the name of the original version of the game Monopoly?
🤖 The original version of the game Monopoly is called “The Landlord’s Game.” It was created by Elizabeth Magie in the early 20th century. However, the most well-known version of Monopoly today is based on a variant called “Monopoly” that was designed by Charles Darrow in 1935.
🧑 Did “The Landlord’s Game” have any purpose besides being a board game?
🤖 Yes, “The Landlord’s Game” had a specific purpose beyond being a board game. Elizabeth Magie created it as a way to illustrate the negative aspects of concentrating land in private monopolies. She believed that it could be used as a tool for teaching economic concepts such as rent, taxes, and the distribution of wealth.
🧑 What economic ideology was associated with this game?
🤖 Elizabeth Magie was influenced by Henry George’s philosophy of Georgism. Georgists believe that land should belong to all people equally, and that taxation should be based on the value of land rather than on income or production.
Host it locally https://github.com/nomic-ai/gpt4all
i don’t know a single thing about whatever these things your talking about are, but i just want to say, you’re the first person i’ve ever seen suggest that edge isn’t a joke.
