It would be interesting to have a Large Language Model (LLM) fine-tuned on the ProleWiki and leftist books, as it could be very useful for debunking arguments related to leftist ideology. However, local models are not yet doing search and cited sources, which makes it difficult to trust them. With citations, it is possible to check if the model is referencing what it is citing or just making things up. The inclusion of citations would enable users to verify the references and ensure the model is accurately representing the sources it cites. In the future, when a local platform with search capabilities for LLMs becomes available, it would be interesting to prioritize leftist sources in the search results. Collaboratively curating a list of reliable leftist sources could facilitate this process. What are your thoughts on this?
https://twitter.com/aakashg0/status/1667756466944770048
China made one called InternLM.
Guess what subjects it performs best on?
Mao culture and Marxism.
LLMs output what you put in.
In this case, the Chinese made a communist AI.
That looks fantastic, we could nudge the developers a bit and they’ll likely know how to help out. Sadly I don’t know any Chinese (yet), but nothing is too much of a hurdle for big nerds. The model is so big that HuggingFace was having trouble building it, but people can try it out here now. The English responses are alright and we could probably even just host it somewhere.
Pinging people who showed interest here: @rjs001@lemmygrad.ml, @Alunyanners@lemmygrad.ml, @comradeRichard@lemmygrad.ml, @RedWizard@lemmygrad.ml.
