zutto

WeeChat! I’ve been using WeeChat for like 13 years now and I love it. I used to use irssi back in the days and mIRC before irssi existed… Some bitchX experiments may have happened at some point during the shell boom too.

This remote interface is the biggest selling point to me even today, it’s amazing: WeeChat-Android.

Hi!

Great question! I don’t crawl reddit, but this applies to other large sites as well. reddit themselves they have at this very moment banned the ip range where I host my Yacy at (Hetzner). I just looked up from my index that I do have 257k pages indexed from reddit through teddit I used to run, this is from before reddit api-enshittification, going to delete those right now.

And the way how the crawling is done is you define crawling depth, which limits how much content is crawled from the site.

• 0 crawling depth = only the page you send Yacy to, nothing more.
• 1 crawling depth = all the links on the page you send Yacy to
• 2 crawling depth = all links on the page you send Yacy to, and all links on the pages crawled…
• 3 …
• n …

… etc.

I have my tampermonkey scripts set to only crawling depth of 1 at the moment (Just set them to 2 actually, kinda curious how much more I will be crawling), I’ve manually crawled some local news sites as a curiosity at the beginning. And my database is currently relatively small, only around ~86.38 gigabytes according to Yacy. This stores aproximately 2.6 million documents in Yacy’s Solr.

–

Yacy has tons of options for crawling, so you can customize how much it crawls and even filter out overly large sites with maximum number of documents set when you send Yacy there.

–

The tampermonkey script I’ve been talking about in these posts, it’s very simple script: https://github.com/JeremyRand/YaCyIndexerGreasemonkey

Hit me up if you guys have more questions! I’m by no means an expert on Yacy, but I will do my best to answer.

Surprisingly, it’s very doable, requires basic technical knowledge and relatively minimal computing resources (runs in the background on your computer).

https://yacy.net/ Github

I have tampermonkey script that sends yacy to crawl any websites that I visit, and it’s keeping up relatively good index for personal use of the visited websites. Combine yacy with ~300gb of Kiwix databases, add searxng as a frontend and you have pretty strong self hosted search engine.

Of course you need to supplement your searches from other search engines, as yacy does not crawl the whole web, just what you tell it to.

I encourage anyone who’s even slightly interested on this stuff to try Yacy, it’s ancient piece of software, but it still works very well and is not an abandoned project yet!

–

I personally use Yacy mostly on private mode, but it does have the distributed network there as well.

I’ve been using dwm for well over 10 years now… It just works, does what I want. Super easy to extend as well, and I can only blame myself for any bugs.

Kiitän ja kumarran ystävällisestä vastaanotosta!

Testaan kommentteja…

Kagin generoima tiivistelmä uutisesta:

Nainen huijasi satoja netissä – tuomiot eivät pysäyttäneet

• Yhteenveto: Nainen huijasi satoja ihmisiä myymällä olemattomia tuotteita netissä vuosina 2019-2023 ja tuomittiin vankeuteen.

• Mitä tapahtui:

  • Tehtaili 164 petosta joulukuun 2021 ja huhtikuun 2023 välillä.
  • Sai aiemmin ehdonalaisen tuomion 156 petoksesta huhtikuussa 2022, jotka tapahtuivat lokakuun 2019 ja elokuun 2021 välillä.
  • Syyllistyi 100 petokseen tammikuun 2021 ja maaliskuun 2022 välillä.
  • Käytti useita eri nimiä ja myi mm. lastentarvikkeita, naistenvaatteita ja festarilippuja.
  • Petoksista saatu rikoshyöty oli 7 900 euroa.

• Seuraamukset:

  • Tuomittiin 2 vuoden ja 2 kuukauden ehdottomaan vankeuteen 164 petoksesta.
  • Nainen on valittanut tuomiosta, joten se ei ole vielä lainvoimainen.

• Nykytilanne:

  • Nainen on valittanut tuomiostaan, joten hänen tilanteensa on oikeudenkäynnin käsittelyssä.