I’ve been getting a lot of these messages lately:

SyntaxError: JSON.parse: unexpected character at line 1 column 1 of the JSON data

So I decided to look at the network requests in the browser console. After all, what JSON data was it trying and failing to parse?

Well, turns out that it was pretty much always:

Timeout occurred while waiting for a slot to become available

I don’t do a lot of backend work, but I suspect that the lack of slots might be referring to the server running out of resources to process all of the ongoing user activity concurrently. Could we be running into scaling issues?

96 points

A lot of bots were spamming the instance which was causing an IO bottleneck, and thus timeout issues. We’re looking into solutions to limit their impact, such as rate-limiting users. We’re trying to do it in such a way that it doesn’t impact regular users which is why it’s taking a bit longer.

permalink
report
reply
15 points

Awesome, thanks for the update. You guys rock.

permalink
report
parent
reply
10 points

Does this instance have a bot problem?

permalink
report
parent
reply
14 points
*

Not in the sense of the other servers that were overtaken by botswarms. But there have been a handful of bots recently.

permalink
report
parent
reply
10 points

It’s hard to get a bot onto this instance, but not impossible. Once they’re on here, they can spam out nonsense as fast as the server can take it (hence the rate-limiting solution).

permalink
report
parent
reply

Yea, rate-limiting per user instead of per IP might be a bit more complicated.
Appreciate the work y’all put into this.
You guys seem to handle fine, but if you need to toss a few ideas at a network engineer, ping me.

permalink
report
parent
reply
4 points

Thank you!

permalink
report
parent
reply
31 points

Shit just doesn’t work

permalink
report
reply
3 points
Deleted by creator
permalink
report
parent
reply
23 points

It’s A LOT worse on lemmy.world, I’d say most of the instances are overloaded that prime time instances.

permalink
report
reply
5 points

a .world refuge here, can confirm it’s overloaded, now I’m moving to lemm.ee

permalink
report
parent
reply
5 points

Yea I have an account on both sh.itjust.works and lemm.ee
For the last day or so lemm.ee has been more reliable but otherwise sh.itjust.works was very good too. Ultimately, I feel like this whole thing was meant for having a lot more smaller instances rather than huge ones.

permalink
report
parent
reply
15 points

It was the bot bullshit, as others have said. I was kinda expecting it once I saw the posts about the account spamming new C/s, but it hit harder and longer than I thought it would.

permalink
report
reply
6 points
*

That’s what…she said?

Conversely:

So did that homegrown green

permalink
report
parent
reply
2 points

Lmao!

permalink
report
parent
reply
11 points

theres apparently some bots running around posting from it as well, may or may not be causing extra load

permalink
report
reply

sh.itjust.works Main Community

!main@sh.itjust.works

Create post

Home of the sh.itjust.works instance.

Community stats

  • 963

    Monthly active users

  • 432

    Posts

  • 11K

    Comments