Hello! I wrote a simple bot that periodically checks for new reddit posts and posts them to lemmy, so that people migrating from reddit to lemmy can still be able to see their favourite posts, but familiarizing with lemmy.

currently the coments are not synced, but this may change in the future (perhaps)

Yes, it uses the Reddit API, so it will stop working on the 1st of July, but I think that then I can implement a sort of web scraper to access Reddit posts without the official API, so this may eventually keep working for a while.

this script is currently on my laptop so it will be offline most of the time, but if I get the approval I may host it somewhere to get it running 24h/24.

now the question… Is this allowed? having this bot running 24h/24 on large subreddits will mean a very high quantity of posts. will this cause any problem to Lemmy?

if you want a preview check out https://enterprise.lemmy.ml/c/reddit_memes, where I started syncing a few posts from r/memes

let me know your opinion on this!

==== EDIT

here’s the bot source code

The bot is now running in https://sh.itjust.works/c/reddit_memes, let’s try to see if it work (I hope that shit just works)

I’m a bit concerned about the legality of this, if anyone has any info please tell me!

8 points

Not an opinion, but a question - would syncing content from Reddit potentially overwhelm both Lemmy’s servers and its organic content? If posts madenon Lemmy are mixed in with the tidal wave of Reddit material, might that put people off posting on Lemmy at all? Possibly not, just wondering.

permalink
report
reply
3 points

I wondered this a bit too and share your concerns. On one hand I like the idea of populating Lemmy with more content, particularly for niche communities, but there’s also a good amount of unique posts here that might get drowned out.

permalink
report
parent
reply
2 points

Maybe create a specific community that aggregates all the syncs so it doesn’t drown out the original content from lemmy, dunno not the best idea from me but I am slightly concerned if it just ends up a Reddit clone post for post

permalink
report
parent
reply
1 point

This is my question as well, I have no idea

permalink
report
parent
reply
1 point

Something something too much time wondering if they could and not if they should… ;-)

permalink
report
parent
reply
1 point

I thought about this yesterday but definitely don’t have the skills to make it happen. Tbh I would go ahead with it, but know you will be required to moderate the posts. I wouldn’t set it up to post on a community that isn’t yours.

permalink
report
reply
2 points

No of course I would create a specific community for each subreddit I want to sync

Are you referring to moderating the comments? I was thinking of restricting the post privileges to only the bot

permalink
report
parent
reply
2 points

Naw just the posts, I guess it depends on if the Bot is scraping all posts or just the top ones.

permalink
report
parent
reply
10 points

I would create a separate instance for this, I don’t think anybody wants their instance to be flooded with automated posts.

permalink
report
reply
2 points

yes of course!

permalink
report
parent
reply
2 points

Or at least create specific communities, e.g. r/pics to c/reddit-pics

permalink
report
parent
reply
1 point

100% create a separate instance, and allow anyone to add subreddits to your import list. I think this would be hugely helpful!

OP, you’ll probably want to block NSFW content, though.

permalink
report
parent
reply
5 points

This may be against reddits TOS and may have legal consequences. But I guess mostly for the person operating the bot, and not the Lemmy instance, as long as they block the bot on request.

permalink
report
reply
2 points

Do you think this may be “dangerous” for me?

permalink
report
parent
reply
5 points

I have no idea, but at least in EU you may be violating copyright by copying someone else’s database (i.e. collection of data). I am not a lawyer though…

permalink
report
parent
reply
2 points

I Read the terms of service and what I understood is that the intellectual property of the content is the users’, not reddit’s, but I asked on r/legaladvices for security (there is no equivalent community on lemmy yet)

permalink
report
parent
reply
4 points

Given their recent posture and actions, I would think yes it could be an issue for you, for sure. You’d want to check their terms of service as it may violate them. If you’re doing this for fun, add a step in the middle and get ChatGPT to rephrase every post to obfuscate their source :-)

permalink
report
parent
reply
3 points
*

I was thinking of something like that too, but probably never would’ve gotten around to implement it myself, so thanks! Could you put your script on Github or something maybe?

Also it would be great if it could copy at least top-level comments by OP, because that’s often used for linking to a source.

permalink
report
reply
3 points

Yes I’ll upload the code very soon!

Also it would be great if it could copy at least top-level comments by OP, because that’s often used for linking to a source.

Great idea! Thanks!

permalink
report
parent
reply

Lemmy

!lemmy@lemmy.ml

Create post

Everything about Lemmy; bugs, gripes, praises, and advocacy.

For discussion about the lemmy.ml instance, go to !meta@lemmy.ml.

Community stats

  • 862

    Monthly active users

  • 1.1K

    Posts

  • 14K

    Comments

Community moderators