r/RedditSafety • • Jun 04 '25 Helpful

Upholding our Public Content Policy

2 Upvotes

Hi everyone - sharing an update related to our Public Content Policy. Last year we rolled out our Public Content Policy to put guardrails around how Reddit content is managed and to protect user privacy from third party scrapers and LLMs. This policy sets rules on how third parties can use Reddit content – including enforcing downstream deletion rights, user privacy protections, preventing redditors from being spammed using this content – and generally prevents misuse and abuse. We’ve reached a few agreements with partners who share our values around how data should be managed, and in other cases we’ve blocked data scrapers we don’t know or have agreements with. 

Today, we’ve filed a lawsuit against Anthropic for wrongful use of Reddit content. Despite repeated requests to stop, Anthropic has accessed or attempted to access Reddit content more than 100,000 times, months after saying publicly they wouldn’t. While we’d prefer to reach agreements amicably, their unlawful scraping of Reddit data for profit is a blatant disregard for the rights and privacy of our users. We’re filing this lawsuit in line with our Public Content Policy and as our final option to force Anthropic to stop its unlawful practices and abide by its claimed values. 

Reddit is one of the last uniquely human places on the internet – it's clear people want access to that content and it’s our responsibility to be good stewards of Reddit data. 

Because this is an active legal matter, we won’t be able to answer questions today but will come back here with updates when we’re able. For those who want to dive deeper, our legal filing is here.


r/RedditSafety • • Sep 01 '21

COVID denialism and policy clarifications

18.3k Upvotes

“Happy” Wednesday everyone

As u/spez mentioned in his announcement post last week, COVID has been hard on all of us. It will likely go down as one of the most defining periods of our generation. Many of us have lost loved ones to the virus. It has caused confusion, fear, frustration, and served to further divide us. It is my job to oversee the enforcement of our policies on the platform. I’ve never professed to be perfect at this. Our policies, and how we enforce them, evolve with time. We base these evolutions on two things: user trends and data. Last year, after we rolled out the largest policy change in Reddit’s history, I shared a post on the prevalence of hateful content on the platform. Today, many of our users are telling us that they are confused and even frustrated with our handling of COVID denial content on the platform, so it seemed like the right time for us to share some data around the topic.

Analysis of Covid Denial

We sought to answer the following questions:

  • How often is this content submitted?

  • What is the community reception?

  • Where are the concentration centers for this content?

Below is a chart of all of the COVID-related content that has been posted on the platform since January 1, 2020. We are using common keywords and known COVID focused communities to measure this. The volume has been relatively flat since mid last year, but since July (coinciding with the increased prevalence of the Delta variant), we have seen a sizable increase.

The trend is even more notable when we look at COVID-related content reported to us by users. Since August, we see approximately 2.5k reports/day vs an average of around 500 reports/day a year ago. This is approximately 2.5% of all COVID related content.

While this data alone does not tell us that COVID denial content on the platform is increasing, it is certainly an indicator. To help make this story more clear, we looked into potential networks of denial communities. There are some well known subreddits dedicated to discussing and challenging the policy response to COVID, and we used this as a basis to identify other similar subreddits. I’ll refer to these as “high signal subs.”

Last year, we saw that less than 1% of COVID content came from these high signal subs, today we see that it's over 3%. COVID content in these communities is around 3x more likely to be reported than in other communities (this is fairly consistent over the last year). Together with information above we can infer that there has been an increase in COVID denial content on the platform, and that increase has been more pronounced since July. While the increase is suboptimal, it is noteworthy that the large majority of the content is outside of these COVID denial subreddits. It’s also hard to put an exact number on the increase or the overall volume.

An important part of our moderation structure is the community members themselves. How are users responding to COVID-related posts? How much visibility do they have? Is there a difference in the response in these high signal subs than the rest of Reddit?

High Signal Subs

  • Content positively received - 48% on posts, 43% on comments

  • Median exposure - 119 viewers on posts, 100 viewers on comments

  • Median vote count - 21 on posts, 5 on comments

All Other Subs

  • Content positively received - 27% on posts, 41% on comments

  • Median exposure - 24 viewers on posts, 100 viewers on comments

  • Median vote count - 10 on posts, 6 on comments

This tells us that in these high signal subs, there is generally less of the critical feedback mechanism than we would expect to see in other non-denial based subreddits, which leads to content in these communities being more visible than the typical COVID post in other subreddits.

Interference Analysis

In addition to this, we have also been investigating the claims around targeted interference by some of these subreddits. While we want to be a place where people can explore unpopular views, it is never acceptable to interfere with other communities. Claims of “brigading” are common and often hard to quantify. However, in this case, we found very clear signals indicating that r/NoNewNormal was the source of around 80 brigades in the last 30 days (largely directed at communities with more mainstream views on COVID or location-based communities that have been discussing COVID restrictions). This behavior continued even after a warning was issued from our team to the Mods. r/NoNewNormal is the only subreddit in our list of high signal subs where we have identified this behavior and it is one of the largest sources of community interference we surfaced as part of this work (we will be investigating a few other unrelated subreddits as well).

Analysis into Action

We are taking several actions:

  1. Ban r/NoNewNormal immediately for breaking our rules against brigading

  2. Quarantine 54 additional COVID denial subreddits under Rule 1

  3. Build a new reporting feature for moderators to allow them to better provide us signal when they see community interference. It will take us a few days to get this built, and we will subsequently evaluate the usefulness of this feature.

Clarifying our Policies

We also hear the feedback that our policies are not clear around our handling of health misinformation. To address this, we wanted to provide a summary of our current approach to misinformation/disinformation in our Content Policy.

Our approach is broken out into (1) how we deal with health misinformation (falsifiable health related information that is disseminated regardless of intent), (2) health disinformation (falsifiable health information that is disseminated with an intent to mislead), (3) problematic subreddits that pose misinformation risks, and (4) problematic users who invade other subreddits to “debate” topics unrelated to the wants/needs of that community.

  1. Health Misinformation. We have long interpreted our rule against posting content that “encourages” physical harm, in this help center article, as covering health misinformation, meaning falsifiable health information that encourages or poses a significant risk of physical harm to the reader. For example, a post pushing a verifiably false “cure” for cancer that would actually result in harm to people would violate our policies.

  2. Health Disinformation. Our rule against impersonation, as described in this help center article, extends to “manipulated content presented to mislead.” We have interpreted this rule as covering health disinformation, meaning falsifiable health information that has been manipulated and presented to mislead. This includes falsified medical data and faked WHO/CDC advice.

  3. Problematic subreddits. We have long applied quarantine to communities that warrant additional scrutiny. The purpose of quarantining a community is to prevent its content from being accidentally viewed or viewed without appropriate context.

  4. Community Interference. Also relevant to the discussion of the activities of problematic subreddits, Rule 2 forbids users or communities from “cheating” or engaging in “content manipulation” or otherwise interfering with or disrupting Reddit communities. We have interpreted this rule as forbidding communities from manipulating the platform, creating inauthentic conversations, and picking fights with other communities. We typically enforce Rule 2 through our anti-brigading efforts, although it is still an example of bad behavior that has led to bans of a variety of subreddits.

As I mentioned at the start, we never claim to be perfect at these things but our goal is to constantly evolve. These prevalence studies are helpful for evolving our thinking. We also need to evolve how we communicate our policy and enforcement decisions. As always, I will stick around to answer your questions and will also be joined by u/traceroo our GC and head of policy.


r/RedditSafety • • Feb 04 '25 This Helpful Love

Taking action on rule-violating content

301 Upvotes

Over the last few days, we’ve seen an increase in content in several communities that violate Reddit Rules. Reddit communities are places for civil discussion and are one of the few places online where people can exchange ideas and perspectives. We want to ensure that they continue to be a place for healthy debate no matter the topic. Debate and dissent are welcome on Reddit—threats and doxing are not.

When we identify communities experiencing an increase in rule-violating content, we are taking the following steps as needed:

  • Reaching out to moderators to ensure they have the support they need, including turning on safety tools, reminding mods of our rules, or offering additional moderation support

  • Adding a popup to remind users before visiting that subreddit of Reddit’s Rules

  • In some cases, placing a temporary ban on the community for 72 hours to enable us to engage with moderation teams and review and remove violating content

Currently r/WhitePeopleTwitter is under a temporary ban. This means that you will not be able to access this community during this cooling-off period while we work with the mods to ensure it is a safe place for discussion.

We will continue to monitor and reach out to communities experiencing a surge in violative content and will take the necessary actions noted above to ensure all communities can provide a safe environment for healthy conversation.


r/RedditSafety • • Feb 15 '19

Introducing r/redditsecurity

2.7k Upvotes

We wanted to take the opportunity to share a bit more about the improvements we have been making in our security practices and to provide some context for the actions that we have been taking (and will continue to take). As we have mentioned in different places, we have a team focused on the detection and investigation of content manipulation on Reddit. Content manipulation can take many forms, from traditional spam and upvote manipulation to more advanced, and harder to detect, foreign influence campaigns. It also includes nuanced forms of manipulation such as subreddit sabotage, where communities actively attempt to harm the experience of other Reddit users.

To increase transparency around how we’re tackling all these various threats, we’re rolling out a new subreddit for security and safety related announcements (r/redditsecurity). The idea with this subreddit is to start doing more frequent, lightweight posts to keep the community informed of the actions we are taking. We will be working on the appropriate cadence and level of detail, but the primary goal is to make sure the community always feels informed about relevant events.

Over the past 18 months, we have been building an operations team that partners human investigators with data scientists (also human…). The data scientists use advanced analytics to detect suspicious account behavior and vulnerable accounts. Our threat analysts work to understand trends both on and offsite, and to investigate the issues detected by the data scientists.

Last year, we also implemented a Reliable Reporter system, and we continue to expand that program’s scope. This includes working very closely with users who investigate suspicious behavior on a volunteer basis, and playing a more active role in communities that are focused on surfacing malicious accounts. Additionally, we have improved our working relationship with industry peers to catch issues that are likely to pop up across platforms. These efforts are taking place on top of the work being done by our users (reports and downvotes), moderators (doing a lot of the heavy lifting!), and internal admin work.

While our efforts have been driven by rooting out information operations, as a byproduct we have been able to do a better job detecting traditional issues like spam, vote manipulation, compromised accounts, etc. Since the beginning of July, we have taken some form of action on over 13M accounts. The vast majority of these actions are things like forcing password resets on accounts that were vulnerable to being taken over by attackers due to breaches outside of Reddit (please don’t reuse passwords, check your email address, and consider setting up 2FA) and banning simple spam accounts. By improving our detection and mitigation of routine issues on the site, we make Reddit inherently more secure against more advanced content manipulation.

We know there is still a lot of work to be done, but we hope you’ve noticed the progress we have made thus far. Marrying data science, threat intelligence, and traditional operations has proven to be very helpful in our work to scalably detect issues on Reddit. We will continue to apply this model to a broader set of abuse issues on the site (and keep you informed with further posts). As always, if you see anything concerning, please feel free to report it to us at [email protected].

[edit: Thanks for all the comments! I'm signing off for now. I will continue to pop in and out of comments throughout the day]


r/RedditSafety • • Dec 06 '19

Suspected Campaign from Russia on Reddit

54.3k Upvotes

We were recently made aware of a post on Reddit that included leaked documents from the UK. We investigated this account and the accounts connected to it, and today we believe this was part of a campaign that has been reported as originating from Russia.

Earlier this year Facebook discovered a Russian campaign on its platform, which was further analyzed by the Atlantic Council and dubbed “Secondary Infektion.” Suspect accounts on Reddit were recently reported to us, along with indicators from law enforcement, and we were able to confirm that they did indeed show a pattern of coordination. We were then able to use these accounts to identify additional suspect accounts that were part of the campaign on Reddit. This group provides us with important attribution for the recent posting of the leaked UK documents, as well as insights into how adversaries are adapting their tactics.

In late October, an account u/gregoratior posted the leaked documents and later reposted by an additional account u/ostermaxnn. Additionally, we were able to find a pocket of accounts participating in vote manipulation on the original post. All of these accounts have the same shared pattern as the original Secondary Infektion group detected, causing us to believe that this was indeed tied to the original group.

Outside of the post by u/gregoratior, none of these accounts or posts received much attention on the platform, and many of the posts were removed either by moderators or as part of normal content manipulation operations. The accounts posted in different regional subreddits, and in several different languages.

Karma distribution:

  • 0 or less: 42

  • 1 - 9: 13

  • 10 or greater: 6

  • Max Karma: 48

As a result of this investigation, we are banning 1 subreddit and 61 accounts under our policies against vote manipulation and misuse of the platform. As we have done with previous influence operations, we will also preserve these accounts for a time, so that researchers and the public can scrutinize them to see for themselves how these accounts operated.

EDIT: I'm signing off for the evening. Thanks for the comments and questions.

gregoratiorLuzRunMcDownesdavidjgloverHarrisonBriggs
BillieFolmarjaimeibanezrobehartyfeliciahoggKlausSteiner
alabelmbernturmannAntonioDiazzciawahhedkrakodoc
PeterMurtaughblancoalesszurabagriashvilisaliahwhitefullekyl
RinzoogalmanzamaryDefiant_EmuOstermaxnnLauraKnecht
MikeHanonestellatorresPastJournalistKattyTorrTomSallee
uzunadnanEllisonRedfallvasiliskusKimJjjNicSchum
lauraferrojochavezsergMaryCWolfCharlesRichardsonbrigittemaur
MilitaryObserverbellagaraStevtBellSherryNunodelmaryang
RuffMoultonfrancovazvictoriasanchesPushyFrank
kempnaomiclaudialopezzFeistyWeddingdemomanz
MaxKasyangarrypughParty_Actuaryrabbier
davecooperrgilbmedina84ZayasLiTelRitterc

edit:added subreddit link


r/RedditSafety • • Jul 06 '23

Content Policy updates: clarifying Rule 3 (non-consensual intimate media) and expanding Rule 4 (minor safety)

47 Upvotes

Hello Reddit Community,

Today, we're rolling out updates to Rule 3 and Rule 4 of our Content Policy to clarify the scope of these rules and give everyone a better sense of the types of content and behaviors that are not allowed on Reddit. This is part of our ongoing work to be transparent with you about how we’re evolving our sitewide rules to keep Reddit safe and healthy.

First, we're updating the language of our Rule 3 policy prohibiting non-consensual intimate media to more specifically address AI-generated sexual media. While faked depictions of non-consensual intimate media are already prohibited, this update makes it clear that sexually explicit AI-generated content violates our rules if it depicts a real, identifiable person.

This update also clarifies that AI-generated sexual media that depict fictional people, or artistic depictions such as cartoons or anime whether AI-generated or not, do not fall under this rule. Keep in mind however that this type of media may violate subreddit-specific rules or other policies (such as our policy against copyright infringement), which our Safety teams already enforce across the platform.

Sidenote: Reddit also leverages StopNCII.org, a free, online tool that supports platforms to detect and remove non-consensual intimate media while protecting the victim’s privacy. You can read more information about how StopNCII.org works here. If you've been affected by this issue, you can access the tool here.

Now to Rule 4. While the vast majority of Reddit users are adults, it is critical that our community continues to prioritize the safety, security, and privacy of minors regardless of their engagement with our platform. Given the importance of minor safety, we are expanding the scope of this Rule to also prohibit non-sexual forms of abuse of minors (e.g., neglect, physical or emotional abuse, including, for example, videos of things like physical school fights). This represents a new violative content category.

Additionally, we already interpret Rule 4 to prohibit inappropriate and predatory behaviors involving minors (e.g., grooming) and actively enforce against this content. In line with this, we’re adding language to Rule 4 to make this even clearer.

You'll also note that we're parting ways with some outdated terminology (e.g., "child pornography") and adding specific examples of violative content and behavior to shed light on our interpretation of the rule.

As always, to help keep everyone safe, we encourage you to flag potentially violative content by using the in-line report feature on the app or website, or by visiting this page.

That's all for now, and I'll be around for a bit to answer any questions on this announcement!


r/RedditSafety • • Sep 19 '19

An Update on Content Manipulation… And an Upcoming Report

5.1k Upvotes

TL;DR: Bad actors never sleep, and we are always evolving how we identify and mitigate them. But with the upcoming election, we know you want to see more. So we're committing to a quarterly report on content manipulation and account security, with the first to be shared in October. But first, we want to share context today on the history of content manipulation efforts and how we've evolved over the years to keep the site authentic.

A brief history

The concern of content manipulation on Reddit is as old as Reddit itself. Before there were subreddits (circa 2005), everyone saw the same content and we were primarily concerned with spam and vote manipulation. As we grew in scale and introduced subreddits, we had to become more sophisticated in our detection and mitigation of these issues. The creation of subreddits also created new threats, with “brigading” becoming a more common occurrence (even if rarely defined). Today, we are not only dealing with growth hackers, bots, and your typical shitheadery, but we have to worry about more advanced threats, such as state actors interested in interfering with elections and inflaming social divisions. This represents an evolution in content manipulation, not only on Reddit, but across the internet. These advanced adversaries have resources far larger than a typical spammer. However, as with early days at Reddit, we are committed to combating this threat, while better empowering users and moderators to minimize exposure to inauthentic or manipulated content.

What we’ve done

Our strategy has been to focus on fundamentals and double down on things that have protected our platform in the past (including the 2016 election). Influence campaigns represent an evolution in content manipulation, not something fundamentally new. This means that these campaigns are built on top of some of the same tactics as historical manipulators (certainly with their own flavor). Namely, compromised accounts, vote manipulation, and inauthentic community engagement. This is why we have hardened our protections against these types of issues on the site.

Compromised accounts

This year alone, we have taken preventative actions on over 10.6M accounts with compromised login credentials (check yo’ self), or accounts that have been hit by bots attempting to breach them. This is important because compromised accounts can be used to gain immediate credibility on the site, and to quickly scale up a content attack on the site (yes, even that throwaway account with password = Password! is a potential threat!).

Vote Manipulation

The purpose of our anti-cheating rules is to make it difficult for a person to unduly impact the votes on a particular piece of content. These rules, along with user downvotes (because you know bad content when you see it), are some of the most powerful protections we have to ensure that misinformation and low quality content doesn’t get much traction on Reddit. We have strengthened these protections (in ways we can’t fully share without giving away the secret sauce). As a result, we have reduced the visibility of vote manipulated content by 20% over the last 12 months.

Content Manipulation

Content manipulation is a term we use to combine things like spam, community interference, etc. We have completely overhauled how we handle these issues, including a stronger focus on proactive detection, and machine learning to help surface clusters of bad accounts. With our newer methods, we can make improvements in detection more quickly and ensure that we are more complete in taking down all accounts that are connected to any attempt. We removed over 900% more policy violating content in the first half of 2019 than the same period in 2018, and 99% of that was before it was reported by users.

User Empowerment

Outside of admin-level detection and mitigation, we recognize that a large part of what has kept the content on Reddit authentic is the users and moderators. In our 2017 transparency report we highlighted the relatively small impact that Russian trolls had on the site. 71% of the trolls had 0 karma or less! This is a direct consequence of you all, and we want to continue to empower you to play a strong role in the Reddit ecosystem. We are investing in a safety product team that will build improved safety (user and content) features on the site. We are still staffing this up, but we hope to deliver new features soon (including Crowd Control, which we are in the process of refining thanks to the good feedback from our alpha testers). These features will start to provide users and moderators better information and control over the type of content that is seen.

What’s next

The next component of this battle is the collaborative aspect. As a consequence of the large resources available to state-backed adversaries and their nefarious goals, it is important to recognize that this fight is not one that Reddit faces alone. In combating these advanced adversaries, we will collaborate with other players in this space, including law enforcement, and other platforms. By working with these groups, we can better investigate threats as they occur on Reddit.

Our commitment

These adversaries are more advanced than previous ones, but we are committed to ensuring that Reddit content is free from manipulation. At times, some of our efforts may seem heavy handed (forcing password resets), and other times they may be more opaque, but know that behind the scenes we are working hard on these problems. In order to provide additional transparency around our actions, we will publish a narrow scope security-report each quarter. This will focus on actions surrounding content manipulation and account security (note, it will not include any of the information on legal requests and day-to-day content policy removals, as these will continue to be released annually in our Transparency Report). We will get our first one out in October. If there is specific information you’d like or questions you have, let us know in the comments below.

[EDIT: Im signing off, thank you all for the great questions and feedback. I'll check back in on this occasionally and try to reply as much as feasible.]


r/RedditSafety • • Jul 14 '25

UK Verifying the age (but not the identity) of UK redditors

230 Upvotes

TL;DR: 

Reddit was built on the principle that you shouldn’t need to share personal information to participate in meaningful discussions. Unlike platforms that are identity-based and cater to the famous (or those that want to become famous), Reddit has always favored upvoting great posts and comments by people who use whimsical usernames and not their real name. These conversations are often more candid and real than those that force you to share your real-world identity. 

However, while we still don’t want to know who you are on Reddit, there are certainly situations where it would be helpful if we knew a little more about you. For example, in the new age of AI, we would like to be able to confirm whether you are a human being or not (more to come about that later). And it would be helpful for our safety efforts to be able to confirm whether you are a child or an adult. Also, there are a growing number of jurisdictions that have considered or have passed laws requiring platforms to verify the ages of their users. 

If you are in the UK…

Notably, the UK Online Safety Act has new requirements to implement additional measures to prevent children from accessing age-inappropriate content. So, starting July 14 in the UK, we will begin collecting and verifying your age before you can view certain mature content. 

We have tried to do this in a way that protects the privacy of UK redditors. To verify your age, we partner with a trusted third-party provider (Persona) who performs the verification on either an uploaded selfie or a photo of your government ID. Reddit will not have access to the uploaded photo, and Reddit will only store your verification status along with the birthdate you provided so you won’t have to re-enter it each time you try to access restricted content. Persona promises not to retain the photo for longer than 7 days and will not have access to your Reddit data such as the subreddits you visit. Your birthdate is never visible to other users or advertisers, and is used to support safety features and age-appropriate experiences on Reddit. You can learn more about how age verification works here and about what content is restricted here. 

For the rest of Reddit…

As laws change, we may need to collect and/or verify age in places other than the UK. Accordingly, we are also introducing globally an option for you to provide your birthdate to optimize your Reddit experience, for example to help ensure that content and ads are age-appropriate. This is optional, and you won’t be required to provide it unless you live in a place (like the UK) where we are required to ask for it.  And, again, your birthdate is never visible to other users or advertisers. 

As always, you should only share what personal details you are comfortable sharing on Reddit. Using Reddit has never required disclosing your real world identity, and these updates don't change that.

UPDATE: Thanks to everyone for your comments (we have been reading them, even if we didn't respond to each one). Fyi, we know that Anonymous Browsing is not appearing for some UK redditors. We are having issues supporting anonymous browsing with this current rollout of age verification. If you have any questions or other issues, please check out these FAQs before reporting.


r/RedditSafety • • Oct 09 '25

Sharing our latest Transparency Report and Reddit Rules updates (evolving Rules 2, 5, and 7)

60 Upvotes

Hello redditors, 

This is u/ailewu from Reddit’s Trust & Safety Policy team! We’re excited to share updates about our ongoing efforts to keep redditors safe and foster healthy participation across the platform. Specifically, we’ve got fresh data and insights in our latest Transparency Report, and some new clarifications to the Reddit Rules regarding community disruption, impersonation, and prohibited transactions.  

Reddit Transparency Report

Reddit’s biannual Transparency Report highlights the impact of our work to keep Reddit healthy and safe. We include insights and metrics on our layered, community-driven approach to content moderation, as well as information about legal requests we received from governments, law enforcement agencies, and third parties around the world to remove content or disclose user data.

This report covers the period from January through June 2025, and reflects our always-on content moderation efforts to safeguard open discourse on Reddit. Here are some key highlights:

Keeping Reddit Safe

Of the nearly 6 billion pieces of content shared, approximately 2.66% was removed by mods and admins combined. Excluding spam, this figure drops to 1.94%, with 1.41% being done by mods, and 0.53% being done by admins. These removals occurred through a combination of manual and automated means, including enhanced AI-based methods:

  • For posts and comments, 87.1% of reports/flags that resulted in admin review were surfaced proactively by our systems. Similarly, for chat messages, Reddit automation accounted for 98.9% of reports/flags to admins.

  • We've observed an overall decline in spam attacks, leading to a corresponding decrease in the volume of spam removals.

  • We rapidly scaled up new automated systems to detect and action content violating our policies against the incitement of violence. We also rolled out a new enforcement action to warn users who upvote multiple pieces of violating, violent content within a certain timeframe.

  • Excluding spam and other content manipulation, mod removals represented 73% of content removals, while admin removals for sitewide Reddit Rules violations increased to 27%, up from 23.9% in the prior period–a steady increase coinciding with improvements to our automated tooling and processing. (Note mod removals include content removed for violating community-specific rules, whereas admins only remove content for violating our sitewide rules). 

Communities Playing Their Part

Mods play a critical role in curating their communities by removing content based on community-specific rules. In this period: 

  • Mods removed 8,493,434,971 pieces of content. The majority of these removals (71.3%) were the result of proactive removals by Automod. 

  • We investigated and actioned 948 Moderator Code of Conduct reports. Admins also sent 2,754 messages as part of educational and enforcement outreach efforts.

  • 96.5% of non-spam related community bans were due to communities being unmoderated.

Upholding User Rights

We continue to invest heavily in protecting users from the most serious harms while defending their privacy, speech, and association rights:

  • With regard to global legal requests from government and law enforcement agencies, we received 27% more legal requests to remove content, and saw a 12% increase in non-emergency legal requests for account information. 

    • We carefully scrutinize every request to ensure it is legally valid and narrowly tailored, and include more details on how we’ve responded in the latest report

  • Importantly, we caught and rejected 10 fraudulent legal requests (3 requests to remove content; 7 requests for user account information) purporting to come from legitimate government or law enforcement agencies. We reported these fake requests to real law enforcement authorities.

We invite you to head on over to our Transparency Center to read the rest of the latest report after you check out the Reddit Rules updates below.

Evolving and Clarifying our Rules

As you may know, part of our work is evolving and providing more clarity around the sitewide Reddit Rules. Specifically, we've updated Rules 2, 5, 7, and their corresponding Help Center articles to provide more examples of what may or may not be violating, set clearer expectations with our community, and make these rules easier to understand and enforce. The scope of violations these Rules apply to includes: 

We'd like to thank the group of mods from our Safety Focus Group, with whom we consulted before finalizing these updates, for their thoughtful feedback and dedication to Reddit! 

One more thing to note: going forward, we’re planning to share Reddit Rules updates twice a year, usually in Q1 and Q3. Look out for the next one in early 2026! 

This is it for now, but I'll be around to answer questions for a bit.


r/RedditSafety • • Mar 04 '25

Findings of our investigation into claims of manipulation on Reddit

300 Upvotes

Over the last couple of years, there have been several events that have greatly impacted people’s lives and how they communicate online. The terrorist attacks of October 7th is one such event. In addition, the broader trend towards political discourse seeping into our daily lives (even if we hate politics) has meant that even our favorite meme subs are now often filled with politics. This is a noticeable trend that we will talk about more in a future post.

Tl;dr A couple weeks ago there were allegations that a network of moderators were attempting to infiltrate Reddit and were responsible for shifting the narrative in many large communities and spreading terrorist propaganda. This is in violation of Reddit’s Rules. We take any manipulation claim seriously, and we investigated twenty communities including r/palestine, r/documentaries, r/therewasanattempt, and others*. While we did not find widespread manipulation in these communities or evidence of mods infiltrating communities and injecting content sourced from terrorist organizations, we did uncover some issues that we are addressing.

We investigated alleged moderator connections to US-designated terrorist organizations.

  • We didn’t find any evidence of moderators posting or promoting terrorist propaganda on Reddit, however, we don’t have visibility into moderator activities outside of Reddit. 

  • We will continue to collect information, and if we learn more, we will take appropriate action.

We investigated alleged dissemination of terrorist propaganda.

  • We found: 

    • Four pieces of terrorist propaganda (none posted by the mods). Two of the posts flagged were made by an account that had already been banned in August 2024 for posting other terrorist propaganda, but we had failed to remove all the historical content associated with the account. We have since run a retroactive process to remove all the content they posted. The other two accounts were actioned as a result of this investigation

  • Actions we are taking:

    • While not widespread on Reddit, we have banned links to the Resistance News Network (RNN), and we are also improving our terrorism detection for content shared via screenshots.

    • We will remove all account content when a user is banned for posting terrorist material and will continue to report terrorist content removals in our transparency report.

We investigated whether a network of moderators were interfering or having an unnatural influence. 

  • We found:

    • Moderator contributions in the communities we investigated represented <1%  of overall contributions, and this is less than the typical level of mods site-wide.

    • Content about Israel, Palestine, Hamas, Hezbollah, Gaza, etc. made up a low percentage of posts in non-Middle East-related communities ranging from as little as 0.7% to 6% of total contributions. With the exception of a single post, these were not made by the moderators of the communities we investigated. 

  • Actions we are taking:

    • We are expanding our vote manipulation monitoring to detect smaller-scale manipulation attempts.

    • We are also analyzing moderator network influence beyond the twenty communities we investigated and are evaluating governance and moderator influence features to ensure community diversity. 

We investigated alleged censorship of opposing views via systematic removal of pro-Israel or anti-Palestine content in large subreddits covering non-Middle East topics.

  • We found:

    • While the moderators' removal actions do include some political content, the takedowns were in line with respective subreddit rules, did not focus on Israel/Palestine issues, did not demonstrate a discernible bias, and did not display anomalies when compared with other mod teams. 

    • Moderators across the ideological spectrum are sometimes relying on bots to preemptively ban users from their communities based on their participation in other communities.  

  • Actions we are taking:

    • Banning users based on participation in other communities is undesirable behavior, and we are looking into more sophisticated tools for moderators to manage conversations, such as identifying and limiting action to engaged members and evaluating the role of ban bots.

We investigated anomalous cross-posting behavior that is non-violating but signals potential coordination.

We found:

  • Some users systematically cross-posting political content from some smaller news-related subreddits. 

Actions we are taking:

  • We turned off cross-posting functionality in these communities to prevent potential influence.

  • We also launched a new project to investigate anomalous high-volume cross-posting as an indicator of potentially nefarious activity.

In the coming weeks, we’ll share our observations and insights on the prevalence of political conversations and what we are doing to help communities handle opposing views civilly and in accordance with their rules. We will continue strengthening and reinforcing our detection and enforcement techniques to safeguard against attempts to manipulate on Reddit while maintaining our commitment to free expression and association.

*Communities investigated: documentaries, palestine, boringdystopia, israelcrimes, publicfreakout, enlightenedcentrism, morbidreality, palestinenews, thatsactuallyverycool, therewasanattempt, iamatotalpieceofshit, ApartheidIsrael, panarab, fight_disinformation, Global_News_Hub, suppressed_news, ToiletPaperUSA, TrueAnon, Fauxmoi, irleastereggs


r/RedditSafety • • Apr 16 '24

Reddit Transparency Report: Jul-Dec 2023

64 Upvotes

Hello, redditors!

Today we published our Transparency Report for the second half of 2023, which shares data and insights about our content moderation and legal requests from July through December 2023.

Reddit’s biannual Transparency Reports provide insights and metrics about content that was removed from Reddit – including content proactively removed as a result of automated tooling, accounts that were suspended, and legal requests we received from governments, law enforcement agencies, and third parties from around the world to remove content or disclose user data.

Some key highlights include:

  • Content Creation & Removals:

    • Between July and December 2023, redditors shared over 4.4 billion pieces of content, bringing the total content on Reddit (posts, comments, private messages and chats) in 2023 to over 8.8 billion. (+6% YoY). The vast majority of content (~96%) was not found to violate our Content Policy or individual community rules.

      • Of the ~4% of removed content, about half was removed by admins and half by moderators. (Note that moderator removals include removals due to their individual community rules, and so are not necessarily indicative of content being unsafe, whereas admin removals only include violations of our Content Policy).

      • Over 72% of moderator actions were taken with Automod, a customizable tool provided by Reddit that mods can use to take automated moderation actions. We have enhanced the safety tools available for mods and expanded Automod in the past year. You can see more about that here.

      • The majority of admin removals were for spam (67.7%), which is consistent with past reports.

    • As Reddit's tools and enforcement capabilities keep evolving, we continue to see a trend of admins gradually taking on more content moderation actions from moderators, leaving moderators more room to focus on their individual community rules.

      • We saw a ~44% increase in the proportion of non-spam, rule-violating content removed by admins, as opposed to mods (admins remove the majority of spam on the platform using scaled backend tooling, so excluding it is a good way of understanding other Content Policy violations).

  • New “Communities” Section

    • We’ve added a new “Communities” section to the report to highlight subreddit-level actions as well as admin enforcement of Reddit’s Moderator Code of Conduct.

  • Global Legal Requests

    • We continue to process large volumes of global legal requests from around the world. Interestingly, we’ve seen overall decreases in global government and law enforcement legal requests to remove content or disclose account information compared to the first half of 2023.

      • We routinely push back on overbroad or otherwise objectionable requests for account information, and fight to ensure users are notified of requests.

      • In one notable U.S. request for user information, we were served with a sealed search warrant from the LAPD seeking records for an account allegedly involved in the leak of an LA City Council meeting recording that resulted in the resignation of prominent, local political leaders. We fought to notify the account holder about the warrant, and while we didn’t prevail initially, we persisted and were eventually able to get the warrant and proceedings unsealed and provide notice to the redditor.

You can read more insights in the full document: Transparency Report: July to December 2023. You can also see all of our past reports and more information on our policies and procedures in our Transparency Center.

Please let us know in the comments section if you have any questions or are interested in learning more about other data or insights.


r/RedditSafety • • Feb 20 '25

Addressing claims of manipulation on Reddit

185 Upvotes

There have been claims of a coordinated effort to manipulate Reddit and inject terrorist content to influence a handful of communities. We take this seriously, and we have not identified widespread terrorist content on Reddit. 

Reddit’s Rules explicitly prohibit terrorist content, and our teams work consistently to remove violating content from the platform and prevent it from being shared again. Check out our Transparency Report for details. Additionally, we use internal tools to flag potentially harmful, spammy, or inauthentic content and hash known violative content. Often, this means we can remove this content before anyone sees it. Reddit is part of industry efforts to fight other dangerous and illegal content. For example, Reddit participates in Tech Against Terrorism’s TCAP alert system as well as its hashing system, giving us automated alerts for any terrorist content found on Reddit allowing us to investigate, remove, and report to law enforcement. We are also regularly in touch with government agencies dedicated to fighting terrorism.

We continue to investigate claims of whether there is coordinated manipulation that violates our policies and undermines the expectations of the community. We will share the results and actions of our investigation in a follow-up post.


r/RedditSafety • • Mar 05 '25 Polished Gold Turd Furious Love

Warning users that upvote violent content

0 Upvotes

Today we are rolling out a new (sort of) enforcement action across the site. Historically, the only person actioned for posting violating content was the user who posted the content. The Reddit ecosystem relies on engaged users to downvote bad content and report potentially violative content. This not only minimizes the distribution of the bad content, but it also ensures that the bad content is more likely to be removed. On the other hand, upvoting bad or violating content interferes with this system. 

So, starting today, users who, within a certain timeframe, upvote several pieces of content banned for violating our policies will begin to receive a warning. We have done this in the past for quarantined communities and found that it did help to reduce exposure to bad content, so we are experimenting with this sitewide. This will begin with users who are upvoting violent content, but we may consider expanding this in the future. In addition, while this is currently “warn only,” we will consider adding additional actions down the road.

We know that the culture of a community is not just what gets posted, but what is engaged with. Voting comes with responsibility. This will have no impact on the vast majority of users as most already downvote or report abusive content. It is everyone’s collective responsibility to ensure that our ecosystem is healthy and that there is no tolerance for abuse on the site.


r/RedditSafety • • 10d ago Bravo

Sharing our latest Transparency Report and Reddit Rules updates (clarifying Rules 1, 3 and 4)

56 Upvotes

Hello everyone, 

This is u/ailewu from Reddit’s Trust & Safety Policy team! Today, we’re excited to share updates about our ongoing efforts to keep people safe on Reddit and foster healthy participation across communities. We’ll cover insights from our latest Transparency Report, which includes data from the first half of 2026, as well as additional clarifications to the Reddit Rules regarding violence, non-consensual intimate media, personal information, and minor abuse and sexualization.  

Reddit Transparency Report

Reddit’s biannual Transparency Report highlights the impact of our work to keep Reddit healthy and safe. We include insights and metrics on our layered, community-driven approach to content moderation, as well as information about legal requests we received from governments, law enforcement agencies, and third parties around the world to remove content or disclose user data.

Our latest report covers the period from January through June 2026. During this time, people on Reddit created 2.3 billion posts and comments, discussing and debating everything under the sun, and sharing real human perspectives in communities of interest around the world. Almost 4 billion chat messages were also exchanged in 1:1 or small group, real-time conversations.

Here are some key highlights that reflect our always-on content moderation efforts to support healthy interactions on Reddit.

Keeping Reddit Safe

Over this period, mods and admins removed 214,683,159 posts and comments, and admins removed 3,862,234 chats (only admins can execute chat removals). These actions occurred through a combination of manual and automated tools, including enhanced AI-based methods. Notably:

  • We made a number of improvements to our data infrastructure and adjusted the way we count and record removal actions across posts, comments, and chats (for this reason, data in this report may seem significantly different when compared to previous reports). 

  • The majority of posts and comments removed by admins were for spam (88.2%), with the remaining share of admin removals focused on other Reddit Rules violations. We saw a notable increase in the share of spam removals based on recent updates we made to legacy detection systems that have allowed us to action content that was not previously detected.

  • There was an increase in the amount of content removed under our policies against violence and hateful content as a result of real world events such as the Minnesota ICE protests and the onset of US-Iran hostilities. In parallel, we’ve continued investing in improving scaled automated systems to quickly detect and remove these violations, which resulted in meaningful increases in the volume of related content-level and account-level actions.

Moderating Communities

Mods play a critical role in curating and keeping their communities healthy by removing content based on community-specific rules, using a combination of automated tooling and human review: 

  • Over this period, over 159 million posts and comments were removed as a result of community-based violations, including removals that aren’t necessarily tied to Reddit Rules violations (for example, for being off-topic or improperly formatted content). 

    • Note: This number is significantly higher than what was reported previously because we are now including community-based removals resulting from automated safety filters developed by Reddit that moderators can choose to enable in their communities (e.g., the harassment filter and the mature content filter).

  • 20.3% of community-based removals were performed manually by mods; 42% were handled by Automoderator; and 37.7% happened through other automated systems, such as moderation apps built on Devvit (Reddit's developer platform), other bespoke moderation tools built by community mods, and the Reddit-provided safety filters.

  • Admins banned 558,160 communities for Reddit Rules violations. Spam made up the majority of ban reasons in this period (65.1%), while the remaining bans were largely due to communities being unmoderated (97.8% of the remaining bans).

  • We conducted 830 Moderator Code of Conduct investigations, and engaged communities 5,426 times to provide moderators with policy education resources and/or subreddit enforcement notifications. 

    • 57.2% of these investigations led to content removals, while 3.3% led to community bans. Over this period, we also reactivated 673 communities that became unmoderated despite being active and/or having a worthwhile topic–we onboarded 1,789 mods to support those communities.

Upholding User Rights

We continue to invest heavily in protecting users from the most serious harms while defending their privacy, speech, and associational rights through our careful and principled handling of legal requests from governments and law enforcement around the world. 

  • During this period, there was an 89% increase in legal requests submitted by government and law enforcement officials to remove content from Reddit, and a 6.8% increase in non-emergency legal requests for Reddit users’ account information compared to the second half of 2025. 

    • 45% of requests resulted in no action on the reported content, which could be for a variety of reasons including if the request was incomplete, overbroad, or inconsistent with international law or human rights standards.

  • We received 1,306 legal requests for account information from global government or law enforcement agencies from 34 different countries, and disclosed information in response to 906 (69%) of these legally mandated requests. The vast majority of these requests were part of routine law enforcement investigations. 

    • We have strict policies governing disclosure of information to government or law enforcement agencies  and we carefully scrutinize every request to ensure it is legally valid and narrowly tailored, pushing back when these requirements aren’t met. You can see more details in the latest report.

  • Importantly, we identified and rejected 34 fraudulent legal requests [21 requests to remove content (+73% from prior report); 13 requests for user account information (+18% from prior report)] purporting to come from legitimate government and law enforcement agencies during this period. We rejected and subsequently reported these bogus requests to the appropriate authorities.

We invite you to head on over to our Transparency Center to read the rest of the latest report after you check out the Reddit Rules updates below.

Evolving and Clarifying the Reddit Rules

We’re committed to continuously evolving our sitewide rules and clarifying expectations for everyone on Reddit. Over the past months, we reviewed and realigned our enforcement guidelines, and set out to better reflect important nuances in how enforcement happens through updates to relevant Help Center articles. Importantly, we continued our ongoing efforts to consult with mods in our Safety Focus Group to help inform our thinking. (Thank you!) 

The latest clarifications pertain to policies under Rules 1, 3, and 4. In the corresponding Help Center articles we share clearer definitions, provide more examples of what may or may not be violating, and make these rules easier to understand and enforce. The scope of violations these Rules apply to includes: 

  • Violence (Rule 1) – reiterating existing prohibitions around promoting, condoning, or simulating real-world sexual violence.

  • Personal Information (Rule 3) – providing more precise definitions and examples of prohibited content and behaviors.

  • Non-consensual Intimate Media (Rule 3) – further clarifying existing expectations around what constitutes a violation (e.g., threats, facilitation, etc.)

  • Minor Abuse and Sexualization (Rule 4) – refining definitions, examples, and counter-examples of harm.

That is all, folks! I’ll stick around to answer a few questions.


r/RedditSafety • • Oct 30 '19

Reddit Security Report -- October 30, 2019

3.6k Upvotes

Through the year, we've shared updates on detecting and mitigating content manipulation and keeping your accounts safe. Today we are sharing our first Reddit Security Report, which we'll be continuing on a quarterly basis. We are committed to continuously evolving how we tackle these problems. The purpose of these reports is to keep you informed about relevant events and actions.

By The Numbers

CategoryVolume (July - Sept)Volume (April - June)
Content manipulation reports5,461,0055,222,058
Admin content manipulation removals19,149,13314,375,903
Admin content manipulation account sanctions1,406,4402,520,474
3rd party breach accounts processed4,681,297,0451,355,654,815
Protective account security actions7,190,3181,845,605

These are the primary metrics we track internally, and we thought you’d want to see them too. If there are alternative metrics that seem worth looking at as part of this report, we’re all ears.

Content Manipulation

Content manipulation is a term we use to combine things like spam, community interference, vote manipulation, etc. This year we have overhauled how we handle these issues, and this quarter was no different. We focused these efforts on:

  1. Improving our detection models for accounts performing these actions

  2. Making it harder for them to spin up new accounts

Recently, we also improved our enforcement measures against accounts taking part in vote manipulation (i.e. when people coordinate or otherwise cheat to increase or decrease the vote scores on Reddit). Over the last 6 months (and mostly during the last couple of months), we increased our actions against accounts participating in vote manipulation by about 30x. We sanctioned or warned around 22k accounts for this in the last 3 weeks of September alone.

Account Security

This quarter, we finished up a major effort to detect all accounts that had credentials matching historical 3rd party breaches. It's important to track breaches that happen on other sites or services because bad actors will use those same username/password combinations to break into your other accounts (on the basis that a percentage of people reuse passwords). You might have experienced some of our efforts if we forced you to reset your password as a precaution. We expect the number of protective account security actions to drop drastically going forward as we no longer have a large backlog of breach datasets to process. Hopefully we have reached a steady state, which should reduce some of the pain for users. We will continue to deal with new breach sets that come in, as well as accounts that are hit by bots attempting to gain access (please take a look at this post on how you can improve your account security).

Our Recent Investigations

We have a lot of investigations active at any given time (courtesy of your neighborhood t-shirt spammers and VPN peddlers), and while we can’t cover them all, we want to use this report to share the results of just some of that work.

Ban Evasion

This quarter, we dealt with a highly coordinated ban evasion ring from users of r/opieandanthony. This began after we banned the subreddit for targeted harassment of users, as well as repeated copyright infringement. The group would quickly pop up on both new and abandoned subreddits to continue the abuse. We also learned that they were coordinating on another platform and through dedicated websites to redirect users to the latest target of their harassment.

This situation was different from your run-of-the-mill shitheadery ban evasion because the group was both creating new subreddits and resurrecting inactive or unmoderated subreddits. We quickly adjusted our efforts to this behavior. We also reported their offending account to the other platform and they were quick to ban the account. We then contacted the hosts of the independent websites to report the abuse. This helped ensure that the sites are no longer able to redirect automatically to Reddit for abuse purposes. Ultimately, we banned 78 subreddits (5 of which existed prior to the attack), and suspended 2,382 accounts. The ban evading activity has largely ceased (you know...until they read this).

There are a few takeaways from this investigation worth pulling out:

  1. Ban evaders (and others up to no good) often work across platforms, and so it’s important for those of us in the industry to also share information when we spot these types of coordinated campaigns.

  2. The layered moderation on Reddit works: Moderators brought this to our attention and did some awesome initial investigating; our Community team was then able to communicate with mods and users to help surface suspicious behavior; our detection teams were able to quickly detect and stop the efforts of the ban evaders.

  3. We have also been developing and testing new tools to address ban evasion recently. This was a good opportunity to test them in the wild, and they were incredibly effective at detecting and quickly actioning many of the accounts that were responsible for the ban evasion actions. We want to roll these tools out more broadly (expect a future post around this).

Reports of Suspected Manipulation

The protests in Hong Kong have been a growing concern worldwide, and as always, conversation on Reddit reflects this. It’s no surprise that we’ve seen Hong Kong-related communities grow immensely in recent months as a result. With this growth, we have received a number of user reports and comments asking if there is manipulation in these communities. We take the authenticity of conversation on Reddit incredibly seriously, and we want to address your concerns here.

First, we have not detected widespread manipulation in Hong Kong related subreddits nor seen any manipulation that affected those communities or their conversations in a meaningful way.

It's worth taking a step back to talk about what we look for in these situations. While we obviously can’t share all of our tactics for investigating these threats, there are some signals that users will be familiar with. When trying to understand if a community is facing widespread manipulation, we will look at foundational signals such as the presence of vote manipulation, mod ban rates (because mods know their community better than we do), spam content removals, and other signals that allow us to detect coordinated and scaled activities (pause for dramatic effect). If this doesn’t sound like the stuff of spy novels, it’s because it’s not. We continually talk about foundational safety metrics like vote manipulation, and spam removals because these are the same tools that advanced adversaries use (For more thoughts on this look here).

Second, let’s look at what other major platforms have reported on coordinated behavior targeting Hong Kong. Their investigations revealed attempts consisting primarily of very low quality propaganda. This is important when looking for similar efforts on Reddit. In healthier communities like r/hongkong, we simply don’t see a proliferation of this low-quality content (from users or adversaries). The story does change when looking at r/sino or r/Hong_Kong (note the mod overlap). In these subreddits, we see far more low quality and one-sided content. However, this is not against our rules, and indeed it is not even particularly unusual to see one-sided viewpoints in some geographically specific subreddits...What IS against the rules is coordinated action (state sponsored or otherwise). We have looked closely at these subreddits and we have found no indicators of widespread coordination. In other words, we do see this low quality content in these subreddits, but it seems to be happening in a genuine way.

If you see anything suspicious, please report it to us here. If it’s regarding potential coordinated efforts that aren't as well-suited to our regular report system, you can also use our separate investigations report flow by emailing us.

Final Thoughts

Finally, I would like to acknowledge the reports our peers have published during the past couple of months (or even today). Whenever these reports come out, we always do our own investigation. We have not found any similar attempts on our own platform this quarter. Part of this is a recognition that Reddit today is less international than these other platforms, with the majority of users being in the US, and other English speaking countries. Additionally, our layered moderation structure (user up/down-votes, community moderation, admin policy enforcement) makes Reddit a more challenging platform to manipulate in a scaled way (i.e. Reddit is hard). Finally, Reddit is simply not well suited to being an amplification platform, nor do we aim to be. This reach is ultimately what an adversary is looking for. We continue to monitor these efforts, and are committed to being transparent about anything that we do detect.

As I mentioned above, this is the first version of these reports. We would love to hear your thoughts on it, as well as any input on what type of information you would like to see in future reports.

I’ll stick around, along with u/worstnerd, to answer any questions that we can.


r/RedditSafety • • May 06 '19

How to keep your Reddit account safe

2.9k Upvotes

Your account expresses your voice and your personality here on Reddit. To protect that voice, you need to protect your access to it and maintain its security. Not only do compromised accounts deprive you of your online identity, but they are often used for malicious behavior like vote manipulation, spam, fraud, or even just posting content to misrepresent the true owner. While we’re always developing ways to take faster action against compromised accounts, there are things you can do to be proactive about your account’s security.

What we do to keep your account secure:

  • Actively look for suspicious signals - We use tools that help us detect unusual behavior in accounts. We monitor trends and compare against known threats.

  • Check passwords against 3rd party breach datasets - We check for username / password combinations in 3rd party breach sets.

  • Display your recent IP sessions for you to access - You can check your account activity at any time to see your recent login IPs. Keep in mind that the geolocation of each login may not be exact and will only include events within the last 100 days. If you see something you don’t recognize, you should change your password immediately and ensure your email address is correct.

If we determine that your account is vulnerable to compromise (or has actually been compromised), we lock the account and force a password reset. If we can’t establish account ownership or the account has been used in a malicious manner that prevents it being returned to the original owner, the account may be permanently suspended and closed.

What you can do to prevent this situation:

  • Use permanent emails - We highly encourage users to link their accounts to accessible email addresses that you regularly check (you can add and update email addresses in your user settings page if you are using new reddit, otherwise you can do that from the preferences page in old reddit). This is also how you will receive any activities alerting you of suspicious activity on your account if you’re signed out. As a general rule of thumb, avoid using email addresses you don't have permanent ownership over like school or work addresses. Temporary email addresses that expire are a bad idea.

  • Verify your emails - Verifying your email helps us confirm that there is a real person creating the account and that you have access to the email address given. If we determine that your account has been compromised, this is the only way we have to validate account ownership. Without this our only option will be to permanently close the account to prevent further misuse and access to the original owner’s data. There will be no appeals possible!

  • Check your profile occasionally to make sure your email address is current. You can do this via the preferences page on old reddit or the settings page in new reddit. It’s easy to forget to update it when you change schools, service providers, or set up new accounts.

  • Use strong/unique passwords - Use passwords that are complex and not used on any other site. We recommend using a password manager to help you generate and securely store passwords.

  • Add two factor authentication - For an extra layer of security. If someone gets ahold of your username/password combo, they will not be able to log into your account without entering the verification code.

We know users want to protect their privacy and don’t always want to provide an email address to companies, so we don’t require it. However, there are certain account protections that require users establish ownership, which is why an email address is required for password reset requests. Forcing password resets on vulnerable accounts is one of many ways we try to secure potentially compromised accounts and prevent manipulation of our platform. Accounts flagged as compromised with a verified email receive a forced password reset notice, but accounts without one will be permanently closed. In the past, manual attempts to establish ownership on accounts with lost access rarely resulted in an account recovery. Because manual attempts are ineffective and time consuming for our operations teams and you, we won’t be doing them moving forward. You're welcome to use Reddit without an email address associated with your account, but do so with the understanding of the account protection limitation. You can visit your user settings page at anytime to add or verify an email address.


r/RedditSafety • • Jul 26 '23

Q1 Safety & Security Report

51 Upvotes

Hello! I’m not the u/worstnerd but I’m not far from it, maybe third or fourth worst of the nerds? All that to say, I’m here to bring you our Q1 Safety & Security report. In addition to the quarterly numbers, we’re highlighting some results from the ban evasion filter we launched in Q1 to help mods keep their communities safe, as well as updates to our Automod notification architecture.

Q1 By The Numbers

CategoryVolume (Oct - Dec 2022)Volume (Jan - Mar 2023)
Reports for content manipulation7,924,7988,002,950
Admin removals for content manipulation79,380,27077,403,196
Admin-imposed account sanctions for content manipulation14,772,62516,194,114
Admin-imposed subreddit sanctions for content manipulation59,49888,772
Protective account security actions1,271,7421,401,954
Reports for ban evasion16,92920,532
Admin-imposed account sanctions for ban evasion198,575219,376
Reports for abuse2,506,7192,699,043
Admin-imposed account sanctions for abuse398,938447,285
Admin-imposed subreddit sanctions for abuse1,202897

Ban Evasion Filter

Ban evasion has been a persistent problem for mods (and admins). Over the past year, we’ve been working on a ban evasion filter, an optional subreddit setting that leverages our ability to identify posts and comments authored by potential ban evaders. Our goal in offering this feature was to help reduce time mods spent detecting ban evaders and prevent their potential negative community impact.

Initially piloted in August 2022, we released the ban evasion filter to all communities this May after incorporating feedback from mods. Since then we’ve seen communities adopting the filter and keeping it on — with positive qualitative feedback too. We have a few improvements on the radar, including faster detection of ban evaders, and are looking forward to continuing to iterate with y’all.

  • Adoption

    • 7,500 communities have turned on the ban evasion filter

  • Volume

    • 5,500 pieces of content are ban evasion-filtered per week from communities that have adopted the tool

  • Reversal Rate

    • Mods keep 92% of ban evasion filtered content out of their communities, indicating the filter is catching the right stuff

  • Retention

    • 98.7% of communities that have turned on the ban evasion filter have kept it on

Automod Notification Checks

Last week, we started rolling out changes to the way our notification systems are architected. Automod will now run before post and comment reply notifications are sent out. This includes both push notifications and email notifications. The change will be fully rolled out in the next few weeks.

This change is designed to improve the user experience on our platform. By running the content checks before notifications are sent out, we can ensure that users don't see content that has been taken down by Automod.

Up Next

More Community Safety Filters

We’re working on another new set of community moderation filters for mature content to further prevent this content from showing up in places where it shouldn’t or where users might not expect it, which we’ve heard from mods that they want. We already employ automated tagging at the site level for sexually explicit content, so this will add to those protections by providing a subreddit-level filter for a wider range of mature content. We’re working to get the first version of these filters to mods in the next couple of months.


r/RedditSafety • • Jul 20 '22

Update on user blocking

165 Upvotes

Hello people folks of Reddit,

Earlier this year we made some updates to our blocking feature. The purpose of these changes is to better protect users who experience harassment. We believe in the good — that the overwhelming majority of users are not trying to be jerks. Blocking is a tool for when someone needs extra protection.

The old version of blocking did not allow users to see posts or comments from blocked users, which often left the user unaware that they were being harassed. This was a big gap, and we saw users frequently cite this as a problem in r/help and similar communities. Our recent updates were aimed at solving this problem and giving users a better way to protect themselves. ICYMI, my posts in December and January cover in more detail the before and after experiences. You can also find more information about blocking in our Help Centers here and here.

We know that the rollout of these changes could have been smoother. We tried our best to provide a seamless transition by communicating early and often with mods via Mod Council posts and calls. When it came time to launch the experience, we ran into scalability issues that hindered our ability to rollout the update to the entire site, meaning that the rollout was not consistent across all users.

This issue meant that some users temporarily experienced inconsistency with:

  • Viewing profiles of blocked users between Web and Mobile platforms

  • How to reply to users who have blocked you

  • Viewing users who have blocked you in community and home feeds

As we worked to resolve these issues, new bugs would pop up that took us time to find, recreate, and resolve. We understand how frustrating this was for you, and we made the blocking feature our top priority during this time. We had multiple teams contribute to making it more scalable, and bug reports were investigated thoroughly as soon as they came in.

Since mid-June, the feature is fully functional on all platforms. We want to acknowledge and apologize for the bugs that made this update more difficult to manage and use. We understand that this created an inconsistent and confusing experience, and we have held multiple reviews to learn from our mistakes on how to scale these types of features better next time.

While we were making the feature more durable, we noticed multiple community concerns about blocking abuse. We heard this concern before we launched, and added additional protections to limit suspicious blocking behavior as well as monitoring metrics that would alert us if the suspicious behavior was happening at scale. That said, it concerned us that there was continued reference to this abuse, and so we completed an investigation on the severity and scale of block abuse.

The investigation involved looking at blocking patterns and behaviors to see how often unwelcome contributors systematically blocked multiple positive contributors with the assumed intent of bolstering their own posts.

In this investigation, we found that:

  • There are very few instances of this kind of abuse. We estimated that 0.02% of active communities have been impacted.

  • Of the 0.02% of active communities impacted, only 3.1% of them showed 5+ instances of this kind of abuse. This means that 0.0006% of active communities have seen this pattern of abuse.

  • Even in the 0.0006% of communities with this pattern of abuse, the blocking abuse is not happening at scale. Most bad actors participating in this abuse have blocked fewer than 10 users each.

While these findings indicate that this kind of abuse is rare, we will continue to monitor and take action if we see its frequency or severity increase. We also know that there is more to do here. Please continue to flag these instances to us as you see them.

Additionally, our research found that the blocking revamp is more effective in meeting user’s safety needs. Now, users take fewer protective actions than users who blocked before the improvements. Our research also indicates that this is especially impactful for perceived vulnerable and minority groups who display a higher need for blocking and other safety measures. (ICYMI read our report on Prevalence of Hate Directed at Women here).

Before we wrap up, I wanted to thank all the folks who have been voicing their concerns - it has helped make a better feature for everyone. Also, we want to continue to work on making the feature better, so please share any and all feedback you have.


r/RedditSafety • • Aug 20 '20

Understanding hate on Reddit, and the impact of our new policy

702 Upvotes

Intro

A couple of months ago I shared the quarterly security report with an expanded focus on abuse on the platform, and a commitment to sharing a study on the prevalence of hate on Reddit. This post is a response to that commitment. Additionally, I would like to share some more detailed information about our large actions against hateful subreddits associated with our updated content policies.

Rule 1 states:

“Remember the human. Reddit is a place for creating community and belonging, not for attacking marginalized or vulnerable groups of people. Everyone has a right to use Reddit free of harassment, bullying, and threats of violence. Communities and users that incite violence or that promote hate based on identity or vulnerability will be banned.”

Subreddit Ban Waves

First, let’s focus on the actions that we have taken against hateful subreddits. Since rolling out our new policies on June 29, we have banned nearly 7k subreddits (including ban evading subreddits) under our new policy. These subreddits generally fall under three categories:

  • Subreddits with names and descriptions that are inherently hateful

  • Subreddits with a large fraction of hateful content

  • Subreddits that positively engage with hateful content (these subreddits may not necessarily have a large fraction of hateful content, but they promote it when it exists)

Here is a distribution of the subscriber volume:

The subreddits banned were viewed by approximately 365k users each day prior to their bans.

At this point, we don’t have a complete story on the long term impact of these subreddit bans, however, we have started trying to quantify the impact on user behavior. What we saw is an 18% reduction in users posting hateful content as compared to the two weeks prior to the ban wave. While I would love that number to be 100%, I'm encouraged by the progress.

*Control in this case was users that posted hateful content in non-banned subreddits in the two weeks leading up to the ban waves.

Prevalence of Hate on Reddit

First I want to make it clear that this is a preliminary study, we certainly have more work to do to understand and address how these behaviors and content take root. Defining hate at scale is fraught with challenges. Sometimes hate can be very overt, other times it can be more subtle. In other circumstances, historically marginalized groups may reclaim language and use it in a way that is acceptable for them, but unacceptable for others to use. Additionally, people are weirdly creative about how to be mean to each other. They evolve their language to make it challenging for outsiders (and models) to understand. All that to say that hateful language is inherently nuanced, but we should not let perfect be the enemy of good. We will continue to evolve our ability to understand hate and abuse at scale.

We focused on language that’s hateful and targeting another user or group. To generate and categorize the list of keywords, we used a wide variety of resources and AutoModerator* rules from large subreddits that deal with abuse regularly. We leveraged third-party tools as much as possible for a couple of reasons: 1. Minimize any of our own preconceived notions about what is hateful, and 2. We believe in the power of community; where a small group of individuals (us) may be wrong, a larger group has a better chance of getting it right. We have explicitly focused on text-based abuse, meaning that abusive images, links, or inappropriate use of community awards won’t be captured here. We are working on expanding our ability to detect hateful content via other modalities and have consulted with civil and human rights organizations to help improve our understanding.

Internally, we talk about a “bad experience funnel” which is loosely: bad content created → bad content seen → bad content reported → bad content removed by mods (this is a very loose picture since AutoModerator and moderators remove a lot of bad content before it is seen or reported...Thank you mods!). Below you will see a snapshot of these numbers for the month before our new policy was rolled out.

Details

  • 40k potentially hateful pieces of content each day (0.2% of total content)

    • 2k Posts

    • 35k Comments

    • 3k Messages

  • 6.47M views on potentially hateful content each day (0.16% of total views)

    • 598k Posts

    • 5.8M Comments

    • ~3k Messages

  • 8% of potentially hateful content is reported each day

  • 30% of potentially hateful content is removed each day

    • 97% by Moderators and AutoModerator

    • 3% by admins

*AutoModerator is a scaled community moderation tool

What we see is that about 0.2% of content is identified as potentially hateful, though it represents a slightly lower percentage of views. The reason for this reduction is due to AutoModerator rules which automatically remove much of this content before it is seen by users. We see 8% of this content being reported by users, which is lower than anticipated. Again, this is partially driven by AutoModerator removals and the reduced exposure. The lower reporting figure is also related to the fact that not all of the things surfaced as potentially hateful are actually hateful...so it would be surprising for this to have been 100% as well. Finally, we find that about 30% of hateful content is removed each day, with the majority being removed by mods (both manual actions and AutoModerator). Admins are responsible for about 3% of removals, which is ~3x the admin removal rate for other report categories, reflecting our increased focus on hateful and abusive reports.

We also looked at the target of the hateful content. Was the hateful content targeting a person’s race, or their religion, etc? Today, we are only able to do this at a high level (e.g., race-based hate), vs more granular (e.g., hate directed at Black people), but we will continue to work on refining this in the future. What we see is that almost half of the hateful content targets people’s ethnicity or nationality.

We have more work to do on both our understanding of hate on the platform and eliminating its presence. We will continue to improve transparency around our efforts to tackle these issues, so please consider this the continuation of the conversation, not the end. Additionally, it continues to be clear how valuable the moderators are and how impactful AutoModerator can be at reducing the exposure of bad content. We also noticed that there are many subreddits already removing a lot of this content, but were doing so manually. We are working on developing some new moderator tools that will help ease the automatic detection of this content without building a bunch of complex AutoModerator rules. I’m hoping we will have more to share on this front in the coming months. As always, I’ll be sticking around to answer questions, and I’d love to hear your thoughts on this as well as any data that you would like to see addressed in future iterations.


r/RedditSafety • • Jan 13 '25

Q3 2024 Safety & Security Report: Election Recap and Renaming our Content Policy

74 Upvotes

Hi redditors,

As we begin 2025, we’re back with another Quarterly Safety & Security Report. This time, to report on how the US election went on Reddit and share the renaming of our Content Policy as “Reddit Rules”. But first, the Q3 numbers.

Q3 By The Numbers

CategoryVolume (April - June 2024)Volume (July-Sept  2024)
Reports for content manipulation440,694591,315
Admin content removals for content manipulation25,062,57125,785,092
Admin-imposed account sanctions for content manipulation4,908,6362,903,258
Admin-imposed subreddit sanctions for content manipulation194,079181,663
Reports for abuse2,797,9582,815,991
Admin content removals for abuse639,986616,443
Admin-imposed account sanctions for abuse445,919454,835
Admin-imposed subreddit sanctions for abuse2,4981,409
Reports for ban evasion15,16714,555
Admin-imposed account sanctions for ban evasion273,511186,739
Protective account security actions2,159,8861,190,348

Elections Recap

TL;DR: We saw no significant content interference related to the election, though we did see a temporary increase in abuse (as well as a corresponding increase in admin enforcement against abuse) in the days following the election. 

The U.S. held general elections on Tuesday, November 5th. As noted in earlier posts, Reddit’s Policy, Safety, and Community teams were prepared and monitoring to ensure the integrity and safety of our platform. 

Content manipulation and foreign interference

Content manipulation, which includes things like inauthentic content, manipulated content presented to mislead, and foreign interference, is against our policies. In the weeks leading to and immediately following the election, our teams were on high-alert for violating content, but ultimately found no significant malicious activity on our platform:

  • We conducted 65 in-depth investigations, and only one piece of content with minimal visibility was confirmed to be connected to a foreign actor. 

  • We reviewed almost 3,000 accounts for potential political manipulation, with only 0.7% warranting actioning.

Abuse and harassment

On the day of and following the election, we observed a very short increase in abuse, including hate and harassment. We saw a corresponding increase in both admin enforcement actions and community level removals, aided by our community tools — our Safety Filters usage by mods peaked, flagging 200,000 pieces of content in communities in which they were enabled. 

Community engagement

Early in the year, we held a roundtable with mods from across the political spectrum to hear their perspective on modding through elections. Their top priorities – inauthentic content and hateful content – aligned with ours. We also worked with communities throughout the US election cycle to ensure mods had the necessary resources and could escalate investigations to our teams.

  • We reached out to over 2,100 communities with resources, education, and reminders about site policy. Only 6 communities received Moderator Code of Conduct violations.

  • Our Mod Tip Line resulted in the identification of a few political spammers (not connected to foreign actors) that were actioned. 

2024 was a big year for elections. As always, our focus during these significant world events — and every day — is fairly and consistently upholding sitewide rules when we review content and enforce our policies, and ensuring the integrity of our platform so that people of all political persuasions can learn, engage, and debate on Reddit. We’re able to do this thanks to the perspectives and participation of our internal teams and community partners — so thank you!

New Year, New Name: Reddit Rules

Last quarter we refreshed the name of this subreddit from r/redditsecurity to r/redditsafety to make it easier for people to know what to expect in this subreddit. 

In a similar vein, today we’re renaming Reddit’s Content Policy to “Reddit Rules” (longtime redditors might remember that “rules” was actually the original name.). The name “Reddit Rules” better reflects that our policies govern both content AND behavior on Reddit. This is just a name change and doesn’t affect the content of the rules themselves.

We've already implemented the new name across a number of surfaces, though we expect that it will take some time to update all mentions, so please bear with us. We also know that many communities have descriptions or rules referencing the old name – Content Policy – and understand it may take mods some time to update. We set up an automatic redirect of the old link to the new page so things don't break as this change rolls out.

Happy new year to the entire Reddit community!


r/RedditSafety • • Jan 09 '20

Updates to Our Policy Around Impersonation

2.9k Upvotes

Hey Redditsecurity,

If you’ve been frequenting this subreddit, you’re aware we’ve been doing significant work on site integrity operations as we move into 2020 to ensure that we have the appropriate rules and processes in place to handle bad actors who are trying to manipulate Reddit, particularly around issues of great public significance, like elections. To this end, we thought it was time to update our policy on impersonation to better cover some of the use cases that we have been seeing and actioning under this rule already, as well as guard against cases we might see in the future.

Impersonation is actually one of the rarest report classes we receive (as you can see for yourself in our Transparency Report), so we don’t expect this update to impact everyday users much. The classic case of impersonation is a Reddit username pretending to be someone else-- whether a politician, brand, Reddit admin, or any other person or entity. However, this narrow case doesn’t fully cover things that we also see from time to time, like fake articles falsely attributed to real journalists, forged election communications purporting to come from real agencies or officials, or scammy domains posing as those of a particular news outlet or politician (always be sure to check URLs closely-- .co does NOT equal .com!).

We also wanted to hedge against things that we haven’t seen much of to date, but could see in the future, such as malicious deepfakes of politicians, for example, or other, lower-tech forged or manipulated content that misleads (remember, pornographic deepfakes are already prohibited under our involuntary pornography rule). But don’t worry. This doesn’t apply to all deepfake or manipulated content-- just that which is actually misleading in a malicious way. Because believe you me, we like seeing Nic Cage in unexpected places just as much as you do.

The updated rule language is below, and can be found here, along with details on how to make reports if you see impersonation on the site, or if you yourself are being impersonated.

Do not impersonate an individual or entity in a misleading or deceptive manner.

Reddit does not allow content that impersonates individuals or entities in a misleading or deceptive manner. This not only includes using a Reddit account to impersonate someone, but also encompasses things such as domains that mimic others, as well as deepfakes or other manipulated content presented to mislead, or falsely attributed to an individual or entity. While we permit satire and parody, we will always take into account the context of any particular content.

If you are being impersonated, or if you believe you’ve found content in violation of these guidelines, please report it here.

EDIT: Alright gang, that's it for me. Thanks for your questions, and remember...


r/RedditSafety • • Oct 21 '21

Internationalizing Safety

147 Upvotes

As Reddit grows and expands internationally, it is important that we support our international communities to grow in a healthy way. In community-driven safety, this means ensuring that the complete ecosystem is healthy. We set basic Trust and Safety requirements at the admin level, but our structure relies on users and moderators to also play their role. When looking at the safety ecosystem, we can break it into 3 key parts:

  • Community Response

  • Moderator Response

  • Reddit Response

The data largely shows that our content moderation is scaling and that international communities show healthy levels of reporting and moderation. We are taking steps to ensure that this will continue in the future and that we can identify the instances when this is not the case.

Before we go too far, it's important to recognize that not all subreddits have the same level of activity. Being more active is not necessarily better from a safety perspective, but generally speaking, as a subreddit becomes more active we see the maturity of the community and mods increase (I'll touch more on this later). Below we see the distribution of subreddit categories as a function of various countries. I'll leave out the specific details of how we define each of these categories but they progress from inactive (not shown) → on the cusp → growing → active → highly active.

Categorizing Subreddit Activity by Country

CountryOn the CuspGrowingActiveHighly Active
US45.8%29.7%17.4%4.0%
GB47.3%29.7%14.1%3.5%
CA34.2%28.0%24.9%5.0%
AU44.6%32.6%12.7%3.7%
DE59.9%26.8%7.6%1.7%
NL47.2%29.1%11.8%0.8%
BR49.1%28.4%13.4%1.6%
FR56.6%25.9%7.7%0.7%
MX63.2%27.5%6.4%1.2%
IT50.6%30.3%10.1%2.2%
IE34.6%34.6%19.2%1.9%
ES45.2%32.9%13.7%1.4%
PT40.5%26.2%21.4%2.4%
JP44.1%29.4%14.7%2.9%

We see that our larger English speaking countries (US, GB, CA, and AU) have a fairly similar distribution of activity levels (AU subreddits skew more active than others). Our larger non-English countries (DE, NL, BR, FR, IT) skew more towards "on the cusp." Again, this is neither good or bad from a health perspective, but it is important to note as we make comparisons across countries.

Our moderators are a critical component of the safety landscape on Reddit. Moderators create and enforce rules within a community, cater automod to help catch bad content quickly, review reported content, and do a host of other things. As such, it is important that we have an appropriate concentration of moderators in international communities. That said, while having moderators is important, we also need to ensure that these mods are taking "safety actions" within their communities (we'll refer to mods who take safety actions as "safety moderators" for the purposes of this report). Below is a chart of the average number of "safety moderators" in each international community.

Average Safety Moderators per Subreddit

CountryOn the cuspGrowingActiveHighly Active
US0.370.701.684.70
GB0.370.772.047.33
CA0.350.721.995.58
AU0.320.852.096.70
DE0.380.811.446.11
NL0.500.762.205.00
BR0.410.841.475.60
FR0.460.762.8215.00
MX0.280.561.382.60
IT0.671.111.118.00
IE0.280.671.904.00
ES0.210.752.203.00
PT0.410.821.118.00
JP0.330.700.805.00

What we are looking for is that as the activity level of communities increases, we see a commensurate increase in the number of safety moderators (more activity means more potential for abusive content). We see that most of our top non-US countries have more safety mods than our US focused communities at the same level of activity (with a few exceptions). There does not appear to be any systematic differences based on language. As we grow internationally, we will continue to monitor these numbers, address any low points that may develop, and work directly with communities to help with potential deficiencies.

Healthy communities also rely on users responding appropriately to bad content. On Reddit this means downvoting and reporting bad content. In fact, one of our strongest signals that a community has become "toxic" is that we see that users are responding in the opposite fashion by upvoting violating content. So, counterintuitively when we are evaluating whether we are seeing healthy growth within a country, we want to see a larger fraction of content being reported (within reason), and that a good fraction of communities are actually receiving reports (ideally this number approaches 100%, but very small communities may not have enough content or activity to receive reports. For every country, 100% of highly engaged communities receive reports).

Portion of Subreddits with ReportsPortion of content Reported
US48.9%
GB44.1%
CA56.1%
DE42.6%
AU45.2%
BR31.4%
MX31.9%
NL52.2%
FR34.6%
IT41.0%
ES38.2%
IE51.1%
PT50.0%
JP35.5%

Here we see a little bit more of a mixed bag. There is not a clear English vs non-English divide, but there are definitely some country level differences that need to be better understood. Most of the countries fall into a range that would be considered healthy, but there are a handful of countries where the reporting dynamics leave a bit to be desired. There are a number of reasons why this could be happening, but this requires further research at this time.

The next thing we can look at is how moderators respond to the content being reported by users. By looking at the mod rate of removal of user reported content, we can ensure that there is a healthy level of moderation happening at the country level. This metric can also be a bit confusing to interpret. We do not expect it to be 100% as we know that reported content has a natural actionability rate (i.e., a lot of reported content is not actually violating). A healthy range is in the 20-40% range for all activity ranges. More active communities tend to have higher report removal rates because of larger mod teams and increased reliance on automod (which we've also included in this chart).

Moderator report removal rateAutomod usage
US25.3%
GB28.8%
CA30.4%
DE24.7%
AU33.7%
BR28.9%
MX16.5%
NL26.7%
FR26.6%
IT27.2%
ES12.4%
IE34.2%
PT23.6%
JP28.9%

For the most part, we see that our top countries show a very healthy dynamic between user's reporting content, and moderators taking action. There are a few low points here, notably Spain and Mexico, the two Spanish speaking countries, this dynamic needs to be further understood. Additionally, we see that automod adoption is generally lower in our non-English countries. Automod is a powerful tool that we provide to moderators, but it requires mods to write some (relatively simple) code...in English. This is, in part, why we are working on building more native moderator tools that do not require any code to be written (there are other benefits to this work that I won't go into here).

Reddit's unique moderation structure allows users to find communities that share their interests, but also their values. It also reflects the reality that each community has different needs, customs, and norms. However, it's important that as we grow internationally, that the fidelity of our governance structure is being maintained. This community-driven moderation is at the core of what has kept Reddit healthy and wonderful. We are continuing to work on identifying places where our tooling and product needs to evolve to ensure that internationalization doesn't come at the expense of a safe experience.


r/RedditSafety • • May 09 '24 Helpful

Sharing our Public Content Policy and a New Subreddit for Researchers

Thumbnail self.reddit
19 Upvotes

r/RedditSafety • • May 28 '26

Reddit Rule 8 (Don’t break the site) Clarifications

67 Upvotes

Hi everyone,

At Reddit, we’re always looking for ways to keep the platform human, transparent, and respectful of your privacy. Today we’re sharing some clarifications to Rule 8 of the Reddit Rules: "Don't break the site." While the spirit of the rule hasn’t changed, we are adding specific details to address platform misuse and behavior that degrades the experience of Redditors.

What is changing?
We’ve updated the policy language to be more explicit about what it means to “interfere with normal use of Reddit”. We are also connecting Rule 8 to our User Agreement and Developer Terms, so the ground rules are clear for everyone – whether you’re a user, developer, or an entity interacting with our services.

Here are the key highlights:  

  • We are using the term “app” to include everything from traditional programs to bots, AI agents, and non-human operated accounts.  

  • As we’ve previously announced, to remain in good standing, apps must identify themselves and register. This supports our app labeling initiative so you know when you’re interacting with an automated account.

  • We’re reflecting long-standing requirements from our Public Content Policy and Responsible Builder Policy directly into Rule 8, specifically: 

    • Respecting user deletions. This has always been the rule, and we’re reiterating it here: if a Redditor deletes their content, apps are prohibited from continuing to display or store local copies of that content.

    • No unauthorized scraping. Accessing or collecting Reddit data without explicit permission continues to be a violation of our terms.   

  • We are prohibiting the creation of accounts through automated or "agentic" means. While we’re okay with posting from a single automated account –if labelled as an App and otherwise within our rules–, using scripts or AI to spin up dozens or hundreds of accounts remains a violation of our site wide rules. 

Why are we making this update?

These changes are part of our commitment to foster a trusted ecosystem for Redditors and ensure that Reddit remains a place for authentic human conversation.


r/RedditSafety • • Apr 07 '22

Prevalence of Hate Directed at Women

539 Upvotes

For several years now, we have been steadily scaling up our safety enforcement mechanisms. In the early phases, this involved addressing reports across the platform more quickly as well as investments in our Safety teams, tooling, machine learning, etc. – the “rising tide raises all boats” approach to platform safety. This approach has helped us to increase our content reviewed by around 4x and accounts actioned by more than 3x since the beginning of 2020. However, in addition to this, we know that abuse is not just a problem of “averages.” There are particular communities that face an outsized burden of dealing with other abusive users, and some members, due to their activity on the platform, face unique challenges that are not reflected in “the average” user experience. This is why, over the last couple of years, we have been focused on doing more to understand and address the particular challenges faced by certain groups of users on the platform. This started with our first Prevalence of Hate study, and then later our Prevalence of Holocaust Denialism study. We would like to share the results of our recent work to understand the prevalence of hate directed at women.

The key goals of this work were to:

  1. Understand the frequency at which hateful content is directed at users perceived as being women (including trans women)

  2. Understand how other Redditors respond to this content

  3. Understand how Redditors respond differently to users perceived as being women (including trans women)

  4. Understand how Reddit admins respond to this content

First, we need to define what we mean by “hateful content directed at women” in this context. For the purposes of this study, we focused on content that included commonly used misogynistic slurs (I’ll leave this to the reader’s imagination and will avoid providing a list), as well as content that is reported or actioned as hateful along with some indicator that it was directed at women (such as the usage of “she,” “her,” etc in the content). As I’ve mentioned in the past, humans are weirdly creative about how they are mean to each other. While our list was likely not exhaustive, and may have surfaced potentially non-abusive content as well (e.g., movie quotes, reclaimed language, repeating other users, etc), we do think it provides a representative sample of this kind of content across the platform.

We specifically wanted to look at how this hateful content is impacting women-oriented communities, and users perceived as being women. We used a manually curated list of over 300 subreddits that were women-focused (trans-inclusive). In some cases, Redditors self-identify their gender (“...as I woman I am…”), but one the most consistent ways to learn something about a user is to look at the subreddits in which they participate.

For the purposes of this work, we will define a user perceived as being a woman as an account that is a member of at least two women-oriented subreddits and has overall positive karma in women-oriented subreddits. This makes no claim of the account holder’s actual gender, but rather attempts to replicate how a bad actor may assume a user’s gender.

With those definitions, we find that in both women-oriented and non-women-oriented communities, approximately 0.3% of content is identified as being hateful content directed at women. However, while the rate of hateful content is approximately the same, the response is not! In women-oriented communities, this hateful content is nearly TWICE as likely to be negatively received (reported, downvoted, etc.) than in non-women-oriented communities (see chart). This tells us that in women-oriented communities, users and mods are much more likely to downvote and challenge this kind of hateful content.

Title: Community response (hateful content vs non-hateful content)

Women-oriented communitiesNon-women-oriented communitiesRatio
Report Rate12x6.6x1.82
Negative Reception Rate4.4x2.6x1.7
Mod Removal Rate4.2x2.4x1.75

Next, we wanted to see how users respond to other users that are perceived as being women. Our safety researchers have seen a common theme in survey responses from members of women-oriented communities. Many respondents mentioned limiting how often they engage in women-oriented communities in an effort to reduce the likelihood they’ll be noticed and harassed. Respondents from women-oriented communities mentioned using alt accounts or deleting their comment and post history to reduce the likelihood that they’d be harassed (accounts perceived as being women are 10% more likely to have alts than other accounts). We found that accounts perceived as being women are 30% more likely to receive hateful content in response to their posts or comments in non-women-oriented communities than accounts that are not perceived as being women. Additionally, they are 61% more likely to receive a hateful message on their first direct communication with another user.

Finally, we want to look at Reddit Inc’s response to this. We have a strict policy against hateful content directed at women, and our Rule 1 explicitly states: Remember the human. Reddit is a place for creating community and belonging, not for attacking marginalized or vulnerable groups of people. Everyone has a right to use Reddit free of harassment, bullying, and threats of violence. Communities and users that incite violence or that promote hate based on identity or vulnerability will be banned. Our Safety teams enforce this policy across the platform through both proactive action against violating users and communities, as well as by responding to your reports. Over a recent 90 day period, we took action against nearly 14k accounts for posting hateful content directed at women and we banned just over 100 subreddits that had a significant volume of hateful content (for comparison, this was 6.4k accounts and 14 subreddits in Q1 of 2020).

Measurement without action would be pointless. The goal of these studies is to not only measure where we are, but to inform where we need to go. Summarizing these results we see that women-oriented communities and non-women-oriented-communities see approximately the same fraction of hateful content directed toward women, however the community response is quite different. We know that most communities don’t want this type of content to have a home in their subreddits, so making it easier for mods to filter it will ensure the shithead users are more quickly addressed. To that end, we are developing native hateful content filters for moderators that will reduce the burden of removing hateful content, and will also help to shrink the gap between identity-based communities and others. We will also be looking into how these results can be leveraged to improve Crowd Control, a feature used to help reduce the impact of non-members in subreddits. Additionally, we saw a higher rate of hateful content in direct messages to accounts perceived as women, so we have been developing better tools that will allow users to control the kind of content they receive via messaging, as well as improved blocking features. Finally, we will also be using this work to identify outlier communities that need a little…love from the Safety team.

As I mentioned, we recognize that this study is just one more milestone on a long journey, and we are constantly striving to learn and improve along the way. There is no place for hateful content on Reddit, and we will continue to take action to ensure the safety of all users on the platform.