r/AssistantBOT • • Jan 16 '20

Update Improved matching for selecting flairs via messaging in v1.8 Icaco

3 Upvotes

Artemis has supported flair selection via messaging ever since v1.1 Birch, so that submitters can simply reply to its flair enforcement messages with the text of the flair they want to select, and Artemis will automatically assign that flair to and approve their post. This (the + enhancement) is a very popular feature: As of January 2020, the bot regularly processes about 100-250 such messages per day.

My personal objective with flairing via messaging has always been to allow for the process to be as easy as possible. That's why the flairs go through a sanitization process to allow for matching to be done even if the user's capitalization is different, and to strip hard-to-type Reddit and Unicode emoji from the flair. Starting in v1.6 Ginkgo I began using fuzzywuzzy to improve flair matching in the cases of typos or punctuation omission. For example, the response question answer in reply would match a flair Question/Answer. At the time the match ratio was set to be extremely high with 95% certainty.

While the vast majority of messages (90+%) are easily processed because they only include the flair text (as per the flair enforcement message), there are cases where flair matching sometimes fails:

  • The user's message is too verbose - e.g. hi there! can you please choose the flair discussion for me thanks xoxo

  • The user replies with a list of different flairs instead of just one - e.g. discussion, rant, question

  • The user duplicates the flair text because they quoted the desired flair in Markdown - e.g. > memes memes

It's easy for a human to parse these sort of messages to know the desired flair, but harder for a script to do so.

Beginning from today I've improved the code to further improve flair matching:

  1. The fuzzing ratio has been lowered to 90% to even better account for not just misspellings, but also cases where the OP lists several flairs in their message.

  2. If all else fails, Artemis will look to see if any flairs are included within the actual body of the message.

Obviously full 100% accurate parsing of every single message is impossible, but this should cover the vast majority of non-standard messages, probably around 97% or so. There do not appear to be too many false positives from lowering the fuzz ratio - the message fuck you bot is not going to be interpreted as the flair facts, for example. (It's sorta unbelievable how many hostile messages the bot gets everyday)

Examples

It's probably easiest to see this in action with examples. These are all actual messages received by Artemis.

Flair Match Fuzzed
  • Champion discussion, guide, showcase

    • Artemis found flair: champion discussion

  • Employee Question The reddit I use does not allow me to add flares.

    • Artemis found flair: employee question

  • Flair used for post would be "question"

    • Artemis found flair: question

  • Can you add Quebec as the flare then lol

    • Artemis found flair: quebec

  • Can you update post flair to Shard Opening?

    • Artemis found flair: shard opening

  • 이민

    • Artemis found flair: 이민 ◦ immigration

Flair Found in Text
  • Meme (At least I hope it qualifies. I'm new to Reddit. Sorry mods!)

    • Artemis found flair: meme

  • Oh wait I'm stupid I read it wrong sorry I want my flair to be Memes

    • Artemis found flair: memes


r/AssistantBOT • • Nov 08 '24

Announcement Bots have been moved to a more powerful system

5 Upvotes

All Artemis instances are now deployed on a mini-PC (Intel N100, to be more specific) which is much faster and can run with better thermals than the old Raspberry Pi 4 it was formerly hosted on.


r/AssistantBOT • • Jun 21 '21

Statistics Artemis Overall Statistics — 2021-05

12 Upvotes

Sorry for the delay, but I finally made it so that the statistics for Artemis now include actions and post totals across both active instances!

Artemis Overall Statistics — 2021-05

Added Subreddits

Daily Processed Posts

DateNumber of Posts
2021-05-0123,769
2021-05-0224,644
2021-05-0326,175
2021-05-0424,944
2021-05-0526,831
2021-05-0626,096
2021-05-0726,231
2021-05-0824,139
2021-05-0924,695
2021-05-1026,598
2021-05-1126,594
2021-05-1226,305
2021-05-1326,600
2021-05-1426,576
2021-05-1524,278
2021-05-1624,948
2021-05-1726,005
2021-05-1826,811
2021-05-1926,816
2021-05-2026,457
2021-05-2125,517
2021-05-2223,585
2021-05-2324,360
2021-05-2425,378
2021-05-2526,273
2021-05-2626,361
2021-05-2726,027
2021-05-2825,395
2021-05-2923,829
2021-05-3024,269
2021-05-3124,757
Total791,263

Daily Actions

DateFlaired postRemoved postRemoved unscheduled postRestored postSent flair reminderUpdated configurationUpdated statisticsUpdated userflair statistics
2021-05-01236001316411---1,385376
2021-05-02165083277411---1,309---
2021-05-0316708---349410---1,386---
2021-05-04256051311401---1,388---
2021-05-05245781303434---1,389---
2021-05-0619637---32541231,390---
2021-05-07226192318390---1,392---
2021-05-0814531---245406---1,394---
2021-05-09215932270358---1,396---
2021-05-1015662---321450---1,396---
2021-05-11175912329479---1,396---
2021-05-12185981309456---1,399---
2021-05-13216221314404---1,402---
2021-05-14166122304389---1,403---
2021-05-1512569---277361---1,406381
2021-05-16135072272414---1,409---
2021-05-17175402255423---1,411---
2021-05-1817633---31342611,412---
2021-05-19229251460442---1,414---
2021-05-20126271338450---1,414---
2021-05-2125577---283449---1,414---
2021-05-2212548---263399---1,416---
2021-05-23125342286395---1,418---
2021-05-24195712281413---1,418---
2021-05-2516631---32142331,418---
2021-05-26165511249457---1,418---
2021-05-27195725282461---1,418---
2021-05-28135361242448---1,419---
2021-05-2913496123438621,420---
2021-05-30194842228410---1,421---
2021-05-31185512275416---1,421---
Total54218,316389,15012,984943,492757

r/AssistantBOT • • Apr 15 '21

Statistics Artemis Overall Statistics — 2021-03

12 Upvotes

Here are the statistics for March! I realized that I seem to have excluded an important part of statistics gathering for the instances, so I need to rectify that for the May statistics!

Artemis Overall Statistics — 2021-03

Added Subreddits

Daily Processed Posts

DateNumber of Posts
2021-03-0124,715
2021-03-0224,921
2021-03-0324,452
2021-03-0424,507
2021-03-0524,013
2021-03-0621,933
2021-03-0722,663
2021-03-0823,339
2021-03-0923,237
2021-03-1024,246
2021-03-1123,795
2021-03-1223,909
2021-03-1320,241
2021-03-1422,278
2021-03-1520,434
2021-03-1624,454
2021-03-1723,224
2021-03-1823,642
2021-03-1922,769
2021-03-2021,621
2021-03-2122,270
2021-03-2223,896
2021-03-2322,223
2021-03-2422,444
2021-03-2523,777
2021-03-2623,435
2021-03-2719,276
2021-03-2821,064
2021-03-2923,124
2021-03-3022,846
2021-03-3123,429
Total712,177

Daily Actions

DateFlaired postRemoved postRestored postSent flair reminderUpdated configurationUpdated statisticsUpdated userflair statistics
2021-03-01251,805367506---1,243342
2021-03-02291,407347511---1,243---
2021-03-03211,517356491---1,243---
2021-03-04151,252366501---1,242---
2021-03-05241,116329541---1,241---
2021-03-06271,251299471---1,241---
2021-03-07341,197322476---1,238---
2021-03-08241,080330467---1,240---
2021-03-09251,135362490---1,238---
2021-03-10191,241340516---1,238---
2021-03-11271,228304475---1,238---
2021-03-12291,084343447---1,238---
2021-03-13161,088298454---1,236---
2021-03-14131,27333642921,068---
2021-03-15211,091334383---1,236344
2021-03-16221,133286473---1,233---
2021-03-17251,326324483---1,236---
2021-03-18251,117325465---1,235---
2021-03-1916983340421---1,235---
2021-03-2024882294406---1,235---
2021-03-2122951299388---1,235---
2021-03-2218967324419---1,235---
2021-03-2333904299419---1,235---
2021-03-24261,151356419---1,235---
2021-03-2527838336491---1,234---
2021-03-2633853312500---1,236---
2021-03-27202,436340488---1,235---
2021-03-28242,279309440---1,027---
2021-03-29291,025321483---1,235---
2021-03-30211,047316453---1,235---
2021-03-3115726319479---1,235---
Total72937,38310,13314,385237,974686

r/AssistantBOT • • Jun 22 '21

Documentation Introduction to Artemis (u/AssistantBOT), Round VI

42 Upvotes

❓ FAQ • 🔎️ Guide • 📓 Change Log • 🎚️ Advanced

Artemis (AssistantBOT), a flair enforcer and statistics bot for any subreddit!

  • Looking for an easy-to-use bot to help make sure your community's submitters remember to choose a post flair?

  • Want more detailed and extensive statistics on the health and growth of your community?

Artemis (AssistantBOT) is an easy-to-use and helpful Reddit bot written by a moderator for moderators to assist them with organizing and gaining insights into their own communities. (Now used on 1,500+ subreddits with over 120 million subscribers and 11,000 moderators combined!)

Feel free to comment below if you have questions about Artemis. Or if you prefer Discord, click this link.

This is an edited repost of previous introduction posts, which have now been automatically archived. (I, II, III, IV, V.)

Functions (TL;DR)

Artemis has two primary functions:

  1. Recording useful statistics for your subreddit. Artemis will compile statistics on the following and format it in a summary wikipage that's updated daily (see the sidebar on New Reddit or mobile of this subreddit for examples). This wikipage includes:

    • A monthly statistics breakdown of your community's posts and its activity (most active days, top submitters/commenters, top-voted posts).

    • Daily subscriber growth, both future and historical, as well as past and future subscriber milestones. (replacement and complement for FrontPageMetrics).

    • Traffic data, including the average uniques and pageviews for your community and its estimated traffic for the current month.

  2. Enforcing post flairs on your subreddit. Artemis will help make sure submitters choose an appropriate flair for their post. (flair enforcing can be turned off, if desired)

    • Artemis can especially help catch any posts that fall through the cracks of Reddit's own post requirements.

Other Artemis functions include, but are not limited to:

  • Restricting certain post flairs to certain days of the week.

  • Associating certain post flairs with Reddit tags like NSFW, Spoiler, or OC.

  • A breakdown of the userflairs of your community and how many people have each userflair.

For more detailed information, please see the FAQ.

I want Artemis to assist my subreddit!

Awesome! It's super easy to add Artemis as a moderator to your subreddit:

  1. Use the guide below to determine what kind of mode suits your subreddit best.

  2. Invite u/AssistantBOT1 (please note the number!) from your subreddit's moderators page at https://www.reddit.com/r/SUBREDDIT/about/moderators with the most suitable moderator permissions.

  3. The bot will accept your invite and reply with a confirmation message.

Note: Artemis will enforce post flairs for subreddits of any size, but will pause statistics-gathering if a subreddit is below 25 subscribers and resume statistics-gathering when it has reached that threshold.

As of January 2021, the original instance of Artemis is no longer accepting new invites - invites should instead be sent to the instance at u/AssistantBOT1.

Flair Enforcing Modes

Artemis's flair enforcing modes are determined by the moderator permissions it has:

  • Default mode

    • If you just want Artemis to provide statistics information and remind OPs but not remove unflaired posts, invite it with the Manage Wiki Pages permission.

  • Strict mode (optional)

    • If you'd like Artemis to proactively remove posts that do not have a flair until their author selects one, invite it with the Manage Wiki Pages and the Manage Posts and Comments permissions.

  • + enhancement (optional, but recommended)

    • If you would like submitters to be able to simply select a flair with a reply to Artemis's flair enforcement messages, also invite Artemis with the Manage Flair permission.

    • This enhancement is recommended as it allows users across all platforms to easily select flairs, even if their Reddit client doesn't allow for flair selection.

Artemis will start enforcing post flairs once it accepts your moderator invite and will generate the first statistics page after midnight UTC.

Here's a table with a detailed breakdown of what the different flair enforcement modes are:

Moderator PermissionsFlair Enforcement ActionsMode Name
Manage Wiki PagesFlair reminder messages are sent to submitters who submit an unflaired post.Default
Manage Wiki Pages, Manage FlairFlair reminder messages are sent to submitters who submit an unflaired post. Submitters can select a flair by responding to the messages with a flair text.Default+
Manage Wiki Pages, Manage Posts and CommentsFlair reminder messages are sent to submitters who submit an unflaired post. Unflaired posts are removed until submitters select a flair.Strict
Manage Wiki Pages, Manage Posts and Comments, Manage Flair / EverythingFlair reminder messages are sent to submitters who submit an unflaired post. Unflaired posts are removed until submitters select a flair. Submitters can select a flair by responding to the messages with a flair text.Strict+

Settings

Artemis is explicitly designed to be easy-to-use and consequently by default doesn't have "settings" apart from the moderator permissions noted in the table above. Moderators can choose to turn off flair enforcing if they want, retaining only Artemis's statistics-gathering function.

If you are comfortable with code and want to change some finer aspects of flair enforcing, please see this page for information on the optional advanced configuration.

Data

All of the data that Artemis collects, except for an individual subreddit's traffic data, is publicly available through Reddit's API or through other public data sources like Pushshift. Posts and subscriber statistics are pulled once daily and traffic data is pulled every month.

Removing Artemis from a subreddit's moderation team automatically terminates all statistics-gathering for the sub. You can find the source code for Artemis here. Artemis is published under the open-source MIT License.

About the Writer

I (u/kungming2) am the writer and maintainer of u/translator-BOT (Wenyuan and Ziwen), among many others. My bot Wenyuan has been keeping detailed statistics for r/translator for four years. I wanted to write a new statistics and flair enforcement bot for some of the other communities that I moderate and decided to share it with fellow moderators as well.


Please feel free to comment below if you have any questions about Artemis or its operations!


r/AssistantBOT • • Nov 30 '19

Update Accounting for variations in getting new posts from 250+ moderated subreddits

4 Upvotes

A slightly technical post here, but please bear with me!

I was messaged yesterday by u/Perito of r/Lebanon alerting me that Artemis had missed a couple of unflaired posts on the subreddit, and none of those posts were by moderators. I also checked r/wow and r/apexlegends and noticed a couple of unflaired posts on their front pages as well. What was especially puzzling was that none of these posts even showed up in the bot's logs as having been processed by the bot.

The Problem

I began to suspect there was a limitation with r/mod/new, which is where the bot pulls new submissions from. For a while now visiting that page has displayed this notice - and Artemis passed the 250 moderated subreddits (incl. private ones) milestone all the way back in May of this year. My suspicion was that there was a limit of 250 subreddits for r/mod, just like the regular front page one sees, which would adversely affect the bot's ability to consistently process all posts in its moderated subreddits.

Using PRAW to fetch posts from r.new('mod') returned different results that appear to indicate that a smaller subset is being fetched, through a script I wrote to test this out.

The script fetches 1000 posts from r.new('mod') several times in quick succession, and saves the IDs from those posts in a list. After it's done fetching posts, it takes the first set (Set Zero) of 1000 post IDs and compares the following sets to it and calculates the similarity with difflib. A previous run with 100 posts obtained some very concerning results, but even with several newer runs of the script, I got the following results:

Run 1:

Set Number% Similarity Compared to Set Zero
Set 198.60% similarity
Set 298.30% similarity
Set 398.80% similarity
Set 498.70% similarity
Set 598.00% similarity
Set 698.10% similarity
Set 798.90% similarity
Set 898.00% similarity
Set 998.40% similarity
Set 1097.90% similarity

Run 2 (with a list of the subreddits that the differing posts are in):

Set Number% Similarity Compared to Set ZeroSubreddits of Differing Posts
Set 197.60% similarityr/IdleHeroes, r/futanari, r/Archero, r/modernwarfare, r/TikTokCringe, r/Roleplaykik, r/deadbydaylight, r/wow, r/feemagers, r/wacom, r/GhostRecon, r/4kTV, r/FREE, r/BorderlandsGuns, r/exmormon, r/DungeonsAndDragons, r/classicwow, r/ShitPostCrusaders, r/JapanTravel, r/JusticeServed, r/apexlegends
Set 299.10% similarityr/MedicalGore, r/SWGalaxyOfHeroes, r/modernwarfare, r/KendrickLamar, r/deadbydaylight, r/classicwow, r/JapanTravel, r/FortniteSavetheWorld
Set 398.60% similarityr/DokkanBattleCommunity, r/The_Best_NSFW_GIFS, r/Archero, r/modernwarfare, r/realmadrid, r/deadbydaylight, r/wow, r/HomeworkHelp, r/TikTokCringe, r/FLMedicalTrees, r/findareddit, r/TakeaPlantLeaveaPlant, r/borderlands3
Set 499.10% similarityr/modernwarfare, r/bostontrees, r/succulents, r/feemagers, r/IMTM, r/ShitPostCrusaders, r/BorderlandsGuns, r/DungeonsAndDragons, r/borderlands3
Set 599.20% similarityr/DokkanBattleCommunity, r/forhonor, r/wow, r/smpearth, r/collapse, r/classicwow, r/KimetsuNoYaiba

As one can see, literally none of the sets match, and there are subreddits that are being omitted. The same was true when a couple of other moderators who mod more than 250 subreddits tested my script on their accounts. This might also account for why starting in the middle of the year, a couple of mods who had newly added Artemis to their subreddit would message me saying that the bot hadn't picked up their post, only to have it work randomly a few minutes later. In practice this issue has been mitigated by the fact that Artemis has multiple cycles of fetching posts within the same hour, but the chances of posts being missed is still there, and 2% variance is quite high.

The Solution (?)

This is a niche problem, to be sure. There is only one other active single-account bot - u/MAGIC_EYE_BOT - that moderates more than 250 subreddits and processes posts. The most obvious solution is to make more than one account for the same bot but that is impractical for Artemis as it would require people to reinvite a new account as moderator.

What I've come up with is to split the list of moderated subreddits into smaller chunks that are in sets of ~125 and get the new submissions from these smaller chunks instead, since Reddit allows one to get posts from multi-reddits in the form of subreddit1+subreddit2+subreddit3.... This will add a little bit of time to each time that Artemis fetches new subreddits, but the results are more consistent. Smaller sets (<100) still display similar variations, so that seems to be unavoidable.

This new method will be implemented in Artemis v1.6.31 Ginkgo today.

Run 1 (sets of 125):

Set Number% Similarity Compared to Set ZeroSubreddits of Differing Posts
Set 199.45% similarityr/fantasybball, r/GiftIdeas, r/dragonballfighterz, r/classicwow, r/Warthunder, r/rule34, r/fatestaynight, r/deadbydaylight, r/CreatorServices, r/dating, r/SimplyFortnite, r/tf2, r/hometheater, r/ShitPostCrusaders, r/ac_newhorizons, r/BDSMpersonals, r/modernwarfare, r/MobileLegendsGame, r/indonesia
Set 299.30% similarityr/AskEurope, r/windows, r/adderall, r/attackeyes, r/realmadrid, r/SmashBrosUltimate, r/Logic_301, r/ShitPostCrusaders, r/deadbydaylight, r/forhonor, r/Antiques, r/CryptoCurrencies, r/TikTokCringe, r/JusticeServed, r/mixer, r/NewTubers, r/rule34, r/modernwarfare, r/feemagers, r/apexlegends, r/DungeonsAndDragons
Set 399.48% similarityr/musictheory, r/AnimeKisa, r/dxm, r/codevein, r/fatestaynight, r/SimplyFortnite, r/tf2, r/Choices, r/NianticWayfarer, r/succulents, r/ShitPostCrusaders, r/wacom, r/BDSMpersonals, r/modernwarfare, r/BorderlandsGuns, r/wow, r/CODZombies
Set 499.25% similarityr/DokkanBattleCommunity, r/MtvChallenge, r/deadbydaylight, r/codevein, r/GenZ, r/NameThatSong, r/Slipknot, r/Mcat, r/Muse, r/RaidShadowLegends, r/rule34, r/CODZombies, r/travisscott, r/modernwarfare, r/nuzlocke, r/Roleplaykik, r/collapse, r/legaladvicecanada, r/TheGoodPlace, r/exmormon, r/borderlands3, r/apexlegends, r/pyrocynical
Set 599.25% similarityr/DokkanBattleCommunity, r/pcgamingtechsupport, r/HomeworkHelp, r/Archero, r/deadbydaylight, r/forhonor, r/codevein, r/Banking, r/Fantasy_Football, r/dragonballfighterz, r/Warthunder, r/RaidShadowLegends, r/Choices, r/hometheater, r/fo76FilthyFleaMarket, r/backrooms, r/windows, r/BollyBlindsNGossip, r/GhostRecon, r/borderlands3, r/MovieSuggestions, r/zelda, r/succulents, r/modernwarfare, r/apexlegends

Run 2 (sets of 125):

Set Number% Similarity Compared to Set ZeroSubreddits of Differing Posts
Set 199.35% similarityr/modernwarfare, r/CODZombies, r/Lovestruck, r/TheArcana, r/deadbydaylight, r/windows, r/rule34, r/NianticWayfarer, r/pcgamingtechsupport, r/GundamBattle, r/apexlegends, r/tf2, r/DokkanBattleCommunity, r/ShitPostCrusaders, r/FLMedicalTrees, r/pokemongo, r/borderlands3, r/Muse, r/BorderlandsGuns, r/borderlandsredcross
Set 299.30% similarityr/deadbydaylight, r/Windows10, r/zelda, r/Foofighters, r/dragonballfighterz, r/Roleplaykik, r/aws, r/nuzlocke, r/BorderlandsGuns, r/HomeworkHelp, r/Logic_301, r/gachagaming, r/modernwarfare, r/Morocco, r/apexlegends, r/UCSD, r/TheGoodPlace, r/GiftIdeas, r/FortniteSavetheWorld, r/succulents, r/ShitPostCrusaders, r/SmashBrosUltimate, r/Archero, r/borderlandsredcross
Set 399.52% similarityr/modernwarfare, r/DungeonsAndDragons, r/gachagaming, r/deadbydaylight, r/TikTokCringe, r/HomeworkHelp, r/Windows10, r/DenzelCurry, r/succulents, r/ShitPostCrusaders, r/exmormon, r/borderlands3, r/Muse, r/SmashBrosUltimate, r/bose, r/forhonor
Set 499.22% similarityr/modernwarfare, r/twicemedia, r/deadbydaylight, r/windows, r/TikTokCringe, r/rule34, r/Mcat, r/codevein, r/Drifting, r/apexlegends, r/MakeupLounge, r/PeePersonals, r/ShitPostCrusaders, r/NonBinary, r/succulents, r/nuzlocke, r/BorderlandsGuns, r/SmashBrosUltimate, r/Logic_301, r/bollywood
Set 599.45% similarityr/modernwarfare, r/UCSD, r/deadbydaylight, r/pyrocynical, r/Twitch, r/bingbongtheorem, r/Addons4Kodi, r/MinecraftCommands, r/FoodFantasy, r/pesmobile, r/apexlegends, r/SWGalaxyOfHeroes, r/ShitPostCrusaders, r/FLMedicalTrees, r/Minecraft_Earth, r/exmormon, r/borderlands3, r/Warthunder, r/BorderlandsGuns, r/dating

Run 3 (sets of 50):

Set Number% Similarity Compared to Set ZeroSubreddits of Differing Posts
Set 199.54% similarityr/deadbydaylight, r/TikTokCringe, r/SmashBrosUltimate, r/Roleplaykik, r/NonBinary, r/forhonor, r/modernwarfare, r/MemeTemplatesOfficial, r/thebachelor, r/hometheater, r/pokemongo, r/CODZombies, r/rule34, r/JusticeServed, r/exmormon, r/apexlegends, r/wow, r/SWGalaxyOfHeroes, r/Minecraft_Earth, r/futanari, r/borderlands3, r/Addons4Kodi, r/NewTubers, r/DungeonsAndDragons, r/BDSMpersonals, r/ShitPostCrusaders, r/GiftIdeas, r/AssassinsCreedOdyssey
Set 299.51% similarityr/deadbydaylight, r/TikTokCringe, r/succulents, r/nasa, r/dresdenfiles, r/BlackPink, r/codevein, r/Slipknot, r/forhonor, r/Songwriters, r/modernwarfare, r/NameThatSong, r/classicwow, r/Warthunder, r/RaidShadowLegends, r/FortniteSavetheWorld, r/residentevil, r/rule34, r/wow, r/ToolBand, r/borderlands3, r/BleachBraveSouls, r/DuelLinks, r/DungeonsAndDragons, r/ShitPostCrusaders, r/moldova, r/GiftIdeas, r/dating, r/travisscott
Set 399.57% similarityr/deadbydaylight, r/TheArcana, r/TikTokCringe, r/nasa, r/PremierLeague, r/Roleplaykik, r/NonBinary, r/Songwriters, r/modernwarfare, r/NameThatSong, r/classicwow, r/thebachelor, r/hometheater, r/fo76FilthyCasuals, r/Tangled, r/exmormon, r/apexlegends, r/borderlands3, r/nuzlocke, r/DungeonsAndDragons, r/feemagers, r/ShitPostCrusaders, r/GiftIdeas, r/TheGoodPlace
Set 499.63% similarityr/TikTokCringe, r/GenZ, r/succulents, r/Kirby, r/HomeworkHelp, r/realmadrid, r/forhonor, r/tf2, r/modernwarfare, r/graphic_design, r/FREE, r/RaidShadowLegends, r/residentevil, r/Muse, r/S10wallpapers, r/BorderlandsGuns, r/rule34, r/exmormon, r/DuelLinks, r/pcgamingtechsupport, r/ShitPostCrusaders, r/dating, r/PelvicFloor, r/Fantasy_Football, r/travisscott
Set 599.43% similarityr/deadbydaylight, r/dragonballfighterz, r/boxoffice, r/pesmobile, r/SmashBrosUltimate, r/HomeworkHelp, r/NonBinary, r/forhonor, r/KendrickLamar, r/DokkanBattleCommunity, r/CallOfDuty, r/modernwarfare, r/Windows10, r/dxm, r/classicwow, r/Warthunder, r/MemeTemplatesOfficial, r/FortniteSavetheWorld, r/RaidShadowLegends, r/weightlifting, r/fo76FilthyCasuals, r/Muse, r/adderall, r/rule34, r/exmormon, r/apexlegends, r/borderlands3, r/futanari, r/SWGalaxyOfHeroes, r/DungeonsAndDragons, r/GundamBattle, r/ShitPostCrusaders, r/fatestaynight, r/Twitch

r/AssistantBOT • • Nov 05 '19

Announcement Statistics on the growth of moderator bots on Reddit

Thumbnail
self.botwatch
3 Upvotes

r/AssistantBOT • • Jan 01 '20

Status Artemis was down for a few hours today, now it's back up

11 Upvotes

Hey mods,

For some reason the Pi 4 on which Artemis is hosted has been experiencing occasional out-of-memory errors which results in Raspbian killing the process. :( So it was down for a few hours today but I have since restarted the process. Sorry about that!

What a way to start the new year, eh? I think I'm going to have to fork out the money for a 4GB Pi 4 as the 1GB one that it's on clearly can't cope.

Please let me know if it's down again.

Edit: 4GB Pi 4 ordered, I'll deploy it on Sunday or Monday.


r/AssistantBOT • • Dec 06 '19

Announcement Testing allowing for mod invites during the statistics cycle

4 Upvotes

Ever since v1.2 Cedar, released back in January, Artemis has not processed moderation invites during the daily statistics cycle that begins at midnight UTC. The reason for this is because initializing a new subreddit's data, which is done upon accepting an invite, historically could take up to ~6-8 minutes per subreddit. The precaution was to avoid having Artemis being "stuck" initializing data for long periods of time while it should actually be processing statistics and the like. Three invites at a time (which has happened multiple times before) could result in an initialization period of almost half-an-hour. Thus, I figured the best thing to do was to simply defer moderation invites until after statistics were done.

As more and more subreddits use Artemis (from 83 in January to almost 600 now), the statistics cycle has also become longer since there's more to process in the first place. This meant that in an extreme scenario it could take up to five hours for a mod invite to be accepted by the bot. This isn't the most user-friendly scenario, so starting from tomorrow I'm going to test the resumption of allowing for mod invites during the statistics cycle again.

There are a couple of changes that make this possible:

  1. The addition of a "mod invite counter" to prevent the bot from processing too many subreddit invites per cycle. The regular limit is 3, but during a statistics cycle that counter is lowered to 1, which means that Artemis will space out its invites accordingly. So, theoretically, if Artemis got 6 invites at once, it would process them across 6 statistics cycles or 2 regular cycles.

  2. Streamlining the initialization process itself. Basically the way I was able to get historical subscriber data from Pushshift in the past was to get a list of days, and then make a request for each day for the earliest submission per day. It worked, but that meant 600+ API calls, one for each day. The function was reasonably quick in November 2018 when I launched Artemis, but a year+ on, it was taking up a large chunk of time since more days have passed. Artemis now grabs larger chunks of 750 submissions for a week, and if there are still missing days, fills those holes with manual calls for those days. This cuts the function run time from ~5-6 mins to about 70 seconds, and total initialization time per subreddit to just over 2 minutes.

TL;DR: I've made some changes that should allow for Artemis to accept moderator invites at any point in the day, starting tomorrow.


Edit: So far, so good. This has been operating with no issues for almost two weeks now.


r/AssistantBOT • • Dec 01 '19

Announcement Introducing Artemis Takeout, a way to easily get a copy of your subreddit's data!

6 Upvotes

Hi moderators!

When I was first writing Artemis, my original idea was that the raw statistics data for each subreddit could be stored on the subreddit's own wiki and moderators could look at the raw data whenever they wanted. Unfortunately this idea quickly proved impractical because as it turns out accessing and re-accessing wikis can be quite slow when you've got several subreddits to manage, much less several hundred. So I wrote Artemis to use a local SQLite database instead, and that's what it still uses.

But ever since I released Artemis a year ago I've wanted to do something thematically similar in terms of data transparency, as ultimately your subreddit's data is yours to do whatever you want with! And while Artemis's statistics pages are nicely organized and everything, it's not in a machine-readable format that would allow for mods to use other analytical tools to parse, and in fact Artemis's database contains more data that can be shown on the statistics page due to length limitations.

With Artemis v1.7 Hazel, out today, I've added Artemis Takeout!

This allows you to easily obtain a copy of your subreddit's Artemis data in JSON, a lightweight data-interchange format widely used in the world.

(The name is inspired by Google Takeout, which is a service that allows you to export your data from Google.)

Why would I want to do this?

  • To keep a local backup of the statistics Artemis has gathered for your subreddit.

  • For full transparency and insight into what Artemis has recorded for your subreddit.

  • To see the full day-by-day subscriber growth of your subreddit, since that has been truncated due to length of the statistics pages Artemis generates.

  • To run your own scripts and independent analysis on the data.

How do I get my subreddit's data via Artemis Takeout?

It's super easy!

  1. Just send a modmail message from your subreddit to u/AssistantBOT with takeout in the subject line.

  2. Artemis will collect all your subreddit's data, format it in JSON, and upload it to an unlisted paste on Pastebin in its reply.

  3. That paste will be valid for 1 hour, giving you and other moderators more than enough time to download or copy the data.

Can I see an example of what Takeout data looks like?

Sure, check out the takeout data for r/testingground4bots (a subreddit I mod) here.

Notes

  • Artemis Takeout does not include userflair statistics, since that data is generated on-the-fly by Artemis and never stored in its database.

  • A reminder that all the data in Takeout that Artemis has gathered, with the exception of traffic data, is all publicly available through various APIs.

  • If your subreddit used to use Artemis, but no longer does, you can still get your Takeout data from the time when the bot was actively gathering statistics for your subreddit.

  • I use pbwrap to interface with the Pastebin API.


r/AssistantBOT • • Jan 16 '20

Announcement Introducing Artemis Query, a way to easily see the flair enforcement actions Artemis has performed!

5 Upvotes

The release of version 1.8 Icaco today brings a new tool for moderators to use: Artemis Query! As moderators may know, Artemis has consistently used messages instead of comments to carry out its actions. While that approach has many advantages, one disadvantage is that it can be hard to see what Artemis has done (or not done) on a post if that action does not appear in the moderation log for a subreddit.

Query is a service for subreddit moderators that allows them to easily see the flair enforcement actions Artemis has performed on recent(-ish) posts in their subreddit.

There are some actions that Artemis conducts on posts that cannot show up in the moderation log, like the initial fetching of a post by Artemis or a flair enforcement reminder in Default mode, because they are not "moderator actions." It allows for moderators to see the history of one or multiple posts in their subreddit, and builds upon the extensive action tracking that Artemis already does per-subreddit. It was originally conceived of as a troubleshooting tool for myself but I decided to open it up to broader use. A big thank-you goes to u/justcool393 for their advice and suggestions as I was working on this!

This is useful for:

  • Checking or troubleshooting what actions Artemis has done (or not done) on a post.

  • Providing proof to users who claim "censorship" that their post removal was entirely automated and due to their failure to follow post flairing rules.

Due to the large amount of data this entails, Artemis will only store the actions that were conducted on the last 60,000 posts or so, which works out to about the last five days' worth of data. This should be more than enough time to check any relevant posts. After all, Artemis only checks posts for flairs for up to 24 hours.

How do I use Artemis Query?

It's super easy!

  1. Just send a modmail message from your subreddit to u/AssistantBOT with query in the subject line.

  2. In the body of the message, include any of the following, separated by spaces, commas (,), semi-colons (;) or newlines:

    • Reddit post IDs (e.g. dc6i1a)

    • Reddit long-form URLs (e.g. https://www.reddit.com/r/AssistantBOT/comments/ein9k9/artemis_overall_statistics_201912/)

    • Reddit short-form URLs (e.g. https://redd.it/e4pwdh)

  3. Artemis will reply with the relevant information it found for your query.

Note that the bot is pretty tolerant of formatting for the query message. All of the following will work:

# Just Reddit IDs
envf7w, eouc49, eopyg2

# A mix of IDs and URLs
https://www.reddit.com/r/languagelearning/comments/eov35b/reliable_place_to_find_the_top_1000_words_of_a/ eoqi8t https://redd.it/eo397s

# Just URLs
https://redd.it/eoskbg https://www.reddit.com/r/ChineseLanguage/comments/eoo963/do_you_have_any_tips_for_memorizing_characters/

Spaces, commas (,), semi-colons (;) or newlines all work as separators.

What does an example query look like?

For each post Artemis will return a table detailing in chronological order the actions it performed along with supplementary information. Here's an example from r/Choices (in Strict+ mode):

Appreciation post for Gemma 😍😍 she’s stunning.

  • Post ID: eox1of

  • Author: u/mbpinney

  • Created: 2020-01-15T03:58:11Z

  • Current Post Flair: The Elementalists

  • Currently Removed?: False

Time (UTC)Action
2020-01-15T03:58:11ZUser created post
2020-01-15T04:09:32ZFetched post
2020-01-15T04:09:34ZRemoved post
2020-01-15T04:12:41ZRestored post
2020-01-15T04:12:42ZCleared post

Here's another example from r/ChineseLanguage (in Default+ mode):

New Language Learning apps

  • Post ID: eon48o

  • Author: u/GutsySporks

  • Created: 2020-01-14T15:58:52Z

  • Current Post Flair: Resources

  • Currently Removed?: False

Time (UTC)Action
2020-01-14T15:58:52ZUser created post
2020-01-15T06:01:20ZFlaired post
2020-01-15T06:01:22ZCleared post

Legend

Post ActionExplanation
User created postThe user created the post.
Fetched postArtemis fetched the post from Reddit. (at least 5 minutes after creation)
Skipped mod postArtemis detected that the post was created by a moderator and thus will not perform actions on it.
Skipped whitelist postArtemis detected that the post was created by a user on the whitelist and thus will not perform actions on it.
Restored postArtemis restored (that is, approved) the post. (Strict mode)
Flaired postArtemis flaired a post through messaging (Default mode, or Strict mode with this setting on False)
Other moderator removed postArtemis detected that another (human) moderator had manually removed the post.
Excessive reports on postArtemis detected that the post has an excessive number of outstanding reports (4+) on a post.
Author deletedArtemis detected that the post was deleted by its author.
Cleared postArtemis stopped checking the post for flair updates, either because the post was flaired and restored or because it is older than 24 hours. (Strict mode)

Note that "Cleared post" will almost always be the last action in a table provided by Query, and "User created post" will obviously always be the first action.

Notes

  • Query only works for subreddits which have flair enforcement on.

  • Posts queried must be of the subreddit the message is from, for privacy's sake. If the message comes from, say, r/ChineseLanguage, the bot will only return information for posts that are in r/ChineseLanguage.

    • If passed an ineligible query for the wrong subreddit, or if the query is for a post no longer in the database, Artemis will just skip it.

  • All dates and times retrieved through Query are in UTC and are strictly formatted according to ISO 8601.


r/AssistantBOT • • Feb 01 '20

Statistics Hostile Replies to Bot Messages

10 Upvotes

The vast majority of messages to Artemis are just for flairing posts, and in fact the majority of non-flairing posts are actually positive and thankful, or people apologizing for forgetting to flair or being new to Reddit. But sometimes, people say mean stuff to the bot, on average a message every couple of days, which actually isn't too bad considering the bot sends thousands of messages every day.

With v1.8 Artemis can log messages that weren't exact flair matches if the message:

  1. Was matched to a post flair via fuzzing

  2. Was matched to a post flair as one was found in text

  3. Was not matched to a post flair at all

Unsurprisingly, the vast majority of hostile replies fall under category 3 here. On average 1 out of 63 logged messages are hostile (I estimate 1 out of ~200 overall) and also unsurprisingly many are from gaming subreddits, particularly r/modernwarfare. Here's an anonymized sample:

DateSubredditActionReceived Message
2020-01-19r/pokemongoNonejesus, you guys are too uptight for what should be a fun community.
2020-01-20r/emkay[action]you can lick and suckle your mothers teet
2020-01-20r/shieldbroNonereally? this bot should be deleted and shat on
2020-01-23r/apexlegendsNonehow do you apologize for the inconvenience when you do it anyway.. dummies
2020-01-24r/modernwarfare[action]really? my post is blowing up, getting a lot of feedback and you are going to take it down because it does not have a “flair” ? suck me dry.
2020-01-24r/veteransNoneflair my dick! how does that sound?
2020-01-24r/veteransNonewhat is this gay shit?
2020-01-24r/modernwarfareNonewhat!? are you joking ? it would t let me post it unless i chose a a flair and a tag to post along too an now the moderators have removed it because of a tag!?!? nonsense more like they don’t want no one ranting bout there favourite game because the developers watch the forums this is a joke can’t even express my opinion an get advice before of stupid limitations because i didn’t put a “flair”? thanks reddit great job real helpful
2020-01-25r/swgalaxyofheroesNoneduck you and your flair you cunt, duck you man and the fuck you!
2020-01-28r/dokkanbattlecommunityNonei don't get that stupid ass rule. its a dokkan post, fuck off.
2020-02-01r/modernwarfareNonelmao suck my dick w that goofy bullshit
2020-02-01r/modernwarfareNoneso fucking annoying

r/AssistantBOT • • Jan 01 '20

Statistics Artemis Overall Statistics — 2019-12

4 Upvotes

Hey mods!

I'm starting a new monthly update for r/AssistantBOT that shares data about the subreddits that were added over the last month, the number of daily posts recorded, and the number of daily actions the bot has done. This is modeled after my bot Wenyuan's monthly language statistics for r/translator.

I added new code in the bot to support recording actions by day at the end of December 5, 2019, so for this month the results begin at that particular date. Previously actions were only recorded on a per-subreddit basis with no ability to break down overall actions by date.

Happy new year!

Added Subreddits

Daily Processed Posts

DayNumber of Posts
2019-12-0512,479
2019-12-0612,403
2019-12-0711,795
2019-12-0812,460
2019-12-0912,805
2019-12-1012,279
2019-12-1112,520
2019-12-1212,323
2019-12-1312,878
2019-12-1411,927
2019-12-1512,366
2019-12-1612,504
2019-12-1712,442
2019-12-1812,434
2019-12-1912,331
2019-12-2012,378
2019-12-2111,630
2019-12-2211,507
2019-12-2311,688
2019-12-2411,504
2019-12-2510,542
2019-12-2610,878
2019-12-2711,900
2019-12-2811,258
2019-12-2911,705
2019-12-3011,805
2019-12-3111,881
Total324,622

Daily Actions

DayExported takeout dataFlaired postRemoved postRestored postSent flair reminderUpdated configurationUpdated statisticsUpdated userflair statistics
2019-12-05---2625012173---------
2019-12-06---2432,1571,148664---549---
2019-12-07---2242,0981,082633---554---
2019-12-0812072,2301,2066542557---
2019-12-09---2032,1261,1406542556---
2019-12-10---2072,0781,106613---556---
2019-12-11---2052,3631,2476671556---
2019-12-12---1882,2101,2066565558---
2019-12-13---1422,1341,195698---561---
2019-12-14---1391,9311,108644---561---
2019-12-15---1732,0811,154722156111
2019-12-16---1422,0701,131663---564---
2019-12-17---1452,2711,298744---569---
2019-12-18---1602,1391,173670---573---
2019-12-19---2372,2271,196775---572---
2019-12-20---2062,2581,209625---574---
2019-12-21---1532,0171,072632---574---
2019-12-22---1231,9771,093635---575---
2019-12-23---1212,0671,1376491577---
2019-12-24---1182,1081,154664---577---
2019-12-25---1072,0481,1205622580---
2019-12-26---1232,1121,154536---580---
2019-12-27---1412,2661,218617---585---
2019-12-28---1102,0701,148615---585---
2019-12-29---1062,0851,124568---587---
2019-12-30---1172,0951,1626353589---
2019-12-31---1252,1301,171625---592---
Total14,19155,59830,27316,8931714,82211

r/AssistantBOT • • Feb 27 '20

Announcement Required post flair is now natively available on Old Reddit (not iOS yet)

Thumbnail
self.modnews
4 Upvotes

r/AssistantBOT • • Nov 26 '19

Documentation Artemis's source code on GitHub updated to the latest version (v1.6)

5 Upvotes

It's been a while since I updated my repository for Artemis, mainly due to the fact that my desktop installation of GitHub Desktop encountered some issues last year and I never (and still haven't) fixed that.

As such, the version of Artemis that was hosted on my GitHub page remained at v1.0 Aspen, the first version of the bot, sans additions such as flaring via messaging, some bug fixes, etc. It was/is still perfectly functional code, as evidenced by the fact that there are a couple of forked versions of Artemis v1.0 Aspen running for specific subreddits as of this writing (thanks to their deployers for giving me a heads-up).

For a long time I felt no urgency in updating the source code to the latest version and figured I would get around to syncing my VCS again sometime. However, the recent controversy over the deactivation of BotBust, the most widely-used moderation bot on Reddit, led me to update the code again:

  • While BotBust's creator had published the source code of BotBust on his GitHub page and granted permission to others to run copies of the bot, it was never properly licensed and said permission was explicitly revoked for versions of the code after January 3, 2019.

  • The fate of BotBust and the infamous downfall of BotWatchman and flair_your_post_bot three years ago, all of which were never properly open-sourced, revealed the dangers of adding moderation bots to one's community without proper transparency of their creator's code.

    • As I've said on the FAQ for over a year: Adding a bot to a subreddit's mod team takes a lot of trust.

  • If a moderation bot goes down for some reason or another, or if a bot creator goes "rogue" (see above), others on Reddit should be able to start it up again, and making sure the latest code is up-to-date greatly aids that effort. After BotBust went down, it took some time for both replacements, u/BotTerminator and u/BotDefense, to become active because their writers essentially had to start from scratch.

Artemis is now the second-largest moderation bot on Reddit since BotBust was deactivated and I felt it was high time I updated my repository with the most recent version of its code.

You can find the updated source code for Artemis v1.6 here.

This version, as with the original v1.0, is licensed under the open-source MIT (Expat) License and while I obviously prefer people to use Artemis itself, people are welcome to fork the code and customize it to their heart's content as long as they attribute the code and include the permission notice per the terms of the license. Just don't judge my code too harshly! I still haven't properly synced up my VCS with GitHub 😅 so the update appears as a single mass commit.

I'm committed to giving as much transparency as I can give for Artemis; that is, basically everything short of revealing monitored subreddits' specific information (which is and should be private to their moderators unless they choose to make their statistics public) and Artemis's own security credentials.


r/AssistantBOT • • Feb 01 '20

Statistics Artemis Overall Statistics — 2020-01

5 Upvotes

This is the first full month of actions data for Artemis.

Added Subreddits

Daily Processed Posts

DateNumber of Posts
2020-01-0111,469
2020-01-0212,107
2020-01-0312,602
2020-01-0412,323
2020-01-0512,194
2020-01-0611,934
2020-01-0712,778
2020-01-0812,297
2020-01-0912,276
2020-01-1013,096
2020-01-1112,563
2020-01-1212,915
2020-01-1312,482
2020-01-1412,914
2020-01-1513,160
2020-01-1613,730
2020-01-1713,471
2020-01-1813,252
2020-01-1913,164
2020-01-2013,436
2020-01-2113,131
2020-01-2213,242
2020-01-2313,599
2020-01-2414,550
2020-01-2513,267
2020-01-2613,896
2020-01-2713,601
2020-01-2814,047
2020-01-2914,927
2020-01-3014,886
2020-01-3114,414
Total407,723

Daily Actions

DateExported takeout dataFlaired postRemoved postRestored postRetrieved query dataSent flair reminderUpdated configurationUpdated statisticsUpdated userflair statistics
2020-01-01---501,543836---461---594---
2020-01-02---1202,1391,213---630---596---
2020-01-03---1392,2121,198---639---597---
2020-01-04---1151,8561,033---541---597---
2020-01-05---1202,0831,161---609---598---
2020-01-061992,1691,203---5971597---
2020-01-07---1052,2021,265---6341597---
2020-01-08---1361,9961,147---664---597---
2020-01-09---791,9131,082---579---599---
2020-01-10---981,9591,119---583---603---
2020-01-11---1021,8111,043---644---604---
2020-01-12---991,9201,038---613---604---
2020-01-13---951,785992---562---608---
2020-01-14---1102,0261,166---618---608---
2020-01-15---1012,0941,188---64913607149
2020-01-16---742,0751,259---998---607---
2020-01-17---902,0101,161---720---607---
2020-01-18---811,9681,094---640---608---
2020-01-19---711,9031,055---591---610---
2020-01-20---841,9521,127---600---611---
2020-01-21---791,9031,123---548---613---
2020-01-22---1062,0521,110---570---613---
2020-01-23---1302,2361,215---601---614---
2020-01-24---1072,0331,155---616---614---
2020-01-25---1102,1341,155---520---614---
2020-01-26---992,0731,163---573---617---
2020-01-27---1012,1211,268---540---618---
2020-01-28---982,2271,262---5961620---
2020-01-29---892,2771,327---700---625---
2020-01-30---832,4251,4261690---630---
2020-01-31---932,3971,375---625---633---
Total13,06363,49435,959119,1511618,860149

r/AssistantBOT • • Mar 01 '20

Statistics Artemis Overall Statistics — 2020-02

3 Upvotes

Here's the data for February 2020 for Artemis!

Added Subreddits

Daily Processed Posts

DateNumber of Posts
2020-02-0113,986
2020-02-0214,460
2020-02-0314,004
2020-02-0413,796
2020-02-0514,339
2020-02-0614,299
2020-02-0714,582
2020-02-0813,540
2020-02-0914,209
2020-02-1014,503
2020-02-1114,209
2020-02-1214,812
2020-02-1315,060
2020-02-1415,079
2020-02-1513,956
2020-02-1614,595
2020-02-1715,102
2020-02-1815,232
2020-02-1914,738
2020-02-2015,047
2020-02-2115,084
2020-02-2214,186
2020-02-2314,971
2020-02-2414,708
2020-02-2515,348
2020-02-2614,875
2020-02-2714,645
2020-02-2814,680
2020-02-2914,052
Total422,097

Daily Actions

DateExported takeout dataFlaired postRemoved postRestored postRetrieved query dataSent flair reminderUpdated configurationUpdated statisticsUpdated userflair statistics
2020-02-01---962,1931,238---646---634159
2020-02-02---1092,3441,258---630---635---
2020-02-03---992,2701,274---5393635---
2020-02-04---1072,2821,335---553---636---
2020-02-05---982,3581,365---628---637---
2020-02-06---932,0821,222---6661639---
2020-02-07---992,1741,265---735---641---
2020-02-08---882,0831,167---655---643---
2020-02-09---872,1571,168---6091643---
2020-02-10---1092,2151,262---623---643---
2020-02-11---1362,2221,226---641---646---
2020-02-12---1652,4751,245---645---649---
2020-02-13---1342,4021,282---639---650---
2020-02-14---1282,3191,250---648---650---
2020-02-15---1322,1761,121---610---651164
2020-02-16---1122,1881,198---567---653---
2020-02-17---1382,2811,210---646---653---
2020-02-18---1222,2771,290---7032653---
2020-02-19---1052,2191,205---635---656---
2020-02-20---1232,2171,214---6691654---
2020-02-21---1032,0811,159---637---655---
2020-02-22---1022,0981,140---621---655---
2020-02-23---922,2111,228---6912655---
2020-02-24---1082,0881,151---709---658---
2020-02-25---1052,2481,264---7272659---
2020-02-26---1392,2871,2491710---660---
2020-02-27---992,0251,181---669---660---
2020-02-28---801,803963---6583660---
2020-02-29---811,814946---627---663---
Total03,18963,58935,076118,7361518,826323

r/AssistantBOT • • Mar 02 '20

Announcement The Future of Artemis - open to feedback!

8 Upvotes

Reddit admins recently announced that they're rolling out post requirements across almost all versions of Reddit - new, old, and mobile app - which means that for the first time ever there is now a native solution to enforce post flair! As I wrote in the comments on the announcement, this is a very welcome change to Reddit that fixes a massive hole in Reddit - the inconsistencies between all the different platforms. I wrote Artemis to help fill this hole, and I'm glad that the site realizes it's important enough of an issue to finally deliver something moderators have been asking for for a long time.

In actuality, I had always hoped or anticipated that Reddit would make post flair requirements available across the site, and there were some comments in r/redditdev a few weeks ago hinting towards this announcement, so this did not come as a surprise. There is, however, an apparent limitation with the new requirements - posts submitted via mobile web or third-party apps that do not support post requirements can still be submitted without flair, and iOS is also currently not supported. So in the future some subreddits may still continue to see occasional posts without flair, though the number is likely to be far fewer than now.

So, where does that leave Artemis?

Of course, the funny thing is I was actually in the middle of re-organizing my code to split the flair-enforcing and statistics functions so that they could better cope with future growth - a project I mentally called intercision in my notes. But I think given the current situation it's probably worth waiting and see how everything pans out before working on that project further, I suspect the number of new subreddits that add Artemis will drop since the vast majority of subreddits going forward that need post flair enforcement will simply use the native post requirements system and be happy with that. But, Artemis's username is u/AssistantBOT, not u/FlairYourPostBot for a reason - because statistics are also a huge component of what it does and the value it provides to moderators. Statistics are not going away any time soon.

The way I see it, there are a couple of paths forward.

  1. Disable flair enforcing on u/AssistantBOT, make it a statistics-only bot.

  2. Keep flair enforcing on u/AssistantBOT to account for unflaired posts that have gotten through, keep statistics. Basically change nothing.

  3. Make flair enforcing on u/AssistantBOT explicitly opt-in, keep statistics.

My gut feeling at present is to do #2 and maybe transition to #3 if the number of unflaired posts drops dramatically in a few months, but if enough moderators feel that Artemis monitoring for unflaired posts is no longer useful I will change my plans to #1. I'm open to feedback!


r/AssistantBOT • • Oct 20 '19

Announcement 500 public subreddits, and a brief retrospective for Artemis

4 Upvotes

Artemis (u/AssistantBOT) is fast approaching its one-year anniversary - it first began operations on November 4, 2018 - and it recently just passed five hundred public subreddits. To mark the occasion I thought I'd jot down some thoughts on how far this little bot has come and my experience running it.

This Subreddit

My original plan was to keep everything related to u/AssistantBOT on the bot's user profile itself! But in September of this year Reddit's automated spam-detection systems accidentally shadow-banned Artemis twice and it turned out to be impossible for me to post a notice telling moderators that, since the user profile of a shadow-banned user is inaccessible to others! So this subreddit serves as an easy place for documentation and status updates to be posted. The posts indicating the new subreddits using Artemis will remain on the bot's user account.

Origins

I created Artemis for a simple reason: I needed its functions - statistics gathering and flair enforcement - on the other subreddits I moderate. While I had written Wenyuan and Ziwen to do those things on r/translator, both bots are inextricably tied to the peculiarities of that subreddit, down to expecting certain AutoModerator code and CSS. I couldn't simply gut Ziwen and run it on say, r/ChineseLanguage. I was also dissatisfied with the few remaining flair enforcement bots on Reddit and found their operations to be less-than-intuitive to new users.

So, I needed to write a new bot, one that would work across several subreddits and adapt to whatever settings that subreddit had already set up. I wrote the first version of the statistics routine on November 4th, and though bare-bones the results already contained sections for the three major things the statistics would track - posts, subscribers, and traffic. I finished the flair enforcement routine two days later and deployed Artemis on three of my subreddits, along with r/alcohol, whose then-mod had generously allowed me to beta test it on their community for statistics only.

Artemis was officially released to a broader audience on November 19, 2018.

Growing

After releasing Artemis, one thing became clear: Because the bot includes the post flairs themselves in its enforcement message, users would simply reply with the text of a post flair. But the bot couldn't process messages so these messages were initially pointless. Therefore I quickly rushed to make flair selection available with v1.1 Birch and since then flairing via messaging has become an integral part of the way Artemis operates.

As more and more subreddits started using Artemis, the statistics routine began to take up more and more time, resulting in long stretches of time after midnight UTC when the bot was just processing statistics and not able to conduct flair enforcement. A number of changes eventually resolved this issue: I built into the database a cache for Pushshift data so that the bot could make much fewer calls to the service, and also started flair enforcement runs in between statistics runs so that the response rate was much faster. One month ago I moved Artemis to a new Raspberry Pi 4 which also dramatically lowered the amount of time that it took to run statistics (about 3.5x faster).

Here's a chart showing the number of moderated subreddits over time.

Future

I plan to make certain aspects of the bot more customizable for moderators who want a bit more granular detail on how the bot operates. This will be completely optional in the next update, v1.6 Ginkgo, and will require moderators to know how to use YAML (the same syntax as AutoModerator). It will probably be the last update for the bot as it will address almost everything that has been on various moderators' wishlists.

Edit: v1.6 Ginkgo has been released with support for advanced configuration settings.

Overall Actions

I didn't build an action counter into Artemis until sometime in spring this year, so these numbers are not 100% of the actions the bot has ever done. The overall data shows that about 62% of removed posts are eventually flaired by their posters.

ActionCount
Flaired post9,215
Removed post261,328
Restored post161,894
Sent flair reminder98,027

Thanks

A huge thanks to u/SCOveterandretired, u/BuckRowdy, u/WandersFar, u/aphoenix, u/coloneljdog, u/langis_on, among many others who have been advocates for this bot and recommended it to other moderators to use! And to everyone who has given me feedback, suggestions, and helped with bug-fixing. Artemis could not have come this far without everyone's input.


r/AssistantBOT • • Oct 02 '19

Documentation Introduction to Artemis (u/AssistantBOT) III

18 Upvotes

❓ FAQ • 🔎️ Guide • 📓 Change Log • 🎚️ Advanced

Introducing Artemis (u/AssistantBOT), a flair enforcer and statistics bot for any subreddit!

  • Looking for an easy-to-use bot to help make sure your community's submitters remember to choose a post flair?

  • Want more detailed and extensive statistics on the health and growth of your community?

Artemis (u/AssistantBOT) is an easy-to-use and helpful Reddit bot written by a moderator for moderators to assist them with organizing and gaining insights into their own communities. (Now used on 500+ subreddits with over 27 million subscribers combined!)

Feel free to comment below if you have questions about Artemis. Or if you prefer Discord, click this link.

This is a repost of previous introduction posts, which have now been automatically archived. (1, 2.)

Functions (TL;DR)

Artemis has two primary functions:

  1. Recording useful statistics for your subreddit. Artemis will compile statistics on the following and format it in a summary wikipage that's updated daily (see the sidebar on New Reddit or mobile of this subreddit for examples). This wikipage includes:

    • A monthly statistics breakdown of your community's posts and its activity (most active days, top submitters/commenters, top-voted posts).

    • Daily subscriber growth, both future and historical, as well as past and future subscriber milestones. (replacement and complement for RedditMetrics).

    • Traffic data, including the average uniques and pageviews for your community and its estimated traffic for the current month.

    • A breakdown of the userflairs of your community and how many people have each userflair (optional).

  2. Enforcing post flairs on your subreddit. Artemis will help make sure submitters choose an appropriate flair for their post. (flair enforcing can be turned off, if desired)

For more detailed information, please see the FAQ.

I want u/AssistantBOT to assist my subreddit!

Awesome! It's super easy to add u/AssistantBOT as a moderator to your subreddit:

  1. Use the guide below to determine what kind of mode suits your subreddit best.

  2. Invite u/AssistantBOT from your subreddit's moderators page at https://www.reddit.com/r/SUBREDDIT/about/moderators with the most suitable moderator permissions.

  3. The bot will accept your invite and reply with a confirmation message.

Note: Artemis will enforce post flairs for subreddits of any size, but will pause statistics-gathering if a subreddit is below 25 subscribers and resume statistics-gathering when it has reached that threshold.

Flair Enforcing Modes

Artemis's flair enforcing modes are determined by the moderator permissions it has:

  • Default mode

    • If you just want Artemis to provide statistics information and remind OPs but not remove unflaired posts, invite it with the wiki permission.

  • Strict mode (optional)

    • If you'd like Artemis to proactively remove posts that do not have a flair until their author selects one, invite it with the wiki and the posts permissions.

  • + enhancement (optional, but recommended)

    • If you would like submitters to be able to simply select a flair with a reply to Artemis's flair enforcement messages, also invite Artemis with the flair permission.

    • This enhancement is recommended as it allows users across all platforms to easily select flairs.

Artemis will start enforcing post flairs once it accepts your moderator invite and will generate the first statistics page after midnight UTC.

Here's a table with a detailed breakdown of what the different flair enforcement modes are:

Moderator PermissionsFlair Enforcement ActionsMode Name
wikiFlair reminder messages are sent to submitters who submit an unflaired post.Default
wiki, flairFlair reminder messages are sent to submitters who submit an unflaired post. Submitters can select a flair by responding to the messages with a flair text.Default+
wiki, postsFlair reminder messages are sent to submitters who submit an unflaired post. Unflaired posts are removed until submitters select a flair.Strict
wiki, posts, flair / allFlair reminder messages are sent to submitters who submit an unflaired post. Unflaired posts are removed until submitters select a flair. Submitters can select a flair by responding to the messages with a flair text.Strict+

Settings

Artemis is explicitly designed to be easy-to-use and consequently by default doesn't have "settings" apart from the moderator permissions noted in the table above. Moderators can choose to turn off flair enforcing if they want, retaining only Artemis's statistics-gathering function.

If you are comfortable with code and want to change some finer aspects of flair enforcing, please see this page for information on the optional advanced configuration.

Data

All of the data that Artemis collects, except for an individual subreddit's traffic data, is publicly available through Reddit's API or through other public data sources like Pushshift. Posts and subscriber statistics are pulled once daily and traffic data is pulled every month.

Removing u/AssistantBOT from a subreddit's moderation team automatically terminates all statistics-gathering for the sub. You can find the source code for Artemis here.

About the Writer

I (u/kungming2) am the writer and maintainer of u/translator-BOT (Wenyuan and Ziwen) and u/LEGO_IDEAS_BOT, among others. My bot Wenyuan has been keeping detailed statistics for r/translator for over three years. I wanted to write a new statistics and flair enforcement bot for some of the other communities that I moderate and decided to share it with fellow moderators as well.

Please feel free to comment below if you have any questions about Artemis or its operations!


r/AssistantBOT • • Oct 28 '19

Announcement Artemis v1.6 Ginkgo with Advanced Configuration Settings now available!

4 Upvotes

Artemis v1.6 Ginkgo is now live and includes support for an optional advanced configuration page for moderators who wish to have a bit more granular control over some aspects of the bot's flair enforcement, among other things. Please note that these settings are intended for moderators who are familiar with YAML code (the same syntax as AutoModerator) and who have a specific idea of what they would like Artemis to do.

To see more information about this update, please visit this page on the wiki.

Special thanks to the moderators u/Wandersfar, u/LackingAGoodName, u/stopspammingme and u/neocharles for bug-testing v1.6 when it was in beta and giving great feedback on the features!


r/AssistantBOT • • Jan 08 '20

Update Update to the timing of when Artemis edits statistics wiki pages

8 Upvotes

As of today, I've implemented an update to when Artemis edits the 600-odd statistics pages that it maintains. Please note that this merely concerns the timing of the edits, rather than the process of gathering the statistics, which is unchanged.

For reference, the Subreddit Index is the order in which Artemis was added to a subreddit - earlier subreddits (like r/classicalchinese, r/languagelearning) will have a smaller number (2 and 4) and come before later ones (like r/classicwow) which will have bigger numbers (257). To find out your subreddit's Index number, just check at the top of your subreddit's statistics page.

Previously, statistics gathering worked this way:

  1. After midnight UTC, Artemis begins gathering statistics for all subreddits in groups, in the order of when they added the bot (the Subreddit Index).

  2. Once statistics gathering was complete, Artemis would edit and update all statistics pages sequentially in alphabetical order.

Basically this meant that all subreddits would get their pages updated at some point several (currently, about 7) hours after midnight UTC. But it meant that all subreddits had to wait the same amount of time before they got their updates, and if something (rarely) happened during the mass editing process, it would all stop. It also meant that as new subreddits were added, the editing time for all subreddits would drift slowly to the right and later and later.

I've changed it to this:

  1. After midnight UTC, Artemis begins gathering statistics for all subreddits in groups, in the order of when they added the bot (the Subreddit Index).

  2. Artemis will edit and update the statistics pages for each group after it's done with that group.

So what does that mean? In truth, not much... But! It means that if your Subreddit Index is smaller, you will see earlier updates to your statistics page that's closer to midnight UTC than before and that going forward that editing time will be more consistent as well.


r/AssistantBOT • • Oct 05 '19

Documentation Artemis Changelog

Thumbnail reddit.com
3 Upvotes

r/AssistantBOT • • Aug 16 '21

Statistics Artemis Overall Statistics — 2021-07

19 Upvotes

Here are more statistics.

Artemis Overall Statistics — 2021-07

Added Subreddits

Daily Processed Posts

DateNumber of Posts
2021-07-0119,648
2021-07-029,729
2021-07-039,072
2021-07-048,911
2021-07-059,159
2021-07-069,553
2021-07-079,725
2021-07-089,590
2021-07-0910,134
2021-07-1023,581
2021-07-114,673
2021-07-1219,719
2021-07-1325,271
2021-07-145,250
2021-07-1526,538
2021-07-165,055
2021-07-1723,287
2021-07-184,080
2021-07-1925,673
2021-07-205,370
2021-07-2124,943
2021-07-225,443
2021-07-2325,615
2021-07-245,276
2021-07-2517,662
2021-07-2625,498
2021-07-275,744
2021-07-2826,647
2021-07-295,996
2021-07-3025,958
2021-07-315,352
Total438,152

Daily Actions

DateFlaired postRemoved postRemoved unscheduled postRestored postSent flair reminderUpdated configurationUpdated statisticsUpdated userflair statistics
2021-07-01154933244454---370397
2021-07-02195354287445---783---
2021-07-03124351210353---71---
2021-07-04223893206380---74---
2021-07-05104332215421---75---
2021-07-06125042263421---72---
2021-07-07125312268437---71---
2021-07-08175103248405271---
2021-07-09166481279440---72---
2021-07-10164691226370---72---
2021-07-11154755231389---1,290---
2021-07-12175163267439---441---
2021-07-13125423298424---1,050---
2021-07-1485136275456---1,408---
2021-07-15134715261445---334407
2021-07-16174551230503---1,193---
2021-07-1717434---211478---554---
2021-07-18114721239435---1,309---
2021-07-19135253278482---441---
2021-07-20154856252584---1,196---
2021-07-21134601192565---554---
2021-07-2221396120956921,176---
2021-07-23144162203745---579---
2021-07-2412356218366011,142---
2021-07-25124154176654---622---
2021-07-26134493220659---959---
2021-07-27184681237696---1,036---
2021-07-28134863245655---731---
2021-07-29184636212717---1,043---
2021-07-30184971228606---725---
2021-07-31123912195605---1,040---
Total45314,632817,28815,892520,554804

r/AssistantBOT • • Oct 01 '22

Status Status of Artemis (yes, it's still running!)

12 Upvotes

Hey all, just wanted to give people a bit of this update on how Artemis is doing and the current state of the bot. Basically, the bot is still running and chugging along, doing its bot-like things, but I'll be honest that I haven't had much time in the last few months to adding new features, and I shall probably be pretty busy in the time coming up as well.

Consequently, we can expect that the bot will continue to do its job, but I should warn people not to expect any new updates or features for a while. To be fair, I didn't really have any new ideas for a future version update anyway! Obviously, if there's a big issue that needs to be looked at, do let me know via direct messages, and I'll do my best to fix them. The Github code is also still current, by the way, in case anyone wants to take a look at it.

Separately, I would recommend that any community on the original instance of the bot move to the second one, as since the bot has been running for almost 4 years now, the processing time for each sub Reddit takes longer and longer. There are fewer communities on the u/AssistantBOT1 instance, so it should be faster for reaction times and for people in general.

I've also heard that Reddit the site is looking at some new automation options in the future for communities, and I think will be interesting to see how those pan out.

Thanks for using Artemis!