May 22, 2009
-{6:31 am}-
Filed by web from Elsewhere

Rating the Raters

An interesting thing comes up when designing/maintaining a website’s “community” - how it will address newcomers and meltdowns. Why Do Work describes this problem in the most modern parlance, that of the Eternal September, a term coined in remembrance of the 1993 addition of millions of AOL users to the growing population using, at the time, Usenet messaging groups.

Prior to 1993, Usenet had been a pretty humdrum affair. September had been deemed the worst time to be on, simply because of the influx of new college students discovering it for the first time. Fortunately, the “experienced” Usenet denizens were usually able to teach their new charges the social norms, and things went back to normal fairly quickly.

With Eternal September, and the addition of not just many more new people, but people whose current goal in life was not an education, that flew right out the window. As Clay Shirky describes it, “a group is its own worst enemy..

In modern parlance, website “communities” have come up with all sorts of governance, but they can pretty easily be categorized as follows:

#1 - Outright Anarchy - no rules. No restrictions. No deletions/bannings. In other words, just a mob. See also: 4Chan (or don’t, it’s scary there).

#2 - The Quiet Oligarchy - there are rules, but they’re relatively respected. For the most part, a single person or a few people handle the necessary duties (blockings, comment deletion, etc) as needed. Hit Coffee falls into this category.

#3 - The Loud Oligarchy - Get onto a larger forum (such as an MMORPG’s forum space, or a large scale internet forum) and the moderators become a bit more… active. Threats and “repeat warnings” become commonplace.

#4 - The Totalitarian - Here we get to Wikipedia. The best way to imagine this is the following: imagine if your entire “police force” consisted of 20-year veteran paranoid cocaine users with a badge, a gun, and orders to shoot first and ask questions later only if anything was still moving.

#5 - The Karma Fest - Sites like Digg and Slashdot. “Users”, either in their entirety or via random selection, are given the ability to “moderate” posts up and down on a point scale. The goal is that “good” posts get moderated up to the top, and “bad” posts down to oblivion and unseen. The actual result? Utter and complete enforcement of community-ingrained groupthink. Slashdot created “karma whores”, Digg gave us the “bury brigade.” Why the difference? Slashdot only allows pushing a post up or down so far (up to 5, down to -1, with 1 being the starting point), while Diggs and Buries moderate what’s seen on the front page of Digg. And of course, even Slashdot is still gamed; the latest trends are to either (a) find someone that they really dislike, mod them down, and then go back and moderate any other posts by the same user they can find down till mod points are exhausted or (b) to tag-team with someone else, modding “+1 Funny” (which mods up, but doesn’t actually add Karma points) and then have the tag-team partner mod down again, adding more negative karma.

As for sites that follow #2 through #4, usually in an evolutionary state (the number of admins rises with number of users and noise in the system, until the number of bad-but-entrenched admins begins driving away users and eventually more admins than users remain), little can be done once critical mass is hit. The most one can do is hope that growth is slow enough to identify bad admins before entrenchment occurs.

On the last, I believe that the overall flaw is in allowing karma to flow both ways. While it’s true that partisan upmodding happens, there’s probably less ill feeling if that is the only partisan behavior; the problems for Digg, and Slashdot to a point, come in from the partisan downmodding that allows a subset of the population to not just decide that something should be seen, but to actively censor things they think shouldn’t be seen.

2 Comments

  1. Comment moderation adds an additional twist. Half Sigma is a pretty good example of a Quiet Oligarchy without comment moderation. In contrast, 2 Blowhards is another Quiet Oligarchy, but this time with comment moderation in place. In both cases all but the most extreme comments get posted, though more quickly in the former case. One thing I’ve noticed is that if a high-traffic blog is going to have comment moderation, the process should take no more than an hour or two if a give-and-take dialog is to be possible.

    Outright Anarchy with comment moderation is probably a contradiction in terms. A Notorious HBD Blog may come closest, as despite having moderation in place some fairly extreme/irrelevant/obscene comments get posted. Of course I don’t know what ones are being screened out, but it’s hard to imagine that they could be any worse than some of the ones which make it through.

    Comment by Peter — May 23, 2009 @ 10:35 am

  2. Part of me would love Hit Coffee to become a sensation, but even aside from the anonymity issue the comment moderation question alone makes me pretty happy where I am at (relatively few, but high-quality commenters). Bigger blogs have to have some sort of system in place.

    I’ve been running tech support for the Econoholic blog, which right now mostly means moderating comments. WordPress has a pretty cool feature where commenters have to be moderated for their first comment but then after that they get through. With my math plug-in not working on Holic’s version of WP, it’s the primary defense against Spam. I’d imagine, though, that it’s a pretty good way to softly moderate comments. You can avoid the drive-by commenters who are often the worst and still have lively discussions.

    Comment by trumwill — May 24, 2009 @ 12:13 am

RSS feed for comments on this post.

Sorry, the comment form is closed at this time.