Removal of Reviewer
- I continue to think that we need to provide more guidance then is currently in the draft regarding when the reviewer right may be removed (Its more relevant here then in the next section, as that is more about instructing reviewers then the main policy). If recent controversial removals of the rollback right have shown us anything, it is that summary removals of rights, based only on the discretion of a single admin, should be avoided when possible. Obviously there may be times when it is necessary, but I think it should be explicit that absent bad faith use or a clear need to stop ongoing disruption, it should only be removed after a discussion at AN or AN/I, or with consent of the editor. Specifically, this would mean that the right should not be summarily removed because an editor did something bad not involving the right, made several bad judgement calls, or mistakes. Monty845 20:16, 9 November 2012 (UTC)
- The question on granting and removal of reviewer was eliminated from this RfC at great expense and at the last minute. Those responsible have been sacked. Seriously though, it was discussed a little on the talk page and we (for some small value of we) agreed that it would be better to have a discussion on it with more involved stakeholders first instead of just tossing it out in the voting format with little prior discussion. Those discussions do need to start very quickly, IMO, and shouldn't wait for this RfC to complete, since PC will be live December 1, and this RfC is not likely to wrap up for another two weeks at least. Gigs (talk) 20:39, 9 November 2012 (UTC)
- What Gigs said. - Dank (push to talk) 02:44, 10 November 2012 (UTC)
- I stated my opinion on the talk page pre-RfC and would have preferred that the question remain, but others disagreed and I am trying to keep an open mind. Of course, stakeholders should always be consulted (and of course they should be diligent about responding to RfCs that affect their work), but I'm not entirely clear on who precisely the stakeholders are when it comes to removal of the reviewer right. Rivertorch (talk) 08:44, 12 November 2012 (UTC)
- If the discussions must start very quickly, then why not start here and now? I agree with Monty's position, since it favors community consensus. Simply giving an individual admin power to strip another user of his/her right, especially for reasons unrelated to reviewing, should not occur. RedSoxFan2434 (talk) 18:54, 12 November 2012 (UTC)
- The goal in removing the question wasn't to support the admins, it was to support the reviewers. We all bitch about RfA ... and rightly so ... but we forget that it does serve some purposes, one of which is to close the feedback loop. If what it means to be a reviewer is decided by RfC voters and isn't allowed to evolve, that means that reviewers won't have a say in how to be a reviewer or what it takes to get promoted, and if that happens, I don't think there will be many reviewers. The trick of course is how to be open to feedback in the promotion and demotion process without allowing the nastiness of RfA. I actually think we've all learned a lot over the years about what not to do from RfA ... it's just that we never could apply those lessons to RfA; the thinking has been that RfA has to be tough because some bad promotions have had nasty repercussions. - Dank (push to talk) 20:15, 12 November 2012 (UTC)
- Do you want to put a straw poll here on whether demotions should require AN/I consensus first, unless it's an emergency? That's pretty open ended to me in that the criteria for that consensus is open to change, while still making it clear that we don't expect unilateral demotion to happen. Gigs (talk) 21:04, 12 November 2012 (UTC)
- I get that ANI may succeed in scaring admins who want to demote against consensus, but the ANI environment is not the place I'd want to be discussing the supposed deficiencies of reviewers. I'd be in favor of experimenting with different demotion discussion formats at RFPERM, where reviewers and people involved in promotion will be most likely to participate; we can probably find something that doesn't wear down the soul like RfA does. If admins are behaving badly, let's take them them to ANI, but let's focus on the admins' conduct, not the reviewers'; ANI is geared toward crime-and-punishment, and I think it would be exactly the wrong place to fine-tune reviewer standards. - Dank (push to talk) 21:25, 12 November 2012 (UTC)
- I didn't suggest removing the question was done "to support the admins", Dank. As for ANI, the fact that it "is geared toward crime-and-punishment", as you stated, is why it should be used to discuss demotion of reviewers, since that is typically a "punishment" being done because of a "crime". RedSoxFan2434 (talk) 22:01, 12 November 2012 (UTC)
(Why all the bullets?) I think you all make good points. Although issues of competence also arise at ANI, the focus there does tend to be on "crime" and "punishment". I think this is due in part to the failure of existing dispute-resolution options to catch problems early and deal effectively with them before they cause major disruption and make people frustrated and vengeful. One possible function of the proposed Pending Changes Noticeboard aka Reviewers Noticeboard (see question above) would be to enable reviewers to solicit and receive feedback on their work as reviewers. This would enable a reviewer to hear from his or her peers that there's a problem and get constructive advice in solving it before it becomes entrenched and festers and erupts into a dramatic ANI thread. The original proposed wording for the question included the following: "When one notices a pattern of problem reviews and a quiet word with the reviewer in question doesn't resolve one's concerns, this [the Noticeboard] would provide an easy, informal opportunity for getting additional opinions without resorting to filing a report at WP:ANI and all the stress that entails." Also, for what it's worth, the reviewer removal question originally mentioned "consensus at WP:AN, WP:AN/I, or another designated noticeboard" (emphasis added). Can we connect the dots? Rivertorch (talk) 22:46, 12 November 2012 (UTC)
- Monty was right to raise this question, as it is an important one. I guess we can discuss cases one-by-one at AN, but we really need to have a community consensus on what the criteria are, and we don't have it. It certainly was raised, by me and others, numerous times in previous discussions, so everyone paying attention knows that it's a matter of concern. I feel like the decision to punt on it for this RfC was a decision to go ahead and implement PC without dealing with reality. The reviewer right was given out way too freely before, and the draft guideline sets the bar awfully low. I fear we're headed for unnecessary drama. --Tryptofish (talk) 23:36, 12 November 2012 (UTC)
- It's an important question, but considering that we are only doing pending changes level 1, I don't think it matters if we hand this out freely. This level of protection is somewhere less than semi-protection. We need to keep that in mind before we go too crazy worrying about a right that is somewhere on par with "autoconfirmed". Gigs (talk) 23:43, 12 November 2012 (UTC)
- Well, I don't see it that way at all. What happens when someone reviews and allows an edit that violates WP:BLP? What happens when someone selectively disallows only those edits with which they disagree in a POV dispute? It's nothing like autoconfirmed, in my opinion. --Tryptofish (talk) 23:56, 12 November 2012 (UTC)
- To back up Tryptofish's point, WP:Reviewing itself says that the level of trust in a reviewer is on par with rollback and autopatrolled rights. This is because autoconfirmation (relative to semi-protection) is the ability to edit, whereas reviewing (relative to PC) is the ability to both edit and accept edits. Meanwhile, I agree that we go case-by-case at AN, ANI, or another Noticeboard, although we should also have a general guideline of criteria, which, if a reviewer undisputably is not meeting, he/she loses his/her reviewer right. However, if it is disputable, than a Noticeboard consensus is needed. RedSoxFan2434 (talk) 01:38, 13 November 2012 (UTC)
- There's no user right at all in order to patrol pages (except autoconfirmed I guess), and all rollback does is make undoing an edit take one less click. Those rights are not a particularly big deal either. PC level 1 is a way to allow an article that might have been semi-protected to still accept edits from IPs and non-autoconfirmed. That's pretty much it. These edits would have never happened at all if the article were semiprotected, which is what it would be today. It's just a fancy UI for people to respond to
{{Edit_semi-protected}} from IPs, without the IPs needing to know how to use a template. We don't have any "level of trust" required to respond to semiprotected editprotected requests, do we? Anyway I'm not convinced this is going to be a big deal. If this were PC level 2, then it would be a bigger deal, but it's not. Gigs (talk) 03:35, 13 November 2012 (UTC)
- To clarify: Autopatrolled rights (formerly known as "Autoreviewer" rights) refers to the ability to create an article which is then automatically marked as patrolled. Now that's a pretty high level of trust. RedSoxFan2434 (talk) 23:39, 13 November 2012 (UTC)
- Unlike most of the other questions, I don't think that we need to have this particular issue settled before 01 December. It's unlikely that we're going to have people clamoring for userrights to be removed on Day #1, or even during Month #1. So hold those thoughts, please, and even give the issue more thought, but let's not try start mixing the concrete for right removals this week.
- (My personal opinion, BTW, is that it ought to be treated like Rollbacker: any admin can act (in either direction), and you can appeal to the community if you disagree with the admin's action. I don't think that we benefit by adding a lot of red tape, like "can only be discussed here" or "must never be removed without a minimum of 48 hours' discussion".) WhatamIdoing (talk) 00:56, 13 November 2012 (UTC)
- The problem is that we have somewhat regular removals of the rollback right for things other then the misuse of rollback, on the grounds of loss of trust. Its very hard to argue against such a removal, other then to try to reach consensus that we do trust generally trust the user. Rather then let reviewer end up in a similar morass, we would be much better advised to limit unilateral removals. I'm not saying we need a specific period of discussion or anything, just that it should be a consensus decision in most cases. Monty845 02:52, 13 November 2012 (UTC)
- Volunteers with difficult jobs need to know that they're working on a team that has a shared, or at least overlapping, vision, and that will have some degree of autonomy. Admins who actually wind up investing time in promotion and demotion, such as the ones who have been doing it so far, generally want to do it right, and I expect they'll gain the trust of the reviewing community. It doesn't matter if random commenters at AN or ANI do a good job with demotions ... if reviewers don't perceive the people making the decisions as being involved with and responsive to reviewers and reviewing, then reviewers will get a sense that the process isn't their process, and they'll stop reviewing. - Dank (push to talk) 03:13, 13 November 2012 (UTC)
- My sense is that those at WP:PERM are not typically the ones removing permissions, instead a random admin sees something they don't like, and does it themselves, sometimes not even understanding how the right works. I think the regulars at PERM do a fine job, at least for me, they are not who I am concerned with. But without any guidance at all on when an admin may remove the right, we fall back on the admin's unbridled discretion, which should be avoided when practical. Monty845 03:26, 13 November 2012 (UTC)
- Right. My sense of it is that removal of the permission is quite different from deciding to hand out the permission in the first place. It might be helpful if the regulars who have been dealing with requests would provide some input on this. @ Gigs re "This level of protection [PC level 1] is somewhere less than semi-protection": that's a valid viewpoint, but it's not the only valid viewpoint, and it was hotly debated in various past RfCs. There's no point in rehashing those old arguments, but I feel I should say that I don't accept the premise. Rivertorch (talk) 06:19, 13 November 2012 (UTC)
- I think the best suggestion might be to wait a little bit to see how things start to go. It sound like we have rough consensus for bringing any issues to AN or something like it, at least for now. I get what Dank is saying, but without knowing how the chips are starting to fall, it's going to be hard to address those concerns. Gigs (talk) 16:13, 13 November 2012 (UTC)
- If "Do it at WP:AN" is going to be added to the RfC, I'd prefer we include something about trying to get consensus among reviewers first before heading to WP:AN. But if that seems premature to you guys, it will be enough for me if the people likely to vote on demotions at WP:AN get the pros and cons of different approaches. I'll go ask. - Dank (push to talk) 17:55, 13 November 2012 (UTC)
There's nothing wrong, exactly, with any of the suggestions so far, but there's an inattention to what's needed that could get us to "awful". In the long run, there's not going to be any demand for a job where someone pretends to newbies to have some authority ... which is what the PC interface suggests, that an edit is being rejected by someone who has the authority to do that ... and then, as soon as they're asked a question by a newbie or challenged by any authority, it becomes clear that they were just pretending to have authority, they actually have no say in anything. Jobs that are all responsibility and no authority tend to fail even when there's a paycheck as incentive to make them work. What I suggest is, if anyone wants to give feedback about a promotion or demotion, before or after, then something should be said at RFPERM (or somewhere else, if you guys want this to happen somewhere else) along the lines of: I have concerns that this person may be too bitey, or may lean too much one way or another on accepting or rejecting edits. Then one or more of the admins who generally do promotions and are trusted by the reviewing community can do a quick investigation, and solicit public comments or emails on just those points that they think might be decisive to the question. A thorough discussion of all possible faults the reviewer or reviewer-candidate might have would be irrelevant, and hurt our ability to retain reviewers, as we know from RfA: no volunteer actually likes a public airing of all their dirty laundry, even if the charges are true, especially if they're true. Then the admin(s) could present what they think is the decisive issue to the reviewing community, sketch the problem, possibly offer a recommendation, and see if people in general, and especially reviewers, are on board with the recommendation ... for better or worse, promotion and demotion decisions will help to define what it means to be a reviewer, which means that reviewers need to be involved, and need to know that they're being heard. For demotions, when a consensus has been reached at RFPERM (or wherever) that someone should be demoted, or that someone who was demoted shouldn't have been, that consensus could be presented at WP:AN for review. This is a little messier than some people were hoping for, but if you're asking people to volunteer large amounts of time to an admin or reviewer job, then it shouldn't be a surprise that sometimes they're going to need to be taken seriously and reasoned with. - Dank (push to talk) 13:10, 13 November 2012 (UTC)
- Quick analogy: the students in the after-school math club are trying to put together a competitive team ... so performance is important, but the club is also a social activity. One option is for the adviser, who the club knows and trusts, to do most of the promotions and demotions to the competitive team, particularly if the adviser has the good sense to involve the students in discussions of standards. If all the promotions and demotions were made and announced to the school by vice-principals unknown to the club, that would be publicly advertising that the club has no autonomy, no voice in its own affairs, and it's unlikely the club would survive that lack of respect. - Dank (push to talk) 14:47, 13 November 2012 (UTC)
Above, I asked two questions. I'm going to ask them again, because I think that it would be constructive here to actually attempt to get consensus on the answers, or alternatively to discover that we need to do more work on that consensus:
- What happens when someone reviews and allows an edit that violates WP:BLP?
- What happens when someone selectively disallows only those edits with which they disagree in a POV dispute?
Thoughts? --Tryptofish (talk) 21:47, 13 November 2012 (UTC)
- I've got a longer answer if you're asking something fine-grained. If your question is mainly about flagrant, knowing abuse of the tool, then if I were in on the discussion, I'd recommend demotion at WP:RFPERM (or wherever) and again at WP:AN. - Dank (push to talk) 23:06, 13 November 2012 (UTC)
- Yes, I'm really just asking about knowing abuse, not an isolated error made in good faith, and maybe also chronic incompetence, so that answer is what I'm looking for. But what I'm not clear on is whether other users will agree with you. Why not put it in the draft that there is a venue for recommending demotion? Why not put it in the draft that such demotion is appropriate when reviewing is repeatedly misused? --Tryptofish (talk) 23:16, 13 November 2012 (UTC)
- It appears from the votes so far that there won't be a special noticeboard, and that maybe WT:PC will be used for notifications. If so, more reviewers will be looking at WT:PC than at WP:RFPERM, so if we want to get the advice of reviewers on demotions, that would probably be the place for it. It sounds like most people here would like to see a demotion question in the current RfC. I suggest: "If clear abuse of the reviewer tool is discovered, links showing the abuse should be provided at WT:Pending changes (WT:PC). Any admin [but I'm hoping it will be admins active in promotion and reviewing generally] can then ask for input from the [reviewing] community if there are open questions about what constitutes abuse and whether there was abuse, and if the admin determines there was abuse, the admin should recommend demotion at the Administrators' noticeboard. Out-of-process demotions should also be reported at WT:PC when discovered. - Dank (push to talk) 03:10, 14 November 2012 (UTC)
- What if we say: "The reviewer permission should only be removed as the result of consensus from a discussion or where an editor requests the removal of their own permission. Discussion regarding removal of the reviewer permission should normally occur at WP:AN. Discussion with the involved editor and/or a request for a second opinion at WT:PC is recommended before formally requesting removal." This would provide clear guidance regarding what admins may do without discussion, and suggest alternatives to dragging someone to AN without necessarily requiring they be used. This also leaves open other potential venues, such as RFC/U or ARBCOM where removals would also be the result of a sufficiently public process. Monty845 03:43, 14 November 2012 (UTC)
- Just to be clear on the difference, your language seems to invite open-ended discussion; mine asks people to provide links to the problem they're trying to point out, and leaves it up to admin discretion whether there are gray areas that need discussion before a trip to WP:AN. - Dank (push to talk) 04:29, 14 November 2012 (UTC)
- I think a diff is a good idea, but as this is for the policy page, I don't think it should be required in every case. The main focus of the change is I want to avoid a mandatory trip through WT:PC before a requested removal can be discussed on a notice board, which would turn WT:PC into a notice board itself. Certainly questions can be raised, advice asked, or help in dealing with a problematic reviewer requested there, and both those should be encouraged, but I think instituting a mandatory pre-screening before a matter can be brought to AN is overly bureaucratic. Really the only part that would be really be policy in my version would be the first part, "The reviewer permission should only be removed as the result of consensus from a discussion or where an editor requests the removal of their own permission. Discussion regarding removal of the reviewer permission should normally occur at WP:AN." the remainder being more of an associated guideline. Monty845 05:51, 14 November 2012 (UTC)
- I like Monty's proposal and thing we should add it for straw polling. Gigs (talk) 14:32, 14 November 2012 (UTC)
- I don't object; I've made my argument. Time will tell whether reviewers wind up being disenfranchised from their own process, and if so, we'll deal with that. - Dank (push to talk) 15:36, 14 November 2012 (UTC)