I believe we should reconsider if the up/down voting feature really is such a good idea. From what I have seen so far it is rarely used, but when it is used it is often for expressing a negative opinion about the post/comment. Often it also seems like votes are more personal than about the actual content the vote is about. Users that are less known in the community is risking getting a down vote far more easy than someone that is very known, seen as a leader and is respected.
I think this will have a negative impact for users that "dare" to stick out and voice an opinion about a subject. Other users that does not like change are then quite likely to give it a negative vote. Users that like the idea will seldom use the vote up feature.
I know this from my own experience, it is very easy to forget to vote up things I like and instead get caught up in the discussion. However, when I don't agree I often catch myself looking at the point.
Due to this I have decided to simply not use the feature since I know that I wouldn't use it in a balanced way.
It would be interesting to see some statistics on how it has been used since it was introduced. How many up and down votes have there been. What is the voting trend among those that actually use it. Are they mainly using it to vote down or up or are they balancing it.
I believe it is important to look into this and then have a think of this feature have a positive or negative impact on groups discussions.
Comments
Comment #1
gregglesThis is an interesting question, and one I think will be relevant for the prairie initiative which has proposed adding votes to issue queues on drupal.org.
I just ran some queries to look at how votes are used. My conclusions:
Here's the breakdown of votes:
Given this data do you change any of your conclusions?
Edited to fix typos and formatting
Comment #2
dave reidI think that:
1. There is less people on groups.drupal.org, so we're not going to see the type of usage that we'd possibly get on d.org.
2. Issue queues are rarely the place where someone has to risk 'putting it out there' with a comment, so I think our vote up/down metrics on d.org issue queues would actually be very useful, as we could auto-hide comments with low enough votes like subscribes (until that whole part is fixed of course) or asshat comments that I always seem to get and help us possibly focus on comments of value, which is getting harder and harder to do with longer and bigger issues.
Comment #3
webchickInteresting to see actual data behind this. Like the original poster, I also got the sense this was basically being used to "shun" people posting unpopular opinions, and it's always rubbed me the wrong way.
As one of the most ridiculous examples I can think of, here's a thread where we're discussing the possibility of changing the template for commit messages: http://groups.drupal.org/node/140309 You'll see that dww's comments are rated -1 (this is up from -2 the other day). There is absolutely nothing offensive or mean about his comments or anything at all that would warrant "modding down", other than I guess the people who did this simply disagree with his opinion on the matter. But then rather than simply saying that, they mark his posts as "low quality". Bleh.
I'm also not sure that 6,810 vs. 2,398 represents an "overwhelming majority"; that's still about 25% of people who are voting down comments on the site, which is no small percentage. And they're seemingly doing so either because they're either expressing dissent to someone's opinion or because they're just being mean or who knows what.
We might be better served with a "Like this" button and a "Flag as offensive" button. This would help the best comments naturally float to the top without putting anyone down unnecessarily, and also provide a tool to escalate spam/abuse to admins much more directly. Just a thought.
Thanks for compiling actual data behind this tool's usage though; it's interesting.
Comment #4
tsvenson commented@greggles: Thanks for posting the data, very interesting. Your data does prove my assumptions a bit wrong, but as @webchick points out, 25% negative votes is high and like me she also had a hunch it was worse that it actually is.
I think that a vote up/down like this works perfect for sites such as slashdot where there is a broad spectra of topics. However, here on d.o there is basically only one topic, namely Drupal. That brings in a lot of other aspects to what makes people place their votes, such as their own personal opinion about open source, how long they have been in the community and what they see their own status in the community is.
Many of the post I have seen getting negative votes is about change on d.o. Unfortunately most people are against change, partly because they are "happy" with how it works.
I like @webchick's idea about just having a "Like this" button combined with a "Flag as offensive" button. The offensive data should however not be visible unless for webmasters.
That would put focus on positives instead of like it is now when the voting can be used for expressing negatives about something just because it will mean they will have to adapt to something new.
Take the Overlay in D7 for example. Before people where able to test it, there where a lot of complaints about it, that they "hated" it and it would be instantly disabled. It was a long time since I saw any such comment, instead I have seen many changing their opinion after testing it and now say its one of the best things in D7.
So, basically what I'm trying to say is that if you give people an option to express a negative feeling about something, many will before they even have fully understand what it will do for them. Especially since it is just a mouse click to do it right now.
Comment #5
gregglesI think your interpretation of the vote down as "this is junk" or "this is offensive" is different from how people are using the vote down. When I see it my interpretation is "I disagree." And I think it is extremely useful to be able to say "I disagree" without having to leave a comment.
For example, this comment got something like 50 down votes. It would be harder to follow the conversation if all 50 people commented saying "-1, I disagree."
Two things that I think could help:
1. We add some hover text on the voting arrows. The hover text on the vote up could say "I agree or I like this comment" and the down arrow could show "I disagree or dislike this comment."
2. We add in something like flag abuse so people have a proper way to report something as abuse. This gives people the tools they need to express themselves.
I'm willing to remove the down vote if only because it is contentious. I feel it is a useful part of intense discussions and could be more useful with the above improvements.
Comment #6
gregglesI mentioned the prairie initiative and the suggestion to use an up/down mechanism in the issue queue - here's the wireframe and the proposal that references the wireframe.
Comment #7
joshk commentedI would personally give a (vote up) to adding a "report abuse" link and then phasing out the issue queue for most spam reports
Comment #8
webchickA flip-side way of viewing that is 50 people didn't have the balls to tell Kieran to his face that they disagreed with what he had to say, and engage him in a conversation about why. Instead, they were anonymous cowards attacking him behind their little -1 votes.
Comment #9
christefano commentedYes, please get rid of the vote down functionality. The negative votes on posts in one particular group I'm involved in is adding noise to many conversations about the direction of that community.
Ironically, when voting was introduced I asked for the decision to allow downvoting to be revisited and my comment was immediately downvoted.
Comment #10
webchickBtw, I do recognize some legitimate uses of downvoting. For example, here's a place where it was appropriate: http://groups.drupal.org/node/136294#comment-464979 (for those who can't see that, it's a comment that just says, "Shut. Up.")
That type of comment is pure trolling, and only breaks down discussion. But a "flag as offensive" flag could've just as easily dealt with that as 6 people down-voting it, and probably would've raised the attention of admins so it could be unpublished sooner.
Comment #11
christefano commentedDownvoted posts show up for admins at http://groups.drupal.org/moderator and it's a good dashdboard for finding trolls and well as spammers.
For what it's worth, it was by looking at that page that I realized that the group I'm involved in has a bigger problem than I thought.
Comment #12
webchickAnd in terms of short-cutting long/heated discussions, the +25 on chx's snarky reply to Kieran's post does just as much to indicate the "mood" of the community as the -25 on Kieran's does. The difference is that one is supporting and boosting up, the other is attacking and tearing down (and in an anonymous, dishonest way).
We should not, IMO, be providing tools for people to attack others on *.d.o, regardless of how unpopular their opinions might be.
Comment #13
gregglesAre you presenting this so the argument can be logically complete or because you dislike the fact that they are anonymous? We could just show who made which votes on content. If we did that I would make it something that was widely advertised, allow for cancelling of votes, and make it true for votes from point X forward.
I don't personally view it as a tool for cowards but a simpler and more useful way to say "+1/-1" without having to spam the conversation. I certainly see how it can be abused like that.
I feel like in general on the internet the down vote (in addition to a spam flag) is a useful pattern that we are seeing more commonly. Two examples: the IxDA.org site (based on years of design/review by interaction designers) follows the pattern and the wildly successful StackExchange sites follow the pattern.
I owe the g.d.o community a blog post on the topic and will use that to solicit feedback. I promise to do that this week (or at least this month).
Comment #14
gregglesI feel, again, that this is as much about a problem with labeling as it is anything else.
The -25 on Kieran's post isn't (necessarily) about attacking him. I don't view it that way at all. It's about disagreeing with him. Disagreeing by voting a -1 is often more civilized than the responses we see on our site.
Did you read my suggestion about labeling in comment #5? And if so could you respond to those proposals?
Comment #15
webchickI'm presenting it because that seems to be how they seem to be used in practice. Take, for example, the post that actually brought me to this issue: http://groups.drupal.org/node/140679#comment-465124
A guy walks into bikshed thread about what to re-name the LGBTQI group to (presumably because the activity on that node has made it "hot" this week and he came across it from the front page; I'm not really sure). Asks a simple, non-offensive, and perfectly legitimate question. Gets one simple, non-offensive, and perfectly legitimate response back. Plus 4 down-votes.
Did the voters mean their -1 as "This comment is off-topic for this thread"? Did they mean their -1 as "This question offends me on a deeply visceral level because I feel that you are de-legitimizing something that's very important to me"? Did they mean their -1 as "Straight people aren't welcome here, and screw off jackass"? I have absolutely no idea, because there isn't a bit of context, nor is there any identifying information to go ask follow-up questions.
So, if I were that person, I would be left to guess, and would probably jump to conclusions that this is an unwelcoming group that doesn't allow reasonable questions to be asked. I would be offended that my simple, non-offensive, perfectly legitimate question was met, essentially, with "Buzz off and go away." By not just one or two but *four* people (so far). None of whom I can confront to ask "Why?"
If we remove down-voting, then the way to voice dissent is by actually, you know, voicing it. Conversations can happen. Understanding can happen. Hurt feelings can be mended. It's much better for building community.
Comment #16
webchickI don't know that the labels in #5 help much. There is a chasm of difference between "I agree" and "I like," just as there is between "I disagree", and "I don't like." And what you might actually mean is "offensive" or "off-topic" or who even knows...
And regardless of what label you assign to it, that -4 is sitting there next to my picture, and it's telling people that what I just posted isn't as worthy as what other people posted. I don't see how people are going to take it as anything other than an attack.
Comment #17
gregglesMarking postponed for now. I think we've sufficiently hashed this out and I'd like to wait for
Comment #18
tsvenson commented@webchik:
That pretty much sums up my main reason for posting this issue.
As I said earlier, this kind of voting works well on sites such as slashdot where the topics are broad and people know each other much less in person. In a community such as Drupal, you will get to know people a lot more and then these things can turn into "weapons" used to back up your own personal, sometimes a bit flawed, view about issues.
Unpopular opinions are often quite important and will stir up feelings, but they still need to be discussed. Letting people express they opinion against using, and hiding behind, anonymous voting is not a good thing. I rather have the odd "Shut up" reply than a vote down, at least I know who it was then.
Comment #19
tsvenson commentedOne more thing. Is it possible to list the post that has >10 votes, plus list the number of +/- votes each of them got?
I think it would be good to actually take a look at those and see what the they actually contain. It would help to be able to analyse what it is that triggers a lot of votes on a subject.
Comment #20
johnalbinThe thread that brought me here is http://groups.drupal.org/node/175234
That entire thread is one giant coordinated trolling effort full of “every basetheme sucks but mine” passive-aggressiveness.
echoZ’s entire comment was:
And that got -4 votes. (One good samaritan came in and started adding +1’s to negatively-reviewed comments which is why it's at -3 at the moment.)
You can’t disagree with echoZ on her comment. It’s a statement of fact. So it’s pretty clear what the sentiment of the -1 votes are about. Fanboyism. Trolling. Directed at people who like the Zen theme.
I completely agree.
I’ve been in the Drupal community for a long time and even I felt unwelcome in that responsive basetheme thread. From the poor treatment of Zen supporters, it was clear my opinion wasn't welcome, so I never commented, even though I had a lot to say on the subject. I just hoped the thread would die. But it kept getting comments and would show up in my inbox. I got like 5 about it in the last week and couldn't stand it any longer.
Comment #21
alexrayu commentedA "minus" should be removed. A "Plus" is still enough to vote for a post you strongly agree with. What John Albin says is a sign that it does have a damaging effect. Let's not wait till people really start leaving the community because their posts have been thrown into minuses and they feel campaigned against.
Comment #22
tsi commentedI agree, the down-vote can't come instead of a "mark as offensive" flag. it is offensive and often miss-used.
Comment #23
tsvenson commentedJust some FYI. When I posted this issue, it was the a different voting widget used. It was placed to the right and quite easy to miss to be honest.
The current iteration is much better from both a visual and usability point.
Still, my opinion is that we should just count plus votes. We want to create a positive and enthusiastic atmosphere in the community and just having positive votes helps to create that.
Those who have a negative opinion can still do so in a comment, but then they need to formulate and give arguments about why they are negative to it. Much better way to handle that then what minus votes ever are able to do. Especially for those just browsing topics and see something got like -5 and just skips over it, despite it could be a very important discussion.
Comment #24
hanpersand commentedI came here via the base theme thread. I'm a themer for non-profits. Webchick's base theme thread is exactly the kind of discussion I need and want as I suss out how to give clients on very tight budgets the most I can. I use different base themes (including Zen) in different contexts, based on their strengths. So, in theory, that base theme thread (http://groups.drupal.org/node/175234) is exactly the kind of helpful discussion I need and want out of the Drupal community.
Until it turns into fanboyism/trolling and passive-aggressive tear-downs. As it so often does. I've been using Drupal extensively since 2006/4.7, and honestly I was hesitant to get more than passive-reader-level involved in the Drupal community at all until a couple years ago. This is in part due to the negativism, the cliquishness, and exclusivity that I perceived in Drupal threads. I feel like the negative voting is a quick, easy, anonymous way to preserve that element. I think a plus vote (vs. neutral/nothing) is great feedback. But as Webchick points out, there's no way to confront or identify the troll/fanboy as there would be if s/he had to put together even a semi-coherent comment.
To build a better community, a more welcoming community, I think it'd be best not to give trolls and fanboys an easy tool to be passive aggressive while remaining totally anonymous. I think + voting is great. + or neutral seems to be a more fair way to capture this quick kind of feedback.
I was just thinking: StackExchange does allow down voting. I am not deeply involved in the StackExchange community enough to have a feel for how often this kind of thing happens, but my colleague is, and he says that he feels it has better community oversight. Here's a link to SE's rules for down-voting, for reference: http://stackoverflow.com/privileges/vote-down
Comment #25
gregglesI think that's a key element of the way SE uses downvotes and we're unlikely to have that kind of feature on g.d.o very soon, so I'm increasingly OK with removing down votes.
Comment #26
tsvenson commentedOne thing worth pointing out is that +1 voting a post/comment doesn't mean you do it only for positive posts. You do it on posts you agree with and that could be a positive or a negative post.
Thing is though. If I agree with a post, then I don't need to justify why I agree with it since it is already in the post/comment I +1.
However, if i disagree with a post/comment, then I should need to explain why. Just doing a -1 on it says absolutely nothing as it gives no alternative or even explanation on why I disagree. It only makes the author wondering why x number of people don't agree.
To make things worse, we don't even know how many people that has voted. A -4 could mean it was just four users all doing -1 or it could be 104 users, 50 doing +1 and 54 doing -1. Result = makes the visible +/- even more useless.
Comment #27
sreynen commentedI'd be interested in seeing the stats in #1 repeated with a distinction between published and unpublished comments. My guess is a large portion of down votes are intended to say "this is spam." That, along with much of "this is inappropriate," aren't really statements that everyone needs to see. They just need to be flagged to moderators and unpublished. So I like the idea of adding a private flag and removing down votes.
The one thing this removes is the "-1 I disagree" statement of down votes. I disagree with what greggles said here:
As tsvenson said:
I'd go further and say not only that they can disagree in a comment, but that a comment is a much better way to disagree, because it's so important to know why someone disagrees. Without such explanation, it's way too easy to make incorrect assumptions and build up misunderstanding. That's not nearly as important for up votes, because the explanation of agreement is already stated in the original comment.
Even if everyone who currently uses down votes instead leaves a comment with nothing more than "-1 I disagree" (which I don't see as very likely), that's at least an opportunity to follow up and ask for more explanation. I think down votes make it too difficult to pursue understanding of disagreements.
Comment #28
ezra-g commentedI was in favor of keeping downvoting up until this point in the conversation. This changed my mind because removing downvoting forces *someone* to explain why they disagree, but preserves the ability for others to express disagreement without leaving a comment by +1'ing the comment that expresses your disagreement best.
Comment #29
tsvenson commentedChanging the title to better reflect what we are discussing.
Comment #30
Drave Robber commentedAnother option is to keep -1 voting but display only positive scores. (so that 0 is visually not different from -37)
On a general note: the OP was concerned about chilling effect on 'users who dare to stick out', but come on, d.o & g.d.o discussions normally are more polite and civilized than perhaps 90% or even 95% of "teh interwebs". There might even be the opposite sort of chilling effect - some people may refrain from commenting because "I think this s**t will lead to a major FUBAR but, oh, everyone is so nice here, how do I put it politely? oh well, let's move on."
Comment #31
izkreny commented+1 for removing -1! :)
I often found myself upvoting, obviously without reason (or without good reason), downvoted posts.
Comment #32
gregglesRemoved.
Since part of the point was to give people a way to flag spam I tried to add a flag for that, but #1611886: dont style all flag links got in the way :(
Comment #33
christefano commentedSo, how do people retract their upvote if they wanted to?
Comment #34
sreynen commentedHere's an issue on retracting votes in Vote Up/Down: #670258: Allow easier resetting of your vote
Comment #35
tsvenson commentedThanks greggles. I am convinced this will make things more positive in the discussions.
Comment #37
alexrayu commentedTo flag spam there should be a separate button. You can "minus" a spam - but it's not getting removed because of that. So minusing a spam was actually useless. There is no good spam control without a few moderators.
Comment #38
sreynen commentedAlexei Rayu, until the problem mentioned in #32 is resolved, opening an issue in this GDO queue under the "Spam" component" is the best way to flag spam. We do have moderators watching that queue and deleting spam, moderators who also watched a list of minused comments when that was available. So that wasn't useless.
Comment #39
ezra-g commentedThe 3.x version of Commons is likely to use the D7 Rate module for voting functionality - The long term solution for canceling votes is probably #1185272: Undo/Cancel a vote .
Let's keep further discussion in a new issue.