Return of Thread Rating
#31
FlyerTalk Evangelist
Join Date: Nov 1999
Location: FTFOE
Programs: TalkBoard: We discuss / ad nauseum things that mean / so very little
Posts: 10,225
gleff: You raise a good point. To address your question about benefits:
All I can say is that the ratings gives people some semblance of what other FlyerTalkers feel about a thread. As I stated in my post above, one must be careful not to read too deeply into statistics. Indeed, the meaning of individual votes which comprise the overall rating is open to interpretation and should not be the subject of speculation, as there are simply too many factors that enter into consideration when one chooses their thread rating. Likewise, the meaning of the aggregated average rating is open to interpretation too! One can choose not to pay much heed to the rating (as what dhammer said above -- a high rating isn't necessarily going to motivate him to open a thread he wouldn't have already) or it might have some small (and I emphasise small) effect on whether people open a thread.
Each person gets one vote (and cannot change their votes, in the default vBulletin settings), but no one has to vote either. If I put enough meaning into thread ratings that I actually dislike the fact that the displayed rating of a thread does not reflect what I think about it, then I can either ignore the rating, or vote the number of stars which reflects what I think it should be. If I'm only one of 10 or 15 or 20 voters, then the "power" of my vote alone on the average rating is minimal.
I think the harm that has come from the system in its initial implementation was came from two things:
1) that the ratings were displayed with just two votes (that's the default setting), which is completely statistically insignificant;
2) that people were reading too much into what individual votes meant.
I think to a large degree that the latter followed from the former. If we address the former, by increasing the setting, then the second problem also goes away.
FewMiles..
All I can say is that the ratings gives people some semblance of what other FlyerTalkers feel about a thread. As I stated in my post above, one must be careful not to read too deeply into statistics. Indeed, the meaning of individual votes which comprise the overall rating is open to interpretation and should not be the subject of speculation, as there are simply too many factors that enter into consideration when one chooses their thread rating. Likewise, the meaning of the aggregated average rating is open to interpretation too! One can choose not to pay much heed to the rating (as what dhammer said above -- a high rating isn't necessarily going to motivate him to open a thread he wouldn't have already) or it might have some small (and I emphasise small) effect on whether people open a thread.
Each person gets one vote (and cannot change their votes, in the default vBulletin settings), but no one has to vote either. If I put enough meaning into thread ratings that I actually dislike the fact that the displayed rating of a thread does not reflect what I think about it, then I can either ignore the rating, or vote the number of stars which reflects what I think it should be. If I'm only one of 10 or 15 or 20 voters, then the "power" of my vote alone on the average rating is minimal.
I think the harm that has come from the system in its initial implementation was came from two things:
1) that the ratings were displayed with just two votes (that's the default setting), which is completely statistically insignificant;
2) that people were reading too much into what individual votes meant.
I think to a large degree that the latter followed from the former. If we address the former, by increasing the setting, then the second problem also goes away.
FewMiles..
#32
A FlyerTalk Posting Legend




Join Date: Jun 2002
Location: NYC
Posts: 44,555
Yeah, but there's the reality of FT's past history getting in the way of eloquent arguments about principles and democracy...
#33
A FlyerTalk Posting Legend




Join Date: Mar 2001
Posts: 55,213
Originally Posted by FewMiles
- How do you know what a person who gave a low rating to a thread is trying to do? How do you know if he/she is rating the thread low because of the dislike for the content, poster, opening poster, or some other reason?
dhammer53 stated that wishing happiness for others on their birthdays fosters community growth. How do you give that a negative rating without it being personal. As if that makes sense!I thanked him for that clear cut example. ^
This whole thread right here gives enough information about why ratings are bad. From supporters, I read that they are annoyed by those of us who dislike this feature for we clearly live in a "victim" society. This looks like a justification of being rude. Some of you have been banned for breaking the TOS which shows just how rude some of the posts were. Why not stop TOS violations because by preserving a TOS, we are preserving a "victim" society where the obnoxious writer gets banned for a period of time.
Randy can see for himself the disrespect some of you have toward those who are against thread rating. You mock them for advocating a victim status. Keep it up. Your slip is showing.... I hope this thread keeps on growing and growing and growing. ^
Last edited by Analise; Sep 28, 2005 at 2:19 pm
#34
FlyerTalk Evangelist




Join Date: Sep 2000
Programs: BA, AA, DL, KLM, UA
Posts: 37,489
Originally Posted by ScottC
Can I politely ask that we leave this thread alone for a few days. I can't speak for the entire talkboard, but I think we've seen enough user input in the past days to start our discussion. If we require any more input you can be assured that we'll be back here!
#35
FlyerTalk Evangelist
Join Date: Dec 2002
Programs: UA Gold MM; AA Gold MM; WN A-List; IHG Diamond Ambassador; Marriott Gold; Hyatt Explorist
Posts: 24,563
Originally Posted by gleff
But I'm not clear on the benefit that the ratings feature provides, and it would seem to me that that would have to come first. The only reason to minimize a harm is to capture a benefit. What is that benefit?
#36


Join Date: Jun 2002
Location: BCT. Formerly known as attorney28
Programs: LH LT SEN,BA GGL GfL,Hyatt LT Gl,Mrtt LT P,HH LT D,IHG D-Amb,Acc D,GHA T,LHW A,Sixt/Av/Hz D/Pres
Posts: 6,947
Originally Posted by cAAl
The benefit would be the increased visibility of important and consequential threads. It would be much easier to scan FlyerTalk's new posts and hone in on the ones that the community considers to be of particular value. Maybe it's a thread discussing an eye-popping fare. Maybe it's a thread pointing the way to easily and inexpensively pick up a bunch of frequent flyer miles. Whatever the case, it would be just one more tool that might help separate the important posts from the trivial.
I agree that that is the idea of the tool in principle, and I can see it being useful for that, in theory.
However, in my personal opinion, this thread (and the two other threads which had to be closed) show that the potential for abuse and disputes over it outweigh the potential benefit described above.
#37
FlyerTalk Evangelist




Join Date: Sep 2000
Programs: UA Million Miler (lite). NY Metro area.
Posts: 15,430
Originally Posted by ScottC
Can I politely ask that we leave this thread alone for a few days. I can't speak for the entire talkboard, but I think we've seen enough user input in the past days to start our discussion. If we require any more input you can be assured that we'll be back here!
#38
FlyerTalk Evangelist
Join Date: Nov 1999
Location: FTFOE
Programs: TalkBoard: We discuss / ad nauseum things that mean / so very little
Posts: 10,225
Originally Posted by Analise
I already gave you an example. CG already stated that he sees nothing wrong with rating low a happy birthday thread simply because he doesn't like the person. CG doesn't dislike all of them; just some of them for personal reasons. So some people deserve a higher rating for threads wishing them a HB than others do?? 

We're certainly not going to get to the point of "only allowing 5-star votes" because anything less is a negative statement. Reminds me of those "democratic countries" where the ballot has one name and you may vote yes or not vote and risk being shot.

[bit removed upon further consideration]
FewMiles..
Last edited by FewMiles; Sep 28, 2005 at 2:23 pm
#39
A FlyerTalk Posting Legend




Join Date: Jun 2002
Location: NYC
Posts: 44,555
Originally Posted by FewMiles
That is his prerogative if that is the way he wishes to use the thread rating system in that fashion. He is one vote out of dozens that would rate the thread, and I think in the vast majority of cases, you'll find the high ratings would far outweigh the low ratings. It all gets washed out in the statistics as I explained earlier.
We're certainly not going to get to the point of "only allowing 5-star votes" because anything less is a negative statement. Reminds me of those "democratic countries" where the ballot has one name and you may vote yes or not vote and risk being shot.
FewMiles..
We're certainly not going to get to the point of "only allowing 5-star votes" because anything less is a negative statement. Reminds me of those "democratic countries" where the ballot has one name and you may vote yes or not vote and risk being shot.

FewMiles..
Last edited by anonplz; Sep 28, 2005 at 2:07 pm Reason: At request of moderator
#40
Moderator, Hilton Honors



Join Date: Nov 2003
Location: on a short leash
Programs: some
Posts: 71,445
Originally Posted by gleff
There's been much discussion of potential (or past) harms from the thread rating feature, and some discussion of how to mitigate those harms.
I'm curious whether members have thoughts on what the benefits of the thread rating feature are.
I'm curious whether members have thoughts on what the benefits of the thread rating feature are.
Thread ratings also have a significant shortcoming (in my eyes) that no-one has mentioned. You can only vote once, but the "value" of the thread may change after you've voted. Eg a thread may initially be full of rubbish, but then later some valuable info or comments may well change the tone & usefulness completely - or vice versa.
#41


Join Date: Jun 2002
Location: BCT. Formerly known as attorney28
Programs: LH LT SEN,BA GGL GfL,Hyatt LT Gl,Mrtt LT P,HH LT D,IHG D-Amb,Acc D,GHA T,LHW A,Sixt/Av/Hz D/Pres
Posts: 6,947
Originally Posted by Kiwi Flyer
I'm unsure what value ratings have. There's already a measure I find useful - number of views. In less frequented forums that may not work so well but then neither would ratings IMHO.
Thread ratings also have a significant shortcoming (in my eyes) that no-one has mentioned. You can only vote once, but the "value" of the thread may change after you've voted. Eg a thread may initially be full of rubbish, but then later some valuable info or comments may well change the tone & usefulness completely - or vice versa.
Thread ratings also have a significant shortcoming (in my eyes) that no-one has mentioned. You can only vote once, but the "value" of the thread may change after you've voted. Eg a thread may initially be full of rubbish, but then later some valuable info or comments may well change the tone & usefulness completely - or vice versa.
#42
Original Poster
Join Date: Dec 1999
Location: Northeast MA, USA.
Programs: HHonors Diamond, DL Silver, TSA Harassee
Posts: 3,657
Originally Posted by Kiwi Flyer
I'm unsure what value ratings have. There's already a measure I find useful - number of views. In less frequented forums that may not work so well but then neither would ratings IMHO.
Thread ratings also have a significant shortcoming (in my eyes) that no-one has mentioned. You can only vote once, but the "value" of the thread may change after you've voted. Eg a thread may initially be full of rubbish, but then later some valuable info or comments may well change the tone & usefulness completely - or vice versa.
Thread ratings also have a significant shortcoming (in my eyes) that no-one has mentioned. You can only vote once, but the "value" of the thread may change after you've voted. Eg a thread may initially be full of rubbish, but then later some valuable info or comments may well change the tone & usefulness completely - or vice versa.
I somewhat agree with you about the single vote theory, but if you think a thread may change in value, you can simply wait to rate it.
#43
Join Date: Jul 2000
Location: Commuting around the mid-atlantic and rust-belt on any number of RJs
Programs: TSA Random Selectee Platinum, * Gold, SPG/HH/MR mid-tier, and a tiny bag of pretzels.
Posts: 9,255
Number of views is a horrid metric: if I posted a thread entitled "New US Airways to offer Free Beer inflight" in the US forum, I can almost guarantee that the number of views would be huge, even if the content of the actual post was "Gotcha!"
FWIW, I have rated this thread 2 stars.
FWIW, I have rated this thread 2 stars.
#44
FlyerTalk Evangelist
Join Date: Feb 2002
Location: El Paso, TX, USA
Programs: Kicked out of all of them
Posts: 32,554
I say we turn on all the features of FT
Reputation
Thread ratings
Referrals
Turn on a feature, and we are like monkeys, we will find a way to abuse it
Reputation
Thread ratings
Referrals
Turn on a feature, and we are like monkeys, we will find a way to abuse it
#45
FlyerTalk Evangelist




Join Date: Sep 2000
Programs: UA Million Miler (lite). NY Metro area.
Posts: 15,430
Originally Posted by ClueByFour
Number of views is a horrid metric: if I posted a thread entitled "New US Airways to offer Free Beer inflight" in the US forum, I can almost guarantee that the number of views would be huge, even if the content of the actual post was "Gotcha!"
FWIW, I have rated this thread 2 stars.
FWIW, I have rated this thread 2 stars.
CB4,
You may want to factor the response to view ratio. If I see lots of views with limited responses, it's a blowoff .
Maybe you should post your thread idea; just for testing of course.
Now can we close this down??

