Forum Home Forum Home > Site News, Newbies, Help and Improvements > Help us improve the site
  New Posts New Posts RSS Feed - Way to reduce # of 5 star ratings
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

Topic ClosedWay to reduce # of 5 star ratings

 Post Reply Post Reply Page  <123>
Author
Message
Pnoom! View Drop Down
Forum Senior Member
Forum Senior Member


Joined: September 02 2006
Location: OH
Status: Offline
Points: 4981
Direct Link To This Post Posted: October 24 2006 at 13:42
Actually, the reason why I do this is that if an album gets 5 stars from me, it is exactly the same as any other 5 star album.  A masterpiece is a masterpiece, you can't have a *better* masterpiece, because that implies some imperfection, which is not the case in a true masterpiece.  The same goes for a one star rating.  If it's deserving of 1 star, it has no redeeming qualities, and is therefore just as bad as any other album without any merits.
 
The only problem this creates is that my Under Wraps review (an album I intensely dislike) gets two stars because 3 of the songs are listenable (thus giving it some redemption).  At the same time, Ummagumma (an album I enjoy a lot) is really only for collector's/fans.  I could boost it to 3 stars, but that doesn't accurately convey that it's only for collectors.
 
This is the only dilemna this rating system creates.  If we had a ten point scale, I could give Under Wraps the 2 it deserves, and Ummagumma the 4 it deserves.  The real problem is that there aren't enough choices for ratings.  The way it is set up now, about 90% of the albums should be three stars (good, but non-essential), with small portions of each band's work being excellent/masterpiece or collectors/completionists only.
 
This is exemplified by SeanTrane, who for half of his reviews adds a half star.  A 10 star system would take care of this, I feel.
Back to Top
Atkingani View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator / Retired Admin

Joined: October 21 2005
Location: Terra Brasilis
Status: Offline
Points: 12288
Direct Link To This Post Posted: October 24 2006 at 21:26
 
Very interesting, OG. This issue was raised in the Admin Zone in October, 6. Here is my starting post for the thread. Smile
 
 
Professional reviewers (websites, magazines, newspapers, etc) deal not only with material they like but also with material ceded by the media owners or labels or artists. Consequently, the share of their reviews show a much more distributed ratings from, say, 1 to 5 stars. In many occasions, they have to review stuff they don't like!
 
Amateur reviewers (99% of PA reviewers) deal generally only with stuff they like. No one will run to the shops to buy a CD not preferred and even borrowing from friends, they'll ask for something they believe is closer to their taste. Consequently, their ratings will show an unbalanced distribution, with 3 to 5 stars dominating.
 
The question is: Can we persuade our reviewers (collabs or not) to review a CD or an album of a band they don't like or disdain? In this case, how? The rating profile for each band and each album could be more fair???
Guigo

~~~~~~
Back to Top
OpethGuitarist View Drop Down
Prog Reviewer
Prog Reviewer


Joined: June 25 2006
Location: United States
Status: Offline
Points: 1655
Direct Link To This Post Posted: October 25 2006 at 00:06
Another major problem, at least in my eyes, is the backlash received here by fans if you rate something here poorly.

For my own case I've had several occassions where I was more or less yelled at and abused because I rated a particular album poorly.

You also will lose a lot of friends if you attempt to be fair here. That's another issue, as I think some members here have some growing up to do.

I'm going to keep doing things the way I'm doing them, leading the cause for balanced rating systems at PA.
back from the dead, i will begin posting reviews again and musing through the forums
Back to Top
Peter View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: January 31 2004
Location: Canada
Status: Offline
Points: 9669
Direct Link To This Post Posted: October 25 2006 at 02:17
Heavyfreight
Senior Member
Senior Member
Avatar

Joined: October 04 2006
Location: United Kingdom
Online Status: Offline
Posts: 168
Quote Heavyfreight Replybullet Posted: October 23 2006 at 05:18
I think that Mike has highlighted the problem.  If many people only choose to rate the albums that they like or are interested in then there will be a bias towards good ratings.
 
One suggestion I have would be to nominate albums and then ask members of the site to listen to them and then post a review.  That way you would get comments both good and bad and therefore a more balanced view.  I know that it isn't quite that simple to organise this but it may lead someone to come up with another better idea.
 
Neil.
Heracleum Mantegazzianum
IP IP Logged Report Post
Philéas
Senior Member
Senior Member
Avatar

Joined: June 14 2006
Location: Sweden
Online Status: Offline
Posts: 1716
Quote Philéas Replybullet Posted: October 23 2006 at 05:22
That's a good idea, Heavyfreight!  It surprises me that nobody has thought about it yet.
 
Originally posted by Geck0 Geck0 wrote:

I can't see it working though.

People are biased with tastes, so someone who dislikes a certain style of prog, will have a biased view when it comes to ranking.

Maybe we can ask people to rank and review some of those albums that have little, to no reviews at all?  There are many bands in the archives that don't have a single review.  They should take priority over big bands.
This old topic again, eh? Sigh.
 
Who's going to buy those albums which I probably won't like for me? You? Max or Ron? (Certainly not me!)Confused
 
Or should I illegally download them, then spend lots of my limited leisure time listening to music I don't care for? Why? Where is my motivation to do that?
 
Tricky & Guigo hit it on the head, aboveClap (and I've said much the same several times, & long beforeWink): we are NOT paid reviewers, getting sent random albums to review by our employers or record companies. Rather, we are volunteer music fans and collectors, and thus we tend to own/buy stuff we either already know we like, or stuff that we can reasonably expect to like. We make INFORMED purchases with our limited music dollars. So I, likely you, and almost all of us own mostly stuff we like, thus that stuff gets a high rating (rightly so).
 
Perhaps some of our younger members who are still in school have more ready access to other people's (friends) collections, but I sure don't. I also think a younger person is more likely to buy "on spec" -- that is, on the strength of a review or ten -- and then write a review that says "this supposed classic is way overrated." (Perhaps because we oldsters, in our enthusiasm, led them to expect some "life-changing" experience -- but Close to the Edge was mindblowing in its 73 context -- much less so now.)
 
I know what I like -- and that's what I buy/own. 
No way around that basic fact.Stern Smile
 
And, BTW, select albums to review en masse HAS been thought of -- and done -- here before, but that practice (MP3 copies of albums, for Collabs to review) was found to be of dubious legality (despite PA being based in Canada, where file sharing laws are much more liberal), and soon stopped, lest the beastly record companies descend upon us in their wrath. Loose lips sank that ship.
 
 
By now, you probably know what I don't like, so send me some of that headbangin' stuff you call "prog," and I'll gleefully savage it for you.Wink
 
But would that be an improvement? It would be a trifle biased, no?
 
Bottom line: reviews on a site where the reviews are fan-generated will ALWAYS be  weighted toward the upper end of the spectrum.
 
(And in my experience, most of the really negative reviews come from silly kids seeking to manipulate the rankings. How is it that they know so many supposedly crap albums so well, anyway? Are they masochists, or just too stupid to turn off/stop buying stuff they don't like?Confused


Edited by Peter Rideout - October 25 2006 at 02:34
"And, has thou slain the Jabberwock?
Come to my arms, my beamish boy!
O frabjous day! Callooh! Callay!'
He chortled in his joy.
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21455
Direct Link To This Post Posted: October 25 2006 at 02:40
Usually I don't like reviewing albums I don't like, because it means that fans of the band/album will be disappointed when reading the review. But sometimes it's necessary ... and after all these reviews tell more about a reviewer than the 1001st review of Close to the Edge.

I guess that the most effective way to write interesting reviews is to simply focus on albums which you see differently than the "public opinion" - works both ways (negative/positive).
Back to Top
Pnoom! View Drop Down
Forum Senior Member
Forum Senior Member


Joined: September 02 2006
Location: OH
Status: Offline
Points: 4981
Direct Link To This Post Posted: October 25 2006 at 08:44
3 ***** reviews, actually...
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21455
Direct Link To This Post Posted: October 25 2006 at 09:01
somehow I think that your post lacks context.WackoWink
Back to Top
Philéas View Drop Down
Forum Senior Member
Forum Senior Member


Joined: June 14 2006
Status: Offline
Points: 6419
Direct Link To This Post Posted: October 25 2006 at 13:31
Originally posted by Peter Rideout Peter Rideout wrote:

Who's going to buy those albums which I probably won't like for me? You? Max or Ron? (Certainly not me!)Confused


You won't have to listen to them and review them. The admins or specialist teams choose a couple of albums, and you can choose wheter you want to review them or not. At least that's the way I'd like it to work. Forcing people to listen to albums against their will is not a good idea.
Back to Top
progaeopteryx View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: June 03 2005
Location: Refrigerator
Status: Offline
Points: 3613
Direct Link To This Post Posted: November 03 2006 at 18:38
How about redesigning the algorithm to include the number of reviews a reviewer has made? For instance, a reviewer who only reviews 10 albums will have a smaller effect on any given album's total rating score than a reviewer who has reviewed 100 albums. The more albums you review, the more of an impact you will have on the rating score of any given album. The effect of consistently doing more and more reviews would also retrospectively increase the impact on previous albums the reviewer has reviewed. In addition, some checking on score spreads, as noted previously, would lower the impact if a reviewer gives everything five stars or one star and has done it to say a couple hundred titles.

I believe something similar to this is used at rateyourmusic.com. I don't know if such an idea is statistically helpful as I'm not a statistician. But at the very least, I think it's worth discussing.
Back to Top
moreitsythanyou View Drop Down
Forum Senior Member
Forum Senior Member
Avatar
VIP Member

Joined: April 23 2006
Location: NYC
Status: Offline
Points: 11682
Direct Link To This Post Posted: November 03 2006 at 18:44
My idea is add .5 stars. A lot of 5 star albums will become 4.5 star albums which is probably a better rating.
Also who ever said in a fan based will tend to have higher ratings is absolutely correct
<font color=white>butts, lol[/COLOR]

Back to Top
OpethGuitarist View Drop Down
Prog Reviewer
Prog Reviewer


Joined: June 25 2006
Location: United States
Status: Offline
Points: 1655
Direct Link To This Post Posted: November 07 2006 at 16:32
Originally posted by progaeopteryx progaeopteryx wrote:

How about redesigning the algorithm to include the number of reviews a reviewer has made? For instance, a reviewer who only reviews 10 albums will have a smaller effect on any given album's total rating score than a reviewer who has reviewed 100 albums. The more albums you review, the more of an impact you will have on the rating score of any given album. The effect of consistently doing more and more reviews would also retrospectively increase the impact on previous albums the reviewer has reviewed. In addition, some checking on score spreads, as noted previously, would lower the impact if a reviewer gives everything five stars or one star and has done it to say a couple hundred titles.

I believe something similar to this is used at rateyourmusic.com. I don't know if such an idea is statistically helpful as I'm not a statistician. But at the very least, I think it's worth discussing.
 
Not a bad idea. Only problem is SeanTrane would rule everything lol.
back from the dead, i will begin posting reviews again and musing through the forums
Back to Top
Pnoom! View Drop Down
Forum Senior Member
Forum Senior Member


Joined: September 02 2006
Location: OH
Status: Offline
Points: 4981
Direct Link To This Post Posted: November 07 2006 at 16:41
Originally posted by OpethGuitarist OpethGuitarist wrote:

Originally posted by progaeopteryx progaeopteryx wrote:

How about redesigning the algorithm to include the number of reviews a reviewer has made? For instance, a reviewer who only reviews 10 albums will have a smaller effect on any given album's total rating score than a reviewer who has reviewed 100 albums. The more albums you review, the more of an impact you will have on the rating score of any given album. The effect of consistently doing more and more reviews would also retrospectively increase the impact on previous albums the reviewer has reviewed. In addition, some checking on score spreads, as noted previously, would lower the impact if a reviewer gives everything five stars or one star and has done it to say a couple hundred titles.

I believe something similar to this is used at rateyourmusic.com. I don't know if such an idea is statistically helpful as I'm not a statistician. But at the very least, I think it's worth discussing.
 
Not a bad idea. Only problem is SeanTrane would rule everything lol.
 
LOL to OG
 
I do not think this would work, however, unless the reviewers who review more write better, more thought out reviews, which might well be the case.  What we would do to keep ST from ruling out everything is to say that everyone over 1000 reviews gets the same influence.  That way, ST would still have the most influence (until someone else gets up there), but not so much more that it would create a problem.  It certainly could work.
 
I do think we could also limit people to only 50% of their reviews being 5 stars after they've written, say, 20 reviews, as anyone who has heard that many five star albums is a lucky man indeed.  I know a lot of prog, and only 6 albums, maybe 7, and a very slight possibility of 8, but only 6 albums have definitely earned 5 stars.  I have written 60 odd reviews, with about 50 more that I will write as soon as I get a chance.  Not one of those 50 is a five star album.
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21455
Direct Link To This Post Posted: November 07 2006 at 16:44
Originally posted by Peter Rideout Peter Rideout wrote:

Who's going to buy those albums which I probably won't like for me? You? Max or Ron? (Certainly not me!)Confused
 
Or should I illegally download them, then spend lots of my limited leisure time listening to music I don't care for? Why? Where is my motivation to do that?


You live in Canada ... one of the big advantages of this magnificent country is that Napster is available there. So for the price of a few dollars each month you can have access to all these albums that you wouldn't normally spend money on.Big smile


Edited by MikeEnRegalia - November 07 2006 at 17:00
Back to Top
el böthy View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: April 27 2005
Location: Argentina
Status: Offline
Points: 6336
Direct Link To This Post Posted: November 07 2006 at 17:07
Many people rate only the albums they really really like, and in most cases this are the ones that get their 5 star review. I dont see why that bothers you
"You want me to play what, Robert?"
Back to Top
johnobvious View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: May 11 2006
Location: Nebraska
Status: Offline
Points: 1367
Direct Link To This Post Posted: November 08 2006 at 13:17
Having people review bands they don't like would be like what is happening now, just in reverse.  You would still not be getting an unbiased opinion.  Music reviewing can never really be conducted in a vacuum, even by professionals.  But do I have an answer to fix it, no. 

But one thing I do really appreciate in a review is the referencing of the band's other albums (or albums of like bands).  When a new album comes out, any references to previous albums and how it compares does more for me than just trying to describe sound with text.  Maybe that could be incorporated in the suggestions for reviews.
Biggles was in rehab last Saturday
Back to Top
Peter View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: January 31 2004
Location: Canada
Status: Offline
Points: 9669
Direct Link To This Post Posted: November 08 2006 at 15:18
Originally posted by MikeEnRegalia MikeEnRegalia wrote:

Originally posted by Peter Rideout Peter Rideout wrote:

Who's going to buy those albums which I probably won't like for me? You? Max or Ron? (Certainly not me!)Confused
 
Or should I illegally download them, then spend lots of my limited leisure time listening to music I don't care for? Why? Where is my motivation to do that?


You live in Canada ... one of the big advantages of this magnificent country is that Napster is available there. So for the price of a few dollars each month you can have access to all these albums that you wouldn't normally spend money on.Big smile
 
Ermm It's still not free though, so it won't happen.
 
Plus I don't want to have to listen to music I don't really like, anyway. (I use multiple listens to write a review.)
 
I don't have limitless time for music. I turn to it for pleasure, not out of a sense of duty or obligation.
 
Plus I want the real CD lyrics, photos & all -- I am a collector.
 
 
In any case, I really don't care about the percentage of 4 & 5 star reviews I've written. They accurately reflect MY collection, and what I think of it. Others have expressed concern, not me. (I only responded to point out how I thought a top-heavy weighting overall was inevitable, in a site where reviewers are unpaid fans, not paid professionals being sent music to review.)
 
Smile
 


Edited by Peter Rideout - November 08 2006 at 15:41
"And, has thou slain the Jabberwock?
Come to my arms, my beamish boy!
O frabjous day! Callooh! Callay!'
He chortled in his joy.
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Offline
Points: 21455
Direct Link To This Post Posted: November 08 2006 at 16:05
^ fair enough, who has time to listen to bad music ... but it's not fair to complain that Napster is not a free service ... after all, good music doesn't just make itself.Wink 10 bucks for more than 2 million tracks still sounds quite fair to me.Big smile

BTW: I also couldn't care less about the percentage of 5 or 4 star ratings in my profile ... LOL




Edited by MikeEnRegalia - November 08 2006 at 16:06
Back to Top
OpethGuitarist View Drop Down
Prog Reviewer
Prog Reviewer


Joined: June 25 2006
Location: United States
Status: Offline
Points: 1655
Direct Link To This Post Posted: November 09 2006 at 15:17
Originally posted by MikeEnRegalia MikeEnRegalia wrote:


BTW: I also couldn't care less about the percentage of 5 or 4 star ratings in my profile ... LOL




Perhaps because that's all you have? Tongue

I kid, I kid.
back from the dead, i will begin posting reviews again and musing through the forums
Back to Top
Peter View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: January 31 2004
Location: Canada
Status: Offline
Points: 9669
Direct Link To This Post Posted: November 09 2006 at 18:57
Originally posted by MikeEnRegalia MikeEnRegalia wrote:

^ fair enough, who has time to listen to bad music ... but it's not fair to complain that Napster is not a free service ... after all, good music doesn't just make itself.Wink 10 bucks for more than 2 million tracks still sounds quite fair to me.Big smile

BTW: I also couldn't care less about the percentage of 5 or 4 star ratings in my profile ... LOL


No, I don't want it to be free -- I am agaiinst illegal downloading. Thumbs Down Admittedly, I did some in the past (mostly "one-hit wonder" stuff I'd never have bought), but I had a "crisis of conscience" about two years ago, and am enthusiastically buying CDs again.Big smile
 
I guess what I mean, but didn't make clear, is that until I am paid (handsomelyWink) to listen to and review stuff I don't care for, I just won't listen to it, or try to acquire it. My few very low ratings here were of CDs I was given, or from bands whom I'd enjoyed before (Tull, Rennaissance, etc.).
 
The opportunities are few, but I actually enjoy writing negative reviews. You get to use a whole new set of adjectives, and it's a great chance to use more humour. In fact, as I've said here before, some of my favourite professional reviews that I've read in magazines, etc, have been the really scathing ones.
 
I have had a good idea for a (hopefully) funny negative review for some time now, but someone would have to send me some ultra-fast and heavy, growly metal that they think I'd hate, first. (For the sake of my conscience, they'd have to know ahead of time what I was hoping/planning to do with the album: savage and ridicule it.)
 
SmileYou know what I don't like, Mike. Have you got any extra copies of albums that you might like, but think I'd hate lying around? Does it perhaps need its overall rating lowered? Would you be able to tolerate me making fun of it, mainly for the purpose of exercising my creative/funny side, and giving my ratings more "balance?" Would you be able to laugh too, even if you strongly disagree with my opinion?
 
I'll just hold my breath, and keep checking my mailbox....Wink
"And, has thou slain the Jabberwock?
Come to my arms, my beamish boy!
O frabjous day! Callooh! Callay!'
He chortled in his joy.
Back to Top
OpethGuitarist View Drop Down
Prog Reviewer
Prog Reviewer


Joined: June 25 2006
Location: United States
Status: Offline
Points: 1655
Direct Link To This Post Posted: November 09 2006 at 19:00
Peter I can more than help you out, if you are really so inclined...

Embarrassed
back from the dead, i will begin posting reviews again and musing through the forums
Back to Top
 Post Reply Post Reply Page  <123>

Forum Jump Forum Permissions View Drop Down



This page was generated in 0.133 seconds.
Donate monthly and keep PA fast-loading and ad-free forever.