Forum Home Forum Home > Site News, Newbies, Help and Improvements > Help us improve the site
  New Posts New Posts RSS Feed - Way to reduce # of 5 star ratings
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

Topic ClosedWay to reduce # of 5 star ratings

 Post Reply Post Reply Page  <123>
Author
Message Reverse Sort Order
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Online
Points: 21491
Direct Link To This Post Posted: October 25 2006 at 02:40
Usually I don't like reviewing albums I don't like, because it means that fans of the band/album will be disappointed when reading the review. But sometimes it's necessary ... and after all these reviews tell more about a reviewer than the 1001st review of Close to the Edge.

I guess that the most effective way to write interesting reviews is to simply focus on albums which you see differently than the "public opinion" - works both ways (negative/positive).
Back to Top
Peter View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: January 31 2004
Location: Canada
Status: Offline
Points: 9669
Direct Link To This Post Posted: October 25 2006 at 02:17
Heavyfreight
Senior Member
Senior Member
Avatar

Joined: October 04 2006
Location: United Kingdom
Online Status: Offline
Posts: 168
Quote Heavyfreight Replybullet Posted: October 23 2006 at 05:18
I think that Mike has highlighted the problem.  If many people only choose to rate the albums that they like or are interested in then there will be a bias towards good ratings.
 
One suggestion I have would be to nominate albums and then ask members of the site to listen to them and then post a review.  That way you would get comments both good and bad and therefore a more balanced view.  I know that it isn't quite that simple to organise this but it may lead someone to come up with another better idea.
 
Neil.
Heracleum Mantegazzianum
IP IP Logged Report Post
Philéas
Senior Member
Senior Member
Avatar

Joined: June 14 2006
Location: Sweden
Online Status: Offline
Posts: 1716
Quote Philéas Replybullet Posted: October 23 2006 at 05:22
That's a good idea, Heavyfreight!  It surprises me that nobody has thought about it yet.
 
Originally posted by Geck0 Geck0 wrote:

I can't see it working though.

People are biased with tastes, so someone who dislikes a certain style of prog, will have a biased view when it comes to ranking.

Maybe we can ask people to rank and review some of those albums that have little, to no reviews at all?  There are many bands in the archives that don't have a single review.  They should take priority over big bands.
This old topic again, eh? Sigh.
 
Who's going to buy those albums which I probably won't like for me? You? Max or Ron? (Certainly not me!)Confused
 
Or should I illegally download them, then spend lots of my limited leisure time listening to music I don't care for? Why? Where is my motivation to do that?
 
Tricky & Guigo hit it on the head, aboveClap (and I've said much the same several times, & long beforeWink): we are NOT paid reviewers, getting sent random albums to review by our employers or record companies. Rather, we are volunteer music fans and collectors, and thus we tend to own/buy stuff we either already know we like, or stuff that we can reasonably expect to like. We make INFORMED purchases with our limited music dollars. So I, likely you, and almost all of us own mostly stuff we like, thus that stuff gets a high rating (rightly so).
 
Perhaps some of our younger members who are still in school have more ready access to other people's (friends) collections, but I sure don't. I also think a younger person is more likely to buy "on spec" -- that is, on the strength of a review or ten -- and then write a review that says "this supposed classic is way overrated." (Perhaps because we oldsters, in our enthusiasm, led them to expect some "life-changing" experience -- but Close to the Edge was mindblowing in its 73 context -- much less so now.)
 
I know what I like -- and that's what I buy/own. 
No way around that basic fact.Stern Smile
 
And, BTW, select albums to review en masse HAS been thought of -- and done -- here before, but that practice (MP3 copies of albums, for Collabs to review) was found to be of dubious legality (despite PA being based in Canada, where file sharing laws are much more liberal), and soon stopped, lest the beastly record companies descend upon us in their wrath. Loose lips sank that ship.
 
 
By now, you probably know what I don't like, so send me some of that headbangin' stuff you call "prog," and I'll gleefully savage it for you.Wink
 
But would that be an improvement? It would be a trifle biased, no?
 
Bottom line: reviews on a site where the reviews are fan-generated will ALWAYS be  weighted toward the upper end of the spectrum.
 
(And in my experience, most of the really negative reviews come from silly kids seeking to manipulate the rankings. How is it that they know so many supposedly crap albums so well, anyway? Are they masochists, or just too stupid to turn off/stop buying stuff they don't like?Confused


Edited by Peter Rideout - October 25 2006 at 02:34
"And, has thou slain the Jabberwock?
Come to my arms, my beamish boy!
O frabjous day! Callooh! Callay!'
He chortled in his joy.
Back to Top
OpethGuitarist View Drop Down
Prog Reviewer
Prog Reviewer


Joined: June 25 2006
Location: United States
Status: Offline
Points: 1655
Direct Link To This Post Posted: October 25 2006 at 00:06
Another major problem, at least in my eyes, is the backlash received here by fans if you rate something here poorly.

For my own case I've had several occassions where I was more or less yelled at and abused because I rated a particular album poorly.

You also will lose a lot of friends if you attempt to be fair here. That's another issue, as I think some members here have some growing up to do.

I'm going to keep doing things the way I'm doing them, leading the cause for balanced rating systems at PA.
back from the dead, i will begin posting reviews again and musing through the forums
Back to Top
Atkingani View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator / Retired Admin

Joined: October 21 2005
Location: Terra Brasilis
Status: Offline
Points: 12288
Direct Link To This Post Posted: October 24 2006 at 21:26
 
Very interesting, OG. This issue was raised in the Admin Zone in October, 6. Here is my starting post for the thread. Smile
 
 
Professional reviewers (websites, magazines, newspapers, etc) deal not only with material they like but also with material ceded by the media owners or labels or artists. Consequently, the share of their reviews show a much more distributed ratings from, say, 1 to 5 stars. In many occasions, they have to review stuff they don't like!
 
Amateur reviewers (99% of PA reviewers) deal generally only with stuff they like. No one will run to the shops to buy a CD not preferred and even borrowing from friends, they'll ask for something they believe is closer to their taste. Consequently, their ratings will show an unbalanced distribution, with 3 to 5 stars dominating.
 
The question is: Can we persuade our reviewers (collabs or not) to review a CD or an album of a band they don't like or disdain? In this case, how? The rating profile for each band and each album could be more fair???
Guigo

~~~~~~
Back to Top
Pnoom! View Drop Down
Forum Senior Member
Forum Senior Member


Joined: September 02 2006
Location: OH
Status: Offline
Points: 4981
Direct Link To This Post Posted: October 24 2006 at 13:42
Actually, the reason why I do this is that if an album gets 5 stars from me, it is exactly the same as any other 5 star album.  A masterpiece is a masterpiece, you can't have a *better* masterpiece, because that implies some imperfection, which is not the case in a true masterpiece.  The same goes for a one star rating.  If it's deserving of 1 star, it has no redeeming qualities, and is therefore just as bad as any other album without any merits.
 
The only problem this creates is that my Under Wraps review (an album I intensely dislike) gets two stars because 3 of the songs are listenable (thus giving it some redemption).  At the same time, Ummagumma (an album I enjoy a lot) is really only for collector's/fans.  I could boost it to 3 stars, but that doesn't accurately convey that it's only for collectors.
 
This is the only dilemna this rating system creates.  If we had a ten point scale, I could give Under Wraps the 2 it deserves, and Ummagumma the 4 it deserves.  The real problem is that there aren't enough choices for ratings.  The way it is set up now, about 90% of the albums should be three stars (good, but non-essential), with small portions of each band's work being excellent/masterpiece or collectors/completionists only.
 
This is exemplified by SeanTrane, who for half of his reviews adds a half star.  A 10 star system would take care of this, I feel.
Back to Top
Pnoom! View Drop Down
Forum Senior Member
Forum Senior Member


Joined: September 02 2006
Location: OH
Status: Offline
Points: 4981
Direct Link To This Post Posted: October 24 2006 at 13:34
I agree that this is a problem.  Of my 47ish reviews, I believe I've given 5 ***** ratings and 1 * rating.  The rest range from 2-4, and **s aren't necessarily bad.
 
For instance, I rated a Tool album, and my review was essentially this:
 
It's clearly good, and hear's why: reasons
But I don't like it, so I'll give it a 2.
Back to Top
Trickster F. View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: February 10 2006
Location: Belize
Status: Offline
Points: 5308
Direct Link To This Post Posted: October 23 2006 at 15:52
Originally posted by Easy Livin Easy Livin wrote:

I agree with those who have already pointed out that most reviewers will focus on the albums they love first, so reviewers with only a few reviews will proabbly have an overall higher average of their ratings than those who have reviewed many.
 
I wouldn't agree with that: I used to give lower ratings more often before I became a Prog Reviewer(and obviously I was less experienced at the time), whereas now I feel the necessity to cover more obscure albums I would like to recommend rather than make attempts on criticising music I simply do not comprehend(wish I hadn't posted that TFK review).
sig
Back to Top
Easy Livin View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator / Retired Admin

Joined: February 21 2004
Location: Scotland
Status: Offline
Points: 15585
Direct Link To This Post Posted: October 23 2006 at 14:32
One thing I have asked M@X to look at doing is to show for each reviewer (on their own page) the spread of their ratings. This would look the same as the bar chart shown on each album page. This may help to highlight to some reviewers that they are not using the full range of ratings available effectively enough.
 
I agree with those who have already pointed out that most reviewers will focus on the albums they love first, so reviewers with only a few reviews will proabbly have an overall higher average of their ratings than those who have reviewed many.
 
If any particular reviewer does seem to be over generous with 4 and 5 star ratings, feel free to highlight it in the Reviews Discussion thread. It would not be considered a personal attack of any sort to civilly suggest that they are being over generous.Wink
Back to Top
OpethGuitarist View Drop Down
Prog Reviewer
Prog Reviewer


Joined: June 25 2006
Location: United States
Status: Offline
Points: 1655
Direct Link To This Post Posted: October 23 2006 at 12:49
it's ok guys, I perfectly understand your point of view

just some thoughts i had wandering around in my head


Edited by OpethGuitarist - October 23 2006 at 12:49
back from the dead, i will begin posting reviews again and musing through the forums
Back to Top
Ricochet View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: February 27 2005
Location: Nauru
Status: Offline
Points: 46301
Direct Link To This Post Posted: October 23 2006 at 11:14
except an abuse, we can't deal with the people's choice, even if they don't take seriously the balance of the scales from 1 to 5. of course there aren't too many albums of genuine 5 stars and there aren't too many artists having many 5 stars albums (and I understand you view, Opeth, since you yourself give 5 stars very reticently). but we can't just force a so-called or so-wanted correctitude. and neither to change things because of those who seems fishy (as you said, many people act balanced). 
Back to Top
bhikkhu View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 06 2006
Location: A² Michigan
Status: Offline
Points: 5109
Direct Link To This Post Posted: October 23 2006 at 08:52
    What if you only want to review the albums you like the most? I agree with the other statements about not owning bad albums. I don't purchase on a whim like I used to. There is enough information now to get an idea of something before you buy it. This site alone can guide you the right way.

This is why I am actually more suspicious of one star ratings. There was the issue of the person who gave every Beatles album one star. Do you really think he gave each album a thorough evaluation?
    

Edited by bhikkhu - October 23 2006 at 08:52
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Online
Points: 21491
Direct Link To This Post Posted: October 23 2006 at 05:35
Personally I prefer an absolutely free approach to rating: No guidelines, suggestions etc.. You have a certain scale (0-5, 1-5, 1-10, 1-20 etc) and then you assign a rating to an album just with the simple rule in mind that the rating should be higher than ratings of albums which you like less, and lower than ratings of albums which you like more.

I hope you understand what I'm trying to say ... I'm sure that there is no such thing as *one* perfect rating system. So why try to enforce it ... people won't listen and develop their own set of rules anyway. So by assigning deeper meanings to certain steps (like "2 stars = for fans only") all you achieve is to create misunderstandings. 2/5 means "bad", no matter how well you explain the meaning, people percieve it as "below par" intuitively.
Back to Top
VanderGraafKommandöh View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: July 04 2005
Location: Malaria
Status: Offline
Points: 89372
Direct Link To This Post Posted: October 23 2006 at 05:28
I can't see it working though.

People are biased with tastes, so someone who dislikes a certain style of prog, will have a biased view when it comes to ranking.

Maybe we can ask people to rank and review some of those albums that have little, to no reviews at all?  There are many bands in the archives that don't have a single review.  They should take priority over big bands.
Back to Top
Philéas View Drop Down
Forum Senior Member
Forum Senior Member


Joined: June 14 2006
Status: Offline
Points: 6419
Direct Link To This Post Posted: October 23 2006 at 05:22
That's a good idea, Heavyfreight!  It surprises me that nobody has thought about it yet.
Back to Top
Neil View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: October 04 2006
Location: United Kingdom
Status: Offline
Points: 1497
Direct Link To This Post Posted: October 23 2006 at 05:18
I think that Mike has highlighted the problem.  If many people only choose to rate the albums that they like or are interested in then there will be a bias towards good ratings.
 
One suggestion I have would be to nominate albums and then ask members of the site to listen to them and then post a review.  That way you would get comments both good and bad and therefore a more balanced view.  I know that it isn't quite that simple to organise this but it may lead someone to come up with another better idea.
 
Neil.
When people get lost in thought it's often because it's unfamiliar territory.
Back to Top
Philéas View Drop Down
Forum Senior Member
Forum Senior Member


Joined: June 14 2006
Status: Offline
Points: 6419
Direct Link To This Post Posted: October 23 2006 at 05:13
To avoid any complications, let me just clarify that this post isn't aimed at anyone in particular and that it isn't supposed to sound negative in any way. Smile

Personally, I think that the only "bad" rating is one star. An album rated two stars, according to how the site defines that rating (Collectors/fans only), might not be very enjoyable for a person who is only a casual fan or a person who is new to the band in question, but for a fan of the band it will be a good album. I rated Gentle Giant's debut two stars, but like I said in my review I don't think it's a bad album at all. As I am a fan of GG, I like it, and I listen to it every now and then. The reason I gave it two stars is because in my opinion it isn't the best GG has to offer, and it's not the best album to start with if one is new to GG (again, in my opinion that is). 
Back to Top
MikeEnRegalia View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 22 2005
Location: Sweden
Status: Online
Points: 21491
Direct Link To This Post Posted: October 23 2006 at 05:06
Originally posted by OpethGuitarist OpethGuitarist wrote:


Theirs no weight to a rating if you think everything is extremely superb. Maybe the site could incorporate some kind of balancing system, say to where only 50% of your ratings can be for 5 stars. That'd be a huge step in balancing things in my opinion.


The problem is that there are huge differences in the selection of albums of each reviewer ... some choose to only review their favorite albums, some review randomly selected albums, some review their masterpieces + the albums which they think extremely suck (to warn others) ...
Back to Top
VanderGraafKommandöh View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: July 04 2005
Location: Malaria
Status: Offline
Points: 89372
Direct Link To This Post Posted: October 23 2006 at 04:57
That's the other problem Rocktopus.

A lot of albums in my collection are 4.5/5 and my own personal feeling is that I should round up to a 5, rather than down to a 4.  It's mainly personal choice on my behalf.  Some 4.5's are 4's and some are 5's.

My Astrid Proll review shows that I rated it a 4/5, but I personally think it's a 4.5, but in this particular situation, I've rounded it down to a 4, as it's a debut album by a relatively unknown band (in which I have been promoting).  If others start to rate it a 5/5, then maybe I'll change my ranking, but I don't want to set a precedence with a new album.


Edited by Geck0 - October 23 2006 at 04:57
Back to Top
Rocktopus View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: March 02 2006
Location: Norway
Status: Offline
Points: 4202
Direct Link To This Post Posted: October 23 2006 at 04:53
Originally posted by Trickster F. Trickster F. wrote:

People don't think "everything is awesome", it's just many of us, myself included, prefer to rate albums they actually really like (and if you remember that people also prefer to listen to the music they enjoy, it becomes even clearer).


Yep. I've probably rated 30% a five star here. That does not mean I think 30% of the albums in the Archives are masterpieces. I could spend a day and give about 500-600 albums a three star, but I guess I won't bother. Besides, it would be easier to give lower ratings if halfs was possible.
Over land and under ashes
In the sunlight, see - it flashes
Find a fly and eat his eye
But don't believe in me
Don't believe in me
Don't believe in me
Back to Top
VanderGraafKommandöh View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: July 04 2005
Location: Malaria
Status: Offline
Points: 89372
Direct Link To This Post Posted: October 23 2006 at 04:47
I agree Iván.  I don't think I have a "bad" album in my entire collection, but I do have albums that I'd rate around 3/5, but none lower than that.

I don't buy music I'm unlikely to like.  Also, even bad albums (mostly), have some good elements, so I don't think giving an album a 1 is a good decision.

I am not a huge fan of Dream Theater, but if I listened to an album of theirs in full, I'm sure I'd find merits and it's obvious they're talented musicians, so I couldn't give a DT album a 1. due to those reasons.

I am currently lacking reviews and that is due to mainly me being somewhat of a perfectionist when it comes to writing reviews and also due to ratings.

I want to rate virtually all Van der Graaf Generator albums as a 5, but at the same time, I feel this is the wrong thing to do...

I also have a few albums in my collection that are 4/5 star albums, but they get more plays than a lot of 5/5 albums.  I prefer some 4/5 albums over 5/5 albums.

An example of the above is "Starless and Bible Black".  It's not as good an album as "Red", but I personally prefer it to it.
Back to Top
 Post Reply Post Reply Page  <123>

Forum Jump Forum Permissions View Drop Down



This page was generated in 0.273 seconds.
Donate monthly and keep PA fast-loading and ad-free forever.