Forum Home Forum Home > Site News, Newbies, Help and Improvements > Help us improve the site
  New Posts New Posts RSS Feed - Should Ratings Be Abolished?
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

Topic ClosedShould Ratings Be Abolished?

 Post Reply Post Reply Page  <123>
Author
Message Reverse Sort Order
micky View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: October 02 2005
Location: .
Status: Offline
Points: 46838
Direct Link To This Post Posted: July 03 2015 at 14:11
Originally posted by Guldbamsen Guldbamsen wrote:

Don't get me wrong - I would love for things to be different; I just don't see any proof suggesting that members or visitors read READ the frontpage.....and I happen to love writing reviews
I do read em though. Man I don't know what I would've done if I'd missed Michael's (Neu!mann) recent Amon Düül write-up. That thing was hilarious and wonderfully written.


I doubt there would be proof either way.. but I do think it dovetails to the overall trend that listeners and bands don't necessarily see the site as the place to go. It used to be you couldn't go a day without having some band or band member come on .. promoting his band and asking our teams to evaluate them for addition. Now these days..  other than 1 man solo productions and a few crusaders who are seen to be pestering the genre with suggestion.. that has all sort of dried up. Why

Social media and blogs review sites... bands can reach directly to audiences and also have their albums reviewed and spotlighted..  not just here on the front page here and often only for a short time before disappearing (with a questionable notion of how many actually glace at the front page. My bookmark is set to the forum page.. where are all of yours set?).  It is only when I want to know OF a specific album do I check reviews. and even then.. like many long term music fans. .we rely not on reviewers but personal recommendations from people we know and know our tastes.

As far as reviews.. I don't know if there is anything to be done.. or should be done. It is a natural evolution.  However I've always liked the notion of something simple yet nourishing like 'reviews of the day' where good reviews are given some love and perhaps a bone. Perhaps giving them top billing for the next day.  Small things like could encourage, might put some wind back the sails of reviewers who do wonder why they might bother..

and still...  keeping on topic....   ratings need to go.. a byproduct of a day and time and site here that really isn't pertinent today. Pure inertia man.  As I noted in the other thread.  Perhaps the caretakers of the site should be looking at how to tweak and improve things .. sometimes it not always best to think.. if it ain't broke don't fix it.  The only way things can improve and get better.. is if one makes an effort to improve them. And change or tweaking things...9 times out of 10 is the instrument to improvement. Thumbs Up


Edited by micky - July 03 2015 at 14:12
The Pedro and Micky Experience - When one no longer requires psychotropics to trip
Back to Top
mogol View Drop Down
Forum Groupie
Forum Groupie


Joined: September 26 2011
Status: Offline
Points: 42
Direct Link To This Post Posted: July 03 2015 at 13:01
Originally posted by Dean Dean wrote:

If you personally want to add artists then prove your worth and become a collaborator on one of the teams.

No, I don't promote myself here :) I have my blog where I can add any artist, so my ego is satisfied. I just do believe that giving more rights to simple users can breathe some fresh air into this site and help it develop. I think that it's the users that are the most valuable resource. The most part of database here has been filled and reviews written not by administration, but by users. At the same they in general are not trusted.


As for the lack of reviews here - how many reviews of one album a person, who hasn't yet listened to it, needs? There is no problem when most reviews are positive or negative, but when there is the whole specter of emotions what does it say to the reader? Almost nothing. So not the quantity, but quality is more important. 
Back to Top
Dean View Drop Down
Special Collaborator
Special Collaborator
Avatar
Retired Admin and Amateur Layabout

Joined: May 13 2007
Location: Europe
Status: Offline
Points: 37575
Direct Link To This Post Posted: July 03 2015 at 12:53
Online reviews and ratings are not transparent so their value is questionable. In the UK the Competition and Markets Authority (CMA) are currently investigating "paid for reviews" on consumer websites such as Trip Adviser and Check-a-trade, and Amazon is taking legal action against companies who pay for fake reviews of their own products. 

While fake reviews are less of a problem for such trivia as album reviews on publicly accessible review sites such as the PA or RYM, it would imprudent to pretend that they don't exist or are of no concern, the term "payola" was coined for the dubious practices of the music industry after all. Just because the behemoth of major labels has been consigned to history (at least from our "prog" perspective) does not mean that the plethora of one-man-and-his-dog labels and self-release artists that have replaced it are above reproach. Anything that damages the integrity of the PA, such as the behaviour of rating manipulation abusers, will have a knock-on affect on the public's confidence in the unsolicited reviews we publish.




Edited by Dean - July 03 2015 at 12:53
What?
Back to Top
Windhawk View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: December 28 2006
Location: Norway
Status: Offline
Points: 11401
Direct Link To This Post Posted: July 03 2015 at 10:45
Originally posted by Guldbamsen Guldbamsen wrote:

Don't get me wrong - I would love for things to be different; I just don't see any proof suggesting that members or visitors read READ the frontpage.....and I happen to love writing reviews
I do read em though. Man I don't know what I would've done if I'd missed Michael's (Neu!mann) recent Amon Düül write-up. That thing was hilarious and wonderfully written.


The downfall of the reviews as a guide to buying music was something that dismayed me a bit as well. Reviews are occasionally read still, but as far as purchasing decisions go they aren't what they used to be indeed.

But some still care for them.

- The artists themselves. Reviews, especially well written reviews, are a core feedback system for many artists. They will also use reviews of quotes from them for various promotional activities, and many reviews will also help the artist to determine where and how to direct marketing

- Labels. Partially for reasons above if the artists is signed, but also as reference material if they are considering signing an artist. Something that still happens, although on rather different terms than in the glory days.

- Promoters of various kinds. They will look through reviews to see whether artists will fit certain type of events or not, again as reference material and then one of many.

- Buyers. Perhaps more rare these days indeed, but reviews still make an impact. Often as a part of a totality, a key piece of a puzzle where other pieces needs to be in place as well, but they still have a role to play.

Some years back I started getting promos from a small, UK label called Fruits de Mer Records. They had been trawling MySpace and some other channels for people to write about their releases: Vinyl singles featuring cover versions of mostly old psychedelic classics. I replied them and basically told them to add me to their promo list - but put me last in line.
The first few years the promo letters I got were extensive, flashy affair with multiple pages of gold and colored paper attached to the CD-R promo. I later got to know that the label had a hard time finding people willing to write about their products, and that they were sort of suffering from the spell of silence.

Fast forward a few years and the label have reviewers in place, are played and promoted on radio, their promo sendouts, now more regular one-sheets and with generally less stuff sent out, sell at fairly steep prizes whenever they hit ebay. Their vinyl releases have a tendency to sell out while on pre-order, they have expanded to do albums and original material, and artists and magazines actually approach them for inclusion and coverage respectively.

A grand totality which includes reviews have made that possible, combined with high quality releases this created a buzz that started feeding on itself and spreading. The reviews alone wasn't important, but without them this wouldn't have happened. Other elements, like word of mouth, radio stations picking this up, minor magazine features...all of them played a role, and all of them had to be in place for this development to take place.

You can to some extent see something similar on a more general level. Releases by Inside Out will typically sell more, often much more, than releases by labels such as Mellow, Musea or Lizard. Reviews have their role there as well, again as an element in a greater totality.

The age of reviews as a standalone, important and vital marketing feature that directly leads to sales is gone. They are still important, but now on a different level and, to some extent at least, as a part of a different context as well.
Websites I work with:

http://www.progressor.net
http://www.houseofprog.com

My profile on Mixcloud:
https://www.mixcloud.com/haukevind/
Back to Top
Raff View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: July 29 2005
Location: None
Status: Offline
Points: 24429
Direct Link To This Post Posted: July 03 2015 at 10:39
Originally posted by Guldbamsen Guldbamsen wrote:

I get what you're saying Olav, but speaking for myself here: I would hate to be part of a team where I HAD to review certain albums. That's also why I mostly thank no to acts asking for a review.
I also highly suspect that noone really bothers reading them - maybe except for the people who also do reviews.


I was an "official" reviewer for a number of years, and am still part of the DPRP reviewing team. Though at present there is quite a respectable number of reviewers on board, a good deal of the promos received by the two or three contact persons remains unreviewed for a long time - in some cases for close to a year. This happens because no one is forced to review stuff outside their comfort zone, which of course is a good thing. Unfortunately, many people just look at the artist name and brief description of the music, and don't even bother to listen to one or two samples. On the other hand, when a "big-name" album comes out, you have to fight people off roundtable reviews (which in some recent cases have involved up to 6 people).

This means that even having a team of regular reviewers would not guarantee that every album gets written about. There is just too much stuff released nowadays - and, let's be honest, quality control seems to be at an all-time low. That being said, artists still consider reviews extremely important, and see them as a means to attract potential listeners' attention.
Back to Top
Polymorphia View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: November 06 2012
Location: here
Status: Offline
Points: 8856
Direct Link To This Post Posted: July 03 2015 at 10:06
1. I think people will give ratings in their reviews anyway, whether or not a PA-facilitated system is in place.
2. Rating is fun. It isn't necessary, or very beneficial aside from the charts exposing users to albums. Early on, I scoured the charts and found a lot of albums I loved there. I'd hate to lose that.
3. It's odd that people are complaining about overly "subjective" reviews. Faced with an objective rating system, people look for more objective reasons to praise or decry an album. Unfortunately, here that translates to "the playing... the compositions..." examining the music like it's a table (is it solid?) and not someone's personal expression. I'd rather hear people review as human beings and talk about the themes of the album and how certain elements of the music might heighten or undermine what the artist is trying to express.
Back to Top
Guldbamsen View Drop Down
Special Collaborator
Special Collaborator
Avatar
Retired Admin

Joined: January 22 2009
Location: Magic Theatre
Status: Offline
Points: 23104
Direct Link To This Post Posted: July 03 2015 at 09:39
Don't get me wrong - I would love for things to be different; I just don't see any proof suggesting that members or visitors read READ the frontpage.....and I happen to love writing reviews
I do read em though. Man I don't know what I would've done if I'd missed Michael's (Neu!mann) recent Amon Düül write-up. That thing was hilarious and wonderfully written.

Edited by Guldbamsen - July 03 2015 at 09:42
“The Guide says there is an art to flying or rather a knack. The knack lies in learning how to throw yourself at the ground and miss.”

- Douglas Adams
Back to Top
micky View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: October 02 2005
Location: .
Status: Offline
Points: 46838
Direct Link To This Post Posted: July 03 2015 at 09:25
^ ahh... the elephant in the room.. exposed. As I noted.. it is a different world out there.  I applaud the reviewers here... but how many are really read.  There is a wealth of information out there by hard core dedicated reviewers in blogs and professsion(or not) review sites.

WE have great reviewers here, but sadly are often submerged quickly beneath amateur hour.. that is why I stopped. I sucked....


Edited by micky - July 03 2015 at 09:26
The Pedro and Micky Experience - When one no longer requires psychotropics to trip
Back to Top
Guldbamsen View Drop Down
Special Collaborator
Special Collaborator
Avatar
Retired Admin

Joined: January 22 2009
Location: Magic Theatre
Status: Offline
Points: 23104
Direct Link To This Post Posted: July 03 2015 at 09:22
I get what you're saying Olav, but speaking for myself here: I would hate to be part of a team where I HAD to review certain albums. That's also why I mostly thank no to acts asking for a review.
I also highly suspect that noone really bothers reading them - maybe except for the people who also do reviews.

In todays day and age people stream their music or look for a rating. Reading 300 words in a row is just too much of a hassle.
This is also why I've (almost) stopped doing them. They seem fruitless.

Edited by Guldbamsen - July 03 2015 at 09:41
“The Guide says there is an art to flying or rather a knack. The knack lies in learning how to throw yourself at the ground and miss.”

- Douglas Adams
Back to Top
Windhawk View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: December 28 2006
Location: Norway
Status: Offline
Points: 11401
Direct Link To This Post Posted: July 03 2015 at 09:08
Personally I don't think rating should be terminated, for reasons other have stated already. Ratings and lists are both expected, both features need to be present. Even dedicated, hardcore fans use them as a means of navigation, at least the ratings.

What is lacking are reviewers. New reviewers, quality reviewers. If this site had a reviewing team, it would soon be swimming in enough promos to fill up a swimming hall. Or three. Especially if said reviews were highlighted in some manner - upper half of the front page for instance. That would also, hopefully, create a drive for the ordinary reviewers to develop their skills well enough to become official reviewers. In this age of music streaming left, right, up and down as well as in the middle, those who would need pointers for material to try out on, the unreviewed album list for instance, could get easy guidance to those.

Something that over time would lead to more reviews and better reviews.

If this site needs it? That's another thing of course. Personally I'm not all that impressed by neither blogs or even some sites in terms of how reviews are written. Then again, my mentor in that department is an old fashioned writer, who learned the craft when reviews were still an art form and not just a case of merely stating how much you like an album or not, and at best with some some reasons as to why that is the case.
Websites I work with:

http://www.progressor.net
http://www.houseofprog.com

My profile on Mixcloud:
https://www.mixcloud.com/haukevind/
Back to Top
Dean View Drop Down
Special Collaborator
Special Collaborator
Avatar
Retired Admin and Amateur Layabout

Joined: May 13 2007
Location: Europe
Status: Offline
Points: 37575
Direct Link To This Post Posted: July 03 2015 at 09:05
Originally posted by mogol mogol wrote:

That's why I used to propose to give close to ablolute freedom to users here - adding new artists (I don't now as I understand technical problems related to such possibility). 
No technical problems, just logistic ones. We are not RYM so the artist additions criteria has to be strictly observed to ensure the artists qualify as prog artists.

We had free-for-all additions in the past and it's was a terrible idea that people can, will and did abuse. 

If you personally want to add artists then prove your worth and become a collaborator on one of the teams.


Edited by Dean - July 03 2015 at 09:08
What?
Back to Top
Sean Trane View Drop Down
Special Collaborator
Special Collaborator

Prog Folk

Joined: April 29 2004
Location: Heart of Europe
Status: Offline
Points: 20414
Direct Link To This Post Posted: July 03 2015 at 08:50
Originally posted by micky micky wrote:


get rid of ratings altogether as the first step to doing something to improve the site in a larger sense. A grand crusade of prog fans to create THE list. If RS can do it, this site can.. and one a helluva lot better as well.
 
I can still eventually see the site dropping the rating-only (or at least not accepting new ones), but getting rid of them altogether cannot function, IMHO.... losing the ratings would certainly diminish the quantity of users... and not necessarily augment (or keep the status quo) on qualitative users.
 
Simply because the "normal" user needs them and expects them (replacing them with 0 to 5 I Like would be the same).... Sadly we're in a world where giving your useless opinions (whether for or against) have become the success of many sites... I definitely don't see a rating as detrimental to a review. I myself find ratings very useful***
Too bad if an idiot user sees the rating >> his loss really.
 
Raff:  I'm at the base of the idea of placing the rating below the review in the submit review box (M@X immediately implemented that after I suggested it >> which goes to show that when he wants to... he can), even if in reality, it doesn't change much, since the stars are still showing at the top of the review. The idea was to first write the review and then put a rating on the album.
 
And in music, the most popular database sites (is there one more popular than RYM?), they seem to all function via star system.
 
 
 
***: Actually I participate to Gnosis2000, where it is ratings-only and very few reviews... the ratings are based on a solid 00 to 15 to -- and it works very well. I trust the site at 99.7% because I know a lot of the raters... Of course, we're a selected (elist a..hole) bunch with more or less the same aesthetics and musical loves.
 


Edited by Sean Trane - July 03 2015 at 08:53
Back to Top
mogol View Drop Down
Forum Groupie
Forum Groupie


Joined: September 26 2011
Status: Offline
Points: 42
Direct Link To This Post Posted: July 03 2015 at 08:50
Originally posted by Raff Raff wrote:

the majority of Internet users seem to love rating

If ordinary users love this feature (and I also think much of them really do), its abolishment will lead to decrease of interest in the site. The more rights and freedom you give to people, the more they are apt to use and develop the system. That's why I used to propose to give close to ablolute freedom to users here - adding new artists (I don't now as I understand technical problems related to such possibility). 

So no, I don't think simply getting rid of ratings won't make the site any good. Better think of how to make the rating system produce more realistic results - as of now most part of albums here have scores between 3.5 and 4.5, thus being considered as 'excellent'. 
Back to Top
micky View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: October 02 2005
Location: .
Status: Offline
Points: 46838
Direct Link To This Post Posted: July 03 2015 at 07:35
there really is no reason now to keep ratings without reviews.

The world is a different place today than it was 10+ years ago and the foundations of the site were being laid down.

The proliferation of review sites and of course personal reviewing blogs have taken many (potential) reviewing voices from the site.  Anyone incapable of writing a review here can, and likely is, writing them elsewhere.  Get rid of ratings without reviews definitely.. zero need for them. Also removes the persistant headache the admins have faced for years in combating ratings abuse/manipulation.

I see no one picked up what I had proposed..  so I'll try yet again. 

This thread came out of the what would you change thread. The basis of change.. is improvement.

What does the site really lack.. Passion and purpose. The forum has settled into domestic bliss of getting up a 6am.. catching the bus to work,  arriving home, having dinner with the wife, watching the boobtube for a few hours before retiring to bed.. to start the whole process again the next day.

What the forum need..  a purpose.  The RS top list generated a lot of interest and discussion. I came here to PA's from a site that created directly in response to the infamous RS Guitarist list of 2002. We worked to objectively as humanly possible rank these things. That is what the forum needs..  involve everyone a giant project to replace the current ratings driven album list with a comprehensive and definitive album list. We have a lot of smart people here.. engage them.. make use of them. Bring some life and purpose to forum other than silly polls and oft done discussion topics.

get rid of ratings altogether as the first step to doing something to improve the site in a larger sense. A grand crusade of prog fans to create THE list. If RS can do it, this site can.. and one a helluva lot better as well.


Edited by micky - July 03 2015 at 07:39
The Pedro and Micky Experience - When one no longer requires psychotropics to trip
Back to Top
Raff View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: July 29 2005
Location: None
Status: Offline
Points: 24429
Direct Link To This Post Posted: July 03 2015 at 07:22
I find ratings totally unnecessary when stuck at the end of a thorough review - or even detrimental, because many people will just scroll down to find the rating, ignoring a review that may have cost hours of work. Unfortunately, as I have already said elsewhere, the majority of Internet users seem to love rating anything with passionate intensity - just look at sites such as Yelp or TripAdvisor - so I don't think we stand a chance in hell of seeing ratings scrapped any time soon. However, I think an effort should be made to eliminate reviewless ratings, which often present a rather questionable picture of an album, as well as being used to manipulate album standings in the site's numerous Top X lists.
Back to Top
Dean View Drop Down
Special Collaborator
Special Collaborator
Avatar
Retired Admin and Amateur Layabout

Joined: May 13 2007
Location: Europe
Status: Offline
Points: 37575
Direct Link To This Post Posted: July 03 2015 at 06:45
Keep the ratings but separate them from reviews. 

If ratings without review are permitted then allow reviews without ratings

Don't publish calculate averages, they're meaningless. Use them internally to calculate the QWR for chart position if you must but the charts are meaningless too, especially those that compare albums from different bands, subgenres and times. For example Close To The Edge is PA's favourite Yes album is more meaningful than Close To The Edge is PA's favourite Symphonic Prog album, which in turn is more meaningful than it being PA's most favourite album of 1972 or PA's most favourite Prog album of all time.
What?
Back to Top
Guldbamsen View Drop Down
Special Collaborator
Special Collaborator
Avatar
Retired Admin

Joined: January 22 2009
Location: Magic Theatre
Status: Offline
Points: 23104
Direct Link To This Post Posted: July 03 2015 at 05:51
I sure should, but I couldn't find any sugarmama willing to sponsor the trip
“The Guide says there is an art to flying or rather a knack. The knack lies in learning how to throw yourself at the ground and miss.”

- Douglas Adams
Back to Top
tamijo View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: January 06 2009
Location: Denmark
Status: Offline
Points: 4287
Direct Link To This Post Posted: July 03 2015 at 04:41
Bamse what are you dooing here, shouldent you be wastet at the festival by now ?
Prog is whatevey you want it to be. So dont diss other peoples prog, and they wont diss yours
Back to Top
Guldbamsen View Drop Down
Special Collaborator
Special Collaborator
Avatar
Retired Admin

Joined: January 22 2009
Location: Magic Theatre
Status: Offline
Points: 23104
Direct Link To This Post Posted: July 03 2015 at 04:20
Yes, absolutely. Throw them out with the trash
“The Guide says there is an art to flying or rather a knack. The knack lies in learning how to throw yourself at the ground and miss.”

- Douglas Adams
Back to Top
Sean Trane View Drop Down
Special Collaborator
Special Collaborator

Prog Folk

Joined: April 29 2004
Location: Heart of Europe
Status: Offline
Points: 20414
Direct Link To This Post Posted: July 03 2015 at 04:15
Originally posted by someone_else someone_else wrote:

I don't have anything against star ratings, but I refuse to give them unless accompanied by a review. If I was to decide whether ratings without reviews were to be abolished, I'd say yes. Anyway, the weighting system helps to correct the rating-only effect a bit.
 
I also have no problems about ratings, and I'd even say that review-less ratings don't bother me either (though I've very rarely done it myself), if the number of ratings is sufficient enough to make the album rating somewhat trustworthy
 
Actually my only gripe is that 5Star is simply too limitative At one point, we had the 0Star happening Clap and I thought it was a step in the right directionThumbs Up, but this was retrieved after only one yearCry... it's been almost a decade since M@X promised us the much-awaited halfstars and we're still waiting...
Back to Top
 Post Reply Post Reply Page  <123>

Forum Jump Forum Permissions View Drop Down



This page was generated in 0.469 seconds.
Donate monthly and keep PA fast-loading and ad-free forever.