Forum Home Forum Home > Progressive Music Lounges > Prog Music Lounge
  New Posts New Posts RSS Feed - Objectivity in rating albums
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

Objectivity in rating albums

 Post Reply Post Reply Page  <1 23456 15>
Author
Message
jamesbaldwin View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: September 25 2015
Location: Milano
Status: Offline
Points: 5986
Post Options Post Options   Thanks (0) Thanks(0)   Quote jamesbaldwin Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 10:04
Originally posted by Logan Logan wrote:

Appreciation is, of course subjective, but if one agrees to or adheres to certain standards or set criteria, then some efforts can be considered objectively more successful then others. An example of this for me would be a replication challenge. We have three performers asked to read and play Ligeti's Devil's Staircase (Etude 13) and are asked not to improvise, but to play it accurately. Performer one is Keyboard Cat. The cat's human servant (one does not own the cat, the cat owns you) sprinkles dry cat food across the keyboard cum catwalk. The cat walk back and forth and it sounds nothing like the Ligeti piece. The second performer is an acclaimed concert pianist who plays all the right notes in the right order and at the right time. The fourth is a three year old beginner (first time trying to play the piano) who lacks the experience to play the piece. The fifth is a very drunk concert pianist who fumbles over the keys and then vomits all over the piano. The mother of the three year old might well enjoy her child's performance the most, but it wouldn't be the "best" according to the criterion of replication (playing a piece). The drunk's regurgitation might ultimately be declared great performance and visual art, but it would not be considered the most successful according to the challenge. The keyboard cat's performance may be the most successful on youtube, going viral (I know I like cat videos), but again it wouldn't be the most accurate performance. Now we have those same people record an album\s worth each of Liszt at the same level of proficiency, and we can judge it at the level of performance. Another way is to consider success is the intent, if someone sets out to make the greatest modal jazz album and the consensus finds that it ended up sounding like a messed up version of Crunkcore, then maybe it doesn't deserve a five star rating as a modal jazz album. As a messed up Crunkcore album it may be a masterpiece however. The albums may even be hailed as up there with Borkencyde! But not up there with Charles Mingus or Miles Davis and Gil Evans probably.

One of my favourite albums is The Shagg's Philosophy of the World, which is hailed as a bad album (they were amateurs), but many love it. Based on my subjective appreciation, I would rate it much higher than any Dream Theater, Spock's Beard or The Flower Kings album I know. But it's apples and oranges...

While I too would rather be able to review without rating, I actually have liked ratings a s reflection of an individual's taste (I will look at peoples reviewer pages) more so than as a conglomerate or aggregate at PA.

I do use RYM's album ratings charts to discover albums (I like the fact that I can search while using multiple tags for the album unlike here where all of a band's discography fall under one category, and not even multiple categories.
I do find that to be a useful research guide for checking things out (I have discovered quite a few acts and albums that I love that way). I also like to search reddit for music similar to whatever it is I am most into at the time but I digress.

I wish that ProgArchives ratings descriptors did not appeal to a sense of objectivity due to the subjective nature of evaluation. To each his or her own tastes. My scale would be more like ( I would want a wider spectrum and there is overlap in the descriptors, have done better ones before):
5. I love this!
4. I really liked this!
3. I like this.
2. Unsatisfying to me.
1. I really disliked/ loathed this.

I like that that scale is explicitly subjective. I do think there are various objective measures to evaluate the success of songs and albums, such as if you know what the goal of the song or album was, such as if it is lyrically trying to convey something that it actually gets wrong, like something historical nd not all music is performed as proficiently (I have heard DIY music that sounds terrible both in production and performance, and I do believe that if the artist was more skilled it would have made for a better album). That said I love the Shagg's and that amateur aspect is a big part of the charm (I'd rate it a five as one of its ilk).



I would put:

"Hmmm..."

between 2 and 3.
Amos Goldberg (professor of Genocide Studies at the Hebrew University in Jerusalem): Yes, it's genocide. It's so difficult and painful to admit it, but we can no longer avoid this conclusion.
Back to Top
Logan View Drop Down
Forum & Site Admin Group
Forum & Site Admin Group
Avatar
Site Admin

Joined: April 05 2006
Location: Vancouver, BC
Status: Offline
Points: 35804
Post Options Post Options   Thanks (0) Thanks(0)   Quote Logan Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 10:13
^That would be a good addition. By the way, I wrote this first thing after waking up(excuses, excuses) and see that I messed up with the numbers of performers. Sometimes the brain has not caught up with the typing and vice versa. It should have been:

"We have [four] performers asked to read and play Ligeti's Devil's Staircase (Etude 13) and are asked not to improvise, but to play it accurately. Performer one is Keyboard Cat. The cat's human servant (one does not own the cat, the cat owns you) sprinkles dry cat food across the keyboard cum catwalk. The cat walks back and forth and it sounds nothing like the Ligeti piece. The second performer is an acclaimed concert pianist who plays all the right notes in the right order and at the right time. The third is a three year old beginner (first time trying to play the piano) who lacks the experience to play the piece. The fourth is a very drunk concert pianist who fumbles over the keys and then vomits all over the piano."
Back to Top
Greenmist View Drop Down
Forum Senior Member
Forum Senior Member


Joined: August 10 2020
Location: UK
Status: Offline
Points: 294
Post Options Post Options   Thanks (0) Thanks(0)   Quote Greenmist Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 10:14
Its quite hard to think of objective criteria, as ranking songs and albums is mainly on ones own opinion.

I would say variety is the closest factor i can name to an objective criteria.   I personally think that albums that have more variety on are better albums than ones that just follow the same type of song style.   Like if an album is nothing but soft mellow songs *cough* The Division Bell *cough*.  Or if the songs just sound too similar to each other.
Back to Top
jamesbaldwin View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: September 25 2015
Location: Milano
Status: Offline
Points: 5986
Post Options Post Options   Thanks (0) Thanks(0)   Quote jamesbaldwin Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 11:07
As i tried to explain in another thread I opened,
in my opinion, an artwork must be judged according to aesthetic criteria, that is to say: beatiful or ugly.

Alternatively, it can be judged from the point of view of its historical importance.

If we want to talk about objective criteria, the historical importance could be quite objective as a criterion, but beauty is largely subjective. Otherwise every literary or music or film critic, etc. would assign the same judgment to an artwork.

In that thread, I tried to make a ranking mainly according to beauty of the albums - and in part of the historical importance.

How can the beauty of a music album be determined?

There are some factors in which we can divide a song:
1) Composition (melody and harmony)
2) Ability to the musical instrument
3) Ability to sing
4) Arrangement
5) Experimentation
6) Sound (production)
7) lyrics

Then we must consider 

8) the overall effect, that is, how the sequence of the songs composes a whole that is more pleasant than the beauty of the individual pieces.

It is clear that, however, as Robin Willams explains in Dead Poets Society, any attempt to mathematize the judgment on an artwork is "excrement". A song can be as simple and short as Yesterday and be considered much more beautiful than a 20-minute prog suite with experimental sounds (at least I think so).

What matters, as a result, is the pathos that the music produces in the listener, the emotions, at least for me. If then the pathos is accompanied by a singing with some thick lyrics, the result can become exceptional.

For example, in my opinion, the VdGG's music of the triad The Least / From H / Pawn Hearts has them all, and reaches a dramatic pathos that is amplified by the exceptional singing of Hammill, who sings lyrics of an existential anguish that are difficult to find in the lyrics of the prog bands of that time (and which in my opinion have aged very well).

Often the complexity of the composition and the virtuosic technique on the musical instrument remove pathos from the songs, provoking more intellectual pleasure than real emotion. This difference in approach distinguishes for example "pure" prog listeners from pure "heartland rock" listeners.
Amos Goldberg (professor of Genocide Studies at the Hebrew University in Jerusalem): Yes, it's genocide. It's so difficult and painful to admit it, but we can no longer avoid this conclusion.
Back to Top
Sacro_Porgo View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: July 15 2019
Location: Cygnus
Status: Offline
Points: 2052
Post Options Post Options   Thanks (0) Thanks(0)   Quote Sacro_Porgo Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 11:30
Originally posted by chopper chopper wrote:

Originally posted by Sacro_Porgo Sacro_Porgo wrote:

Originally posted by chopper chopper wrote:

There are some things that could be measured objectively but I don't see how they would affect the rating of an album - number of different chords, number of instruments played etc. Music rating is inherently subjective imo, for every album someone loves there will be someone who hates it. 
There are some albums however that you can't really argue with. Let's take Close To The Edge as an example, there will be people who don't like it but you can't really argue that it is one of the most important and highly regarded prog albums and is therefore deserving of a reasonable rating. Can you? 

See, I disagree. Not with the idea that CTTE is one of the most important and highly regarded prog albums, but of which could be pretty consistently measured with some decent criteria, though they may not be objective per say. I disagree with the idea that that must make it deserving of a reasonable rating. Personally, I love CTTE, and I'd give it 5/5 stars easily. But someone who doesn't enjoy it at all, even recognizing it's towering impact on the genre and popularity among prog fans to this day, may not be compelled to rate it based on any criteria but their own personal enjoyment of it, and if they don't enjoy it, there would be much reason to give it more than 1 star! Rating is subjective, criticism is subjective. The objective qualities about music don't tell us how many stars to give it. The Ramones and The Chainsmokers both tend to write 2-3 minute songs based around 3-4 chords. I love those of the former and detest those of the latter. The numbers involved have little to nothing to do with my opinions on that.
I get your point, it's interesting. The 5 star rating in PA is for "a masterpiece of progressive rock music". Now I would say that there are a number of prog albums generally regarded as "masterpieces" and CTTE is one of them. So if you don't like the album would you really give it 1 or 2 stars which means it's for collectors and completionists only? Could it really be said that CTTE is for completionists only? I would also argue that Relayer is a masterpiece but there is at least one person here who prefers The Quest, so should he give Relayer 1 or 2 stars?

Yeah, that's the problem I kinda have with this site's rating system in general. There are absolutely essential albums that you're going to like less than non-essential ones, and qualifying star ratings in terms of essential-ness rather than goodness makes it confusing to decide how to rate something. If I absolutely love Tormato, to the point I prefer it to many Yes classics, I'd want to give it 5 stars. But if I already know the community at large doesn't agree with this take, and I already know it's not historically a very important album, it makes it seem like giving it 5 stars would be building it up to be something it isn't, even if I love it as much as a more collectively agreed upon 5 star album.

For the record, I don't actually think this about Tormato, though I do think it's quite good.
Porg for short. My love of music doesn't end with prog! Feel free to discuss all sorts of music with me. Odds are I'll give it a chance if I haven't already! :)
Back to Top
Sacro_Porgo View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: July 15 2019
Location: Cygnus
Status: Offline
Points: 2052
Post Options Post Options   Thanks (0) Thanks(0)   Quote Sacro_Porgo Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 11:34
Originally posted by David_D David_D wrote:


thank you very much for all the contributions so far, and not least yours, Sacro Porgo

Thanks. I suppose it's all a matter of opinion anyway. If you believe there are objectively measurable qualities about music which are interesting to put in a review, I doubt that's going to do anyone any harm.
Porg for short. My love of music doesn't end with prog! Feel free to discuss all sorts of music with me. Odds are I'll give it a chance if I haven't already! :)
Back to Top
Lewian View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: August 09 2015
Location: Italy
Status: Offline
Points: 14728
Post Options Post Options   Thanks (0) Thanks(0)   Quote Lewian Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 12:12
@Lorenzo: I suspect the word "pathos" is used slightly differently in English from Italian (and in fact German):
Back to Top
I prophesy disaster View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: December 31 2017
Location: Australia
Status: Offline
Points: 4779
Post Options Post Options   Thanks (0) Thanks(0)   Quote I prophesy disaster Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 12:49
Originally posted by Sacro_Porgo Sacro_Porgo wrote:

I don't think popularity and quality are related more than tangentially. Many things of impeccable quality (pick any set of standards you like to measure that) fall through the cracks.
 
By what criteria are the many things of "impeccable quality" that fall through the cracks being assessed? You say "pick any set of standards you like to measure that", but I've actually picked popularity to measure that. That's the point. I do get that things might not be popular for identifiable reasons other than quality, but in a ratings system such as on PA, one gets to see not only the overall ratings, but also the number of ratings, which provides an indication of the level of exposure.
 
 
Originally posted by Sacro_Porgo Sacro_Porgo wrote:

Meanwhile many things of massive popularity (by whichever measure using whichever group of fans you prefer) could be said by any number of people to be low quality. I'm in a band with someone who's all about efficiency in music, and he would probably scoff at the idea that Animals is one of the best albums of all time., what with those extended length runtimes and long passages of moody atmospherics. He simply has a different barometer. Sure he's not a prog fan, but his opinion isn't invalid, it just might mean less to someone who is a prog fan.
 
I don't get the point you're trying to make here. No one is suggesting that a massively popular album will be liked by everyone, or that an unpopular album will be liked by no one. The point of popularity is that it is a measure over many individuals, and even though each individual assessment is subjective and highly variable, the overall assessment by many individuals is objective and reliable.
 
 
Originally posted by Sacro_Porgo Sacro_Porgo wrote:

Popularity is not an objective measurement of anything other than how many people like something.
 
And that is exactly why popularity is an objective measure of quality. The crucial point is that the only determinant of quality is that people like it. If one person likes it, that is subjective. But if many people like it, then that is objective. As for other objective measures of music such as complexity, these are not measures of quality. And the ones we tend to associate with quality correlate with popularity anyway.
 
 



Edited by I prophesy disaster - March 14 2022 at 12:56
No, I know how to behave in the restaurant now, I don't tear at the meat with my hands. If I've become a man of the world somehow, that's not necessarily to say I'm a worldly man.
Back to Top
moshkito View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: January 04 2007
Location: Grok City
Status: Offline
Points: 17510
Post Options Post Options   Thanks (0) Thanks(0)   Quote moshkito Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 12:55
Originally posted by jamesbaldwin jamesbaldwin wrote:

...
Often the complexity of the composition and the virtuosic technique on the musical instrument remove pathos from the songs, provoking more intellectual pleasure than real emotion. This difference in approach distinguishes for example "pure" prog listeners from pure "heartland rock" listeners.

Hi,

If I had stated that it would have been considered bad, and totally out of order and context.

The idea of some folks listening with a wider/larger intent to all music, not just prog or rock at all, is quite different from the "hardland rock" (intentional spelling!) ... and as I have stated, when you have as much music as I did, and so many different countries and languages, the thought and idea of which of the albums is my "favorite" is completely ridiculous and bizarre ... because my listening is not based on something I like, and the fact I don't listen to anything else. And that's the problem ... I listen to too much "else" and I do so on purpose, because I don't want to be someone putting up charts and polls about ridiculous competitions between this and that ... which supposedly is fun. It isn't for me, because it brings down one of the pieces. I don't choose between Wagner or Verdi, they are both excellent in their own way, although it is easier to hear a Verdi and Puccini, than it is a lot of others ... their melodic styles are quite useful and common in rock music of all kinds, but that alone, is not enough for me, since I know that music has so much more on the score sheet than just 3 instruments doing the same thing.

I once did a "film" version of Tosca (Act 2) for a class by Peter Mark (emeritus from the Virginia Opera), and his comment? I cleaned up all the problems with performing an opera, including not being able to see a lot ... but my favorite part was in the aria, where in the score there is a violin all alone, and it is playing single notes ... plucking them sort of ... and going down a note at a time, during the aria ... and for me the visual was immediate ... the VIOLIN WAS ABOUT HIS TEARS ... and that is what I put in the "film" script ... which had everyone going ... far out ... and it was what I was about when directing ... it wasn't about a "concept" or an "idea" ... it was all about how you can bring out the total beauty and the best from the work ... and to me, that is what "music" is about, but I am not sure that you or anyone else can hear that violin in the background of the aria ... but it is on the score, and I visualized it. 

There is nothing subjective or objective in that ... it is all right there ... and to me ... that is the PURE element of music that we have lost the ability to see and hear, because we are stuck on the lyrics, not necessarily on the content of the music itself ... which in rock music is the worst representative of what an "art form" is or is supposed to be!
Music is not just for listening ... it is for LIVING ... you got to feel it to know what's it about! Not being told!
www.pedrosena.com
Back to Top
nick_h_nz View Drop Down
Collaborator
Collaborator
Avatar
Prog Metal / Heavy Prog Team

Joined: March 01 2013
Location: Suffolk, UK
Status: Offline
Points: 6737
Post Options Post Options   Thanks (0) Thanks(0)   Quote nick_h_nz Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 13:31
Originally posted by I prophesy disaster I prophesy disaster wrote:

Originally posted by Sacro_Porgo Sacro_Porgo wrote:

I don't think popularity and quality are related more than tangentially. Many things of impeccable quality (pick any set of standards you like to measure that) fall through the cracks.
 
By what criteria are the many things of "impeccable quality" that fall through the cracks being assessed? You say "pick any set of standards you like to measure that", but I've actually picked popularity to measure that. That's the point. I do get that things might not be popular for identifiable reasons other than quality, but in a ratings system such as on PA, one gets to see not only the overall ratings, but also the number of ratings, which provides an indication of the level of exposure.
 
 
Originally posted by Sacro_Porgo Sacro_Porgo wrote:

Meanwhile many things of massive popularity (by whichever measure using whichever group of fans you prefer) could be said by any number of people to be low quality. I'm in a band with someone who's all about efficiency in music, and he would probably scoff at the idea that Animals is one of the best albums of all time., what with those extended length runtimes and long passages of moody atmospherics. He simply has a different barometer. Sure he's not a prog fan, but his opinion isn't invalid, it just might mean less to someone who is a prog fan.
 
I don't get the point you're trying to make here. No one is suggesting that a massively popular album will be liked by everyone, or that an unpopular album will be liked by no one. The point of popularity is that it is a measure over many individuals, and even though each individual assessment is subjective and highly variable, the overall assessment by many individuals is objective and reliable.
 
 
Originally posted by Sacro_Porgo Sacro_Porgo wrote:

Popularity is not an objective measurement of anything other than how many people like something.
 
And that is exactly why popularity is an objective measure of quality. The crucial point is that the only determinant of quality is that people like it. If one person likes it, that is subjective. But if many people like it, then that is objective. As for other objective measures of music such as complexity, these are not measures of quality. And the ones we tend to associate with quality correlate with popularity anyway.
 
 


I disagree, as popularity is often based/biased upon a self-perpetuating fractal model. The more something appears highly rated, the more exposure it gets for others to notice it and experience it, and rate it highly themselves. But that in itself is meaningless, and certainly not objective. As Pedro is so fond of saying (albeit not in the most constructive of manners), it misses the point entirely. That’s not to say those hugely popular albums are not the great quality works people find them to be - but rather that people find them because their popularity is a self-perpetuating echo chamber of sorts. There are plenty of albums as great as those that top the list, but they will never be as popular simply because they have too far to catch up with the resounding echoes of popularity. The top 100 in PA realistically is a measure of exposure, rather than quality. Again, that’s not to say the albums in the 100 are not of great quality, but that they are not necessarily greater “objectively” than many more not in the list. The quality of the albums in the 100 is due to correlation, rather than causation, to be awfully simplistic.
(Also, apologies for the numerous spelling and grammatical errors that are no doubt in this post, as I have made it in a somewhat less than sober state…)

Back to Top
David_D View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: October 26 2010
Location: Copenhagen
Status: Offline
Points: 15119
Post Options Post Options   Thanks (0) Thanks(0)   Quote David_D Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 14:14
Originally posted by Logan Logan wrote:

Appreciation is, of course subjective, but if one agrees to or adheres to certain standards or set criteria, then some efforts can be considered objectively more successful then others. ........
...................

I've seen in this thread, and previously as well, that the definition of "objective" commonly used in the music art seems to be another one than the common one used in philosophy (and which I used here).
Can you tell me maybe how "objective" is commonly defined in the music art?
                      quality over quantity, and all kind of PopcoRn almost beyond
Back to Top
nick_h_nz View Drop Down
Collaborator
Collaborator
Avatar
Prog Metal / Heavy Prog Team

Joined: March 01 2013
Location: Suffolk, UK
Status: Offline
Points: 6737
Post Options Post Options   Thanks (0) Thanks(0)   Quote nick_h_nz Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 14:24
Originally posted by David_D David_D wrote:

Originally posted by Logan Logan wrote:

Appreciation is, of course subjective, but if one agrees to or adheres to certain standards or set criteria, then some efforts can be considered objectively more successful then others. ........
...................

I've seen in this thread, and previously as well, that the definition of "objective" commonly used in the music art seems to be another one than the common one used in philosophy (and which I used here).
Can you tell me maybe how "objective" is commonly defined in the music art?

Or rather, tell us how you define it. Objective as commonly defined in this thread is as it is commonly defined everywhere in the world I have lived. Objectivity is a lack of influence by personal feelings or opinions. It is a concept of truth independent of those personal feelings or opinions. This is really not at all different from the idea of objectivity in philosophy (or at least as I remember it from my studies at university all those years ago): Something can be considered to be objective when the conditions surrounding its truth are met without bias caused by an individual.

Not one of the criteria you have suggested as being objective is possible to rate objectively. The closest, as several people have said, is production - but the other criteria you suggested can never be anything other than subjective. It doesn’t appear to be us who have the problem with the definition of objectivity, but you. 🤷🏻‍♂️

Back to Top
I prophesy disaster View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: December 31 2017
Location: Australia
Status: Offline
Points: 4779
Post Options Post Options   Thanks (0) Thanks(0)   Quote I prophesy disaster Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 14:32
Originally posted by nick_h_nz nick_h_nz wrote:

There are plenty of albums as great as those that top the list
 
But how do you know that? What criteria are you using to assess these other albums as great? If it's just your opinion, then one can dismiss it as just your opinion. Otherwise, why do you think the criteria you are using is an assessment of greatness? Or are you somehow using popularity anyway?
 
Even if the ratings system is flawed, it is still a measure of quality even if it is somewhat inaccurate. This topic is about objectivity not accuracy. Thus, we are talking about measures of quality in principle, even if they are found wanting in practice.
 

No, I know how to behave in the restaurant now, I don't tear at the meat with my hands. If I've become a man of the world somehow, that's not necessarily to say I'm a worldly man.
Back to Top
nick_h_nz View Drop Down
Collaborator
Collaborator
Avatar
Prog Metal / Heavy Prog Team

Joined: March 01 2013
Location: Suffolk, UK
Status: Offline
Points: 6737
Post Options Post Options   Thanks (0) Thanks(0)   Quote nick_h_nz Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 14:53
Originally posted by I prophesy disaster I prophesy disaster wrote:

Originally posted by nick_h_nz nick_h_nz wrote:

There are plenty of albums as great as those that top the list
 
But how do you know that? What criteria are you using to assess these other albums as great? If it's just your opinion, then one can dismiss it as just your opinion. Otherwise, why do you think the criteria you are using is an assessment of greatness? Or are you somehow using popularity anyway?
 
Even if the ratings system is flawed, it is still a measure of quality even if it is somewhat inaccurate. This topic is about objectivity not accuracy. Thus, we are talking about measures of quality in principle, even if they are found wanting in practice.


The top 100 is effectively based upon a frequentist conception of evidence, which attempts to avoid explicitly subjective elements, but like most frequentist conceptions of evidence does so at the price of a misleading impression of objectivity.


Humour me here, and imagine PA is a scientific study.  The PA ratings are our p values, so let’s say we classify 1 and 2 star ratings as non-significant, 3 and 4 stars as significant and 5 star ratings as highly significant. Not only are these labels obviously arbitrary, they also promote publication bias. The highly significant albums get thrown to the top of the PA 100 list, because they continue to be seen, and newly discovered, and rated again and again as highly significant. Why? Because researchers tend to “hunt for significance” when they come to PA. That doesn’t mean that the albums are not highly significant, but it would be ignorant to assume that they are the only highly significant results, just because they were the ones found in the study.  That’s the inherent problem with any frequentist conception of evidence. That’s why in science there is rarely only one study. Because one study may easily miss something highly significant, or give the appearance that something is more significant than it actually is. (Which is not to say it’s not significant, so much as there could be other data out there equally significant, but as yet undiscovered or untested.)


Popularity has never been, and never can be, a measure of objectivity. It can only ever give the illusion of objectivity.




Edited by nick_h_nz - March 14 2022 at 14:54
Back to Top
Lewian View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: August 09 2015
Location: Italy
Status: Offline
Points: 14728
Post Options Post Options   Thanks (0) Thanks(0)   Quote Lewian Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 16:21
Sorry Nick, I usually appreciate your postings a lot, but...
Originally posted by nick_h_nz nick_h_nz wrote:

The top 100 is effectively based upon a frequentist conception of evidence, which attempts to avoid explicitly subjective elements, but like most frequentist conceptions of evidence does so at the price of a misleading impression of objectivity.


I don't think it conveys any impression of objectivity and as such cannot be misleading.


Otherwise, I know a thing or two about frequentism and p-values, and your comparison makes no sense whatsoever. (For starters, a proper frequentist will know that hunting for significance is abuse and does not work according to proper frequentist logic. I leave it at that because this is not the place for that discussion.) 

Back to Top
Hugh Manatee View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: December 07 2021
Location: The Barricades
Status: Offline
Points: 1587
Post Options Post Options   Thanks (0) Thanks(0)   Quote Hugh Manatee Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 16:38
Originally posted by nick_h_nz nick_h_nz wrote:

Popularity has never been, and never can be, a measure of objectivity. 


As I so clumsily tried to explain previously, the dollar value given to this popularity can be objectively measured on a balance sheet.
I should have been a pair of ragged claws
Scuttling across the floors of uncertain seas
Back to Top
I prophesy disaster View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: December 31 2017
Location: Australia
Status: Offline
Points: 4779
Post Options Post Options   Thanks (0) Thanks(0)   Quote I prophesy disaster Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 16:43
Originally posted by nick_h_nz nick_h_nz wrote:

The top 100 is effectively based upon a frequentist conception of evidence, which attempts to avoid explicitly subjective elements, but like most frequentist conceptions of evidence does so at the price of a misleading impression of objectivity.


Humour me here, and imagine PA is a scientific study.  The PA ratings are our p values, so let’s say we classify 1 and 2 star ratings as non-significant, 3 and 4 stars as significant and 5 star ratings as highly significant. Not only are these labels obviously arbitrary, they also promote publication bias. The highly significant albums get thrown to the top of the PA 100 list, because they continue to be seen, and newly discovered, and rated again and again as highly significant. Why? Because researchers tend to “hunt for significance” when they come to PA. That doesn’t mean that the albums are not highly significant, but it would be ignorant to assume that they are the only highly significant results, just because they were the ones found in the study.  That’s the inherent problem with any frequentist conception of evidence. That’s why in science there is rarely only one study. Because one study may easily miss something highly significant, or give the appearance that something is more significant than it actually is. (Which is not to say it’s not significant, so much as there could be other data out there equally significant, but as yet undiscovered or untested.)


Popularity has never been, and never can be, a measure of objectivity. It can only ever give the illusion of objectivity.

 

I think you're missing the point of what I'm saying. It seems to me that all you're saying is that popularity is difficult to measure. That is a practical problem which could be alleviated by a redesign. What I'm saying is that the objective quality of music is determined by the proportion of a particular fanbase who like the music. It specifically rejects the notion that the quality of music is determined by some aspect of the music other than its ability to evoke people to like it. It is also saying that the proportion of a particular fanbase who like the music is an objective notion even though the liking of the music by any individual is itself subjective.

 


No, I know how to behave in the restaurant now, I don't tear at the meat with my hands. If I've become a man of the world somehow, that's not necessarily to say I'm a worldly man.
Back to Top
Sacro_Porgo View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: July 15 2019
Location: Cygnus
Status: Offline
Points: 2052
Post Options Post Options   Thanks (0) Thanks(0)   Quote Sacro_Porgo Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 16:55
Originally posted by I prophesy disaster I prophesy disaster wrote:

Originally posted by Sacro_Porgo Sacro_Porgo wrote:

I don't think popularity and quality are related more than tangentially. Many things of impeccable quality (pick any set of standards you like to measure that) fall through the cracks.
 
By what criteria are the many things of "impeccable quality" that fall through the cracks being assessed? You say "pick any set of standards you like to measure that", but I've actually picked popularity to measure that. That's the point. I do get that things might not be popular for identifiable reasons other than quality, but in a ratings system such as on PA, one gets to see not only the overall ratings, but also the number of ratings, which provides an indication of the level of exposure.
 
 
Originally posted by Sacro_Porgo Sacro_Porgo wrote:

Meanwhile many things of massive popularity (by whichever measure using whichever group of fans you prefer) could be said by any number of people to be low quality. I'm in a band with someone who's all about efficiency in music, and he would probably scoff at the idea that Animals is one of the best albums of all time., what with those extended length runtimes and long passages of moody atmospherics. He simply has a different barometer. Sure he's not a prog fan, but his opinion isn't invalid, it just might mean less to someone who is a prog fan.
 
I don't get the point you're trying to make here. No one is suggesting that a massively popular album will be liked by everyone, or that an unpopular album will be liked by no one. The point of popularity is that it is a measure over many individuals, and even though each individual assessment is subjective and highly variable, the overall assessment by many individuals is objective and reliable.
 
 
Originally posted by Sacro_Porgo Sacro_Porgo wrote:

Popularity is not an objective measurement of anything other than how many people like something.
 
And that is exactly why popularity is an objective measure of quality. The crucial point is that the only determinant of quality is that people like it. If one person likes it, that is subjective. But if many people like it, then that is objective. As for other objective measures of music such as complexity, these are not measures of quality. And the ones we tend to associate with quality correlate with popularity anyway.
 
 




I’ll concede a little on your first point. Using popularity as your criteria for measuring quality necessarily nullifies my argument there. Do if that’s how you personally judge how good something is, then have fun. On the other hand, if it’s at all possible to prefer something less popular to something more popular, it’s entirely reasonable to believe that popularity does not determine what you believe the quality of something to be. And if it’s reasonable to believe something less popular is of greater quality than something more popular, it would seem no longer possible to assert that popularity is an objective measure of quality. It signifies how many people share the same subjective opinion of something’s quality, but even a great sun of subjective opinions do not suddenly become objective because most people agree on them. Otherwise you could argue that God must be real only because a majority of people believe He is, totally ignoring any other evidence to support or negate that conclusion. Popularity doesn’t prove any objective fact other than the number of people who like something.
Porg for short. My love of music doesn't end with prog! Feel free to discuss all sorts of music with me. Odds are I'll give it a chance if I haven't already! :)
Back to Top
jamesbaldwin View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: September 25 2015
Location: Milano
Status: Offline
Points: 5986
Post Options Post Options   Thanks (0) Thanks(0)   Quote jamesbaldwin Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 18:05
With Pathos I mean:

1. Technical term of Greek rhetoric (of peripatetic origin) which indicates the ensemble of passion, excitement, greatness typical of tragedy. 2. In modern use, the ability that a artwork, even musical or figurative (or an expression, a moment of the work), has to arouse, with the power contained in it, intense affective emotion and emotion aesthetics (see drama, of which it is often synon.). By extension, impetus, warmth, emotional intensity: a peroration full of pathos.

(From Treccani Encyclopedia)

Thanks to Lewian


Edited by jamesbaldwin - March 14 2022 at 18:08
Amos Goldberg (professor of Genocide Studies at the Hebrew University in Jerusalem): Yes, it's genocide. It's so difficult and painful to admit it, but we can no longer avoid this conclusion.
Back to Top
BrufordFreak View Drop Down
Collaborator
Collaborator
Avatar
Honorary Collaborator

Joined: January 25 2008
Location: Wisconsin
Status: Offline
Points: 8191
Post Options Post Options   Thanks (0) Thanks(0)   Quote BrufordFreak Quote  Post ReplyReply Direct Link To This Post Posted: March 14 2022 at 19:27
As much as I've pondered this question--and even experimented with metric breakdowns of numerous categories, I've come to the conclusion that objectivity is impossible: the subject is always skewed (and mired) by her or his own biases. Even the choice of which albums to select for rating comes down to subjective choices--some of which are beyond our control.

The best I've been able to accomplish is understanding that there is a difference between "best" and "favorite". 
Drew Fisher
https://progisaliveandwell.blogspot.com/
Back to Top
 Post Reply Post Reply Page  <1 23456 15>

Forum Jump Forum Permissions View Drop Down



This page was generated in 0.172 seconds.
Donate monthly and keep PA fast-loading and ad-free forever.