Forum Home Forum Home > Site News, Newbies, Help and Improvements > Report bugs here
  New Posts New Posts RSS Feed - Ratings calculation
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

Topic ClosedRatings calculation
 Post Reply Post Reply Page  <123>
Author
Message Reverse Sort Order
  Topic Search Topic Search  Topic Options Topic Options
Rivertree View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator / Band Submissions

Joined: March 22 2006
Location: Germany
Status: Offline
Points: 17628 		Direct Link To This Post Posted: July 11 2007 at 16:55
Originally posted by Easy Livin Easy Livin wrote:

There has been a fundamental change to the algorithm used. See the thread in the Prog Music lounge.


I can't find any thread in the Prog Music Lounge dealing with this problem Confused


Back to Top
avestin View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: September 18 2005
Status: Offline
Points: 12625 		Direct Link To This Post Posted: July 11 2007 at 16:36
Originally posted by Easy Livin Easy Livin wrote:

There has been a fundamental change to the algorithm used. See the thread in the Prog Music lounge.
 
 
Bob, does this change apply to albums that have not been rated as well?
 
No ratings done by anyone it says and yet there's an average rating for this album.
 
Hanging Sounds

PA Index of prog music vendors


Back to Top
Easy Livin View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator / Retired Admin

Joined: February 21 2004
Location: Scotland
Status: Offline
Points: 15585 		Direct Link To This Post Posted: July 11 2007 at 16:15
There has been a fundamental change to the algorithm used. See the thread in the Prog Music lounge.
Back to Top
Mandrakeroot View Drop Down
Forum Senior Member
Forum Senior Member

Italian Prog Specialist

Joined: March 01 2006
Location: San Foca, Friûl
Status: Offline
Points: 5851 		Direct Link To This Post Posted: July 11 2007 at 16:09
Unfortunately change my manner of to appraise the album!!!  
Back to Top
Mandrakeroot View Drop Down
Forum Senior Member
Forum Senior Member

Italian Prog Specialist

Joined: March 01 2006
Location: San Foca, Friûl
Status: Offline
Points: 5851 		Direct Link To This Post Posted: July 11 2007 at 16:07
Originally posted by Andrea Cortese Andrea Cortese wrote:

Originally posted by Rivertree Rivertree wrote:

WOW! It looks like the PA server has its own ratings for the music.
So this must be a breakthrough with the development of ARTIFICIAL INTELLIGENCE.

Clap  Congratulations!  Clap

It would be interesting to know who is feeding the server with the songs?

BTW - The calculation is raising the results (dynamically??) - yesterday 3.45 - today 3.82




 
LOLLOL
 
Prog reviewers has been fired!!!
 
The site does not need them anymore!


Hey... "2001 Space Odissey" computer is here!!! That sense has give evaluations to the album if then...  Already if then a 4 becomes a 2,98 (I wrote a number at random)!!!  Then I give to all 1 star and we end it here!!!
Back to Top
Rivertree View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator / Band Submissions

Joined: March 22 2006
Location: Germany
Status: Offline
Points: 17628 		Direct Link To This Post Posted: July 11 2007 at 15:33
Originally posted by Easy Livin Easy Livin wrote:

I think, and I'm speaking from shaky ground hereEmbarrassed, that the rating shown should not be seen as a straight average of the ratings posted.
 
It is a figure calculated by taking the rating or ratings of the album, running them through an algorithm which takes other factors into account, an coming up with a result. This result allows the album to find its relative position among all the others.
 
I know it looks strange that the figure shown for one album is not the same as the only rating for that album, but it reflects all the other constituent parts of the algorithm too.


I'm quite sure the calculation was OK in the past.
So there must have been changes during the last days which have forced this dilemma.
Maybe there is a chance to revert to a former state ...




Edited by Rivertree - July 11 2007 at 15:33


Back to Top
Rivertree View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator / Band Submissions

Joined: March 22 2006
Location: Germany
Status: Offline
Points: 17628 		Direct Link To This Post Posted: July 11 2007 at 15:05
Originally posted by Rocktopus Rocktopus wrote:

Originally posted by avestin avestin wrote:

Here's even a better example:
 
3.54
(Warning: only 0 ratings)

 
So, now the PA server has come to life and has started giving ratings of its own but for some reason doesn't count itself as part of the number of ratings...
 
 
Seriously though, there's a systemic (chaos) problem here...
 
 


The server has changed its mind. Now up to:  3.86
(Warning: only 0 ratings)


(I'd give it a four myself. Great album)


CASSIBER "Beauty and the Beast" ratings distribution

3.50 / 5
(0 ratings)
Essential: a masterpiece of progressive music (0%)
0%
Excellent addition to any prog music collection (0%)
0%
Good, but non-essential (0%)
0%
Collectors/fans only (0%)
0%
Poor. Only for completionists (0%)
0%


now actually we have a surprising 3.5 calculation for CASSIBER ...


Back to Top
Ivan_Melgar_M View Drop Down
Special Collaborator
Special Collaborator

Honorary Collaborator

Joined: April 27 2004
Location: Peru
Status: Offline
Points: 19535 		Direct Link To This Post Posted: July 11 2007 at 14:17

HT wrote:

Quote there is something wrong with the rating system. It's obvious when you look at some albums with only one rating. For example, I am the only one to rate Amos Key, and I gave it four stars. However, the rating is 3.55.

 

I believe it’s a common problem when you add too many variables to an algorithm, we had that same problem once in the office, one of the equations was giving flawed results.

 

For example, if an extra factor is added to albums that have many reviews like + 14%, the system will automatically subtract the same percentage from albums that have a very short number of reviews to keep the equivalence.

 

Take for instance X being the rating for Close to the Edge

 

X = 4

14% the bonus for albums with more than 20 reviews

The result will be 4.56

 

In this case being that there are too many reviews, we would never notice the difference, much less if there are other factors like giving more weight to Collaborators reviews that make it hard to discover.

 

But the computer will automatically subtract that same percentage from albums that have very few reviews. like

 

Y being a review of  Amos Key The first Key.

 

Y = 4

-14% will be subtracted  from the review being that this album has less than 20 reviews.

The new result will be: 3.44

 

If you add other distorting but necessary factors like less weight for ratings without reviews and extra value for Collaborators reviews, you may get a  different final result in the average of only one review.

 

Sounds illogical, but it’s absolutely normal, maybe adding a new variable that will exclude any case in which the reviews are less than two (<2)....Would make it easier to accept.

 

Iván



Edited by Ivan_Melgar_M - July 11 2007 at 14:20
            
Back to Top
bhikkhu View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 06 2006
Location: A² Michigan
Status: Offline
Points: 5109 		Direct Link To This Post Posted: July 11 2007 at 13:44
Originally posted by Easy Livin Easy Livin wrote:



I think, and I'm speaking from shaky ground hereEmbarrassed, that the rating shown should not be seen as a straight average of the ratings posted.
 

It is a figure calculated by taking the rating or ratings of the album, running them through an algorithm which takes other factors into account, an coming up with a result. This result allows the album to find its relative position among all the others.

 

I know it looks strange that the figure shown for one album is not the same as the only rating for that album, but it reflects all the other constituent parts of the algorithm too.


Well then, that means that people have to start reviewing these lonely albums. Let's start a collaborator drive to get some solid ratings for our underprivileged obscurities. You know, something along the lines of, "For just a few few minutes a day, you could get little "Spark of Light" here the attention it deserves." Who's with me?

a.k.a. H.T.

http://riekels.wordpress.com
Back to Top
Andrea Cortese View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: September 05 2005
Status: Offline
Points: 4411 		Direct Link To This Post Posted: July 11 2007 at 13:40
I've seen that many albums of the ISP genre has been (mysteriously) downrated. Hybla Act 1 by Randone, for example, which was 4,30, now is languishing below the excellence status...
 
 
No, the rating is evolving...now at 4,03!Confused
 
 
 

RANDONE "Hybla Act 1" ratings distribution

4.03 / 5
(11 ratings)
Essential: a masterpiece of progressive music (73%)
73%
Excellent addition to any prog music collection (9%)
9%
Good, but non-essential (9%)
9%
Collectors/fans only (9%)
9%
Poor. Only for completionists (0%)


Edited by Andrea Cortese - July 11 2007 at 13:42
Back to Top
Andrea Cortese View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: September 05 2005
Status: Offline
Points: 4411 		Direct Link To This Post Posted: July 11 2007 at 13:34
Originally posted by Rivertree Rivertree wrote:

WOW! It looks like the PA server has its own ratings for the music.
So this must be a breakthrough with the development of ARTIFICIAL INTELLIGENCE.

Clap  Congratulations!  Clap

It would be interesting to know who is feeding the server with the songs?

BTW - The calculation is raising the results (dynamically??) - yesterday 3.45 - today 3.82




 
LOLLOL
 
Prog reviewers has been fired!!!
 
The site does not need them anymore!
Back to Top
Easy Livin View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator / Retired Admin

Joined: February 21 2004
Location: Scotland
Status: Offline
Points: 15585 		Direct Link To This Post Posted: July 11 2007 at 13:34
I think, and I'm speaking from shaky ground hereEmbarrassed, that the rating shown should not be seen as a straight average of the ratings posted.
 
It is a figure calculated by taking the rating or ratings of the album, running them through an algorithm which takes other factors into account, an coming up with a result. This result allows the album to find its relative position among all the others.
 
I know it looks strange that the figure shown for one album is not the same as the only rating for that album, but it reflects all the other constituent parts of the algorithm too.
Back to Top
Mandrakeroot View Drop Down
Forum Senior Member
Forum Senior Member

Italian Prog Specialist

Joined: March 01 2006
Location: San Foca, Friûl
Status: Offline
Points: 5851 		Direct Link To This Post Posted: July 11 2007 at 13:26
I saw that all of the album with 1 rating have this problem: 

(example)

3,44/ 5
(1 rating)

But this isn't possible. In fact If I appraised the album with 4 stars the middle vow wouldn't have to be 4/5? 
Back to Top
bhikkhu View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 06 2006
Location: A² Michigan
Status: Offline
Points: 5109 		Direct Link To This Post Posted: July 11 2007 at 13:02
there is something wrong with the rating system. It's obvious when you look at some albums with only one rating. For example, I am the only one to rate Amos Key, and I gave it four stars. However, the rating is 3.55.
a.k.a. H.T.

http://riekels.wordpress.com
Back to Top
Easy Livin View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator / Retired Admin

Joined: February 21 2004
Location: Scotland
Status: Offline
Points: 15585 		Direct Link To This Post Posted: July 11 2007 at 12:58

Could you say that again Mandie, I'm afraid I can't understand it.  Sorry.
Back to Top
Mandrakeroot View Drop Down
Forum Senior Member
Forum Senior Member

Italian Prog Specialist

Joined: March 01 2006
Location: San Foca, Friûl
Status: Offline
Points: 5851 		Direct Link To This Post Posted: July 11 2007 at 12:50
Originally posted by M@X

Originally posted by Mandrakeroot

M@X now you should concentrate yourself on the ratings of the individual album because how written in other thread there are weird cases (album with 1 rating and decimals [for example 3,45/1])


I may have fix this already ...

Wich album ?
----------------------------------------------------

How already written from other, the album are much.  They would have been lost it lose days to list the all.  I am noting that they are all those with 1 rating.  For the other I would not know to say. 
Back to Top
bhikkhu View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 06 2006
Location: A² Michigan
Status: Offline
Points: 5109 		Direct Link To This Post Posted: July 11 2007 at 12:17
There is still something going on. My lone 4-star review of Amos Key, "First Key," is calculated at 3.55.

http://www.progarchives.com/album.asp?id=10590
a.k.a. H.T.

http://riekels.wordpress.com
Back to Top
Chris H View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: October 08 2006
Location: Charlotte, NC
Status: Offline
Points: 8191 		Direct Link To This Post Posted: July 11 2007 at 11:14

THE BLACK NOODLE PROJECT "And Life Goes On" ratings distribution

3.68 / 5
(2 ratings)
Essential: a masterpiece of progressive music (50%)
50%
Excellent addition to any prog music collection (50%)
50%
Good, but non-essential (0%)
0%
Collectors/fans only (0%)
0%
Poor. Only for completionists (0%)
0%
 
 
 
 
Two collabs rated it 4 and 5 stars...
Back to Top
M@X View Drop Down
Forum & Site Admin Group
Forum & Site Admin Group
Avatar
Co-founder, Admin & Webmaster

Joined: January 29 2004
Location: Canada
Status: Offline
Points: 4028 		Direct Link To This Post Posted: July 11 2007 at 11:11
Fixed
Prog On !
Back to Top
M@X View Drop Down
Forum & Site Admin Group
Forum & Site Admin Group
Avatar
Co-founder, Admin & Webmaster

Joined: January 29 2004
Location: Canada
Status: Offline
Points: 4028 		Direct Link To This Post Posted: July 11 2007 at 09:40
Ok -- ill check it out 
Prog On !
Back to Top
 Post Reply Post Reply Page  <123>

Forum Jump Forum Permissions View Drop Down



This page was generated in 0.164 seconds.
Donate monthly and keep PA fast-loading and ad-free forever.