Forum Home Forum Home > Site News, Newbies, Help and Improvements > Report bugs here
  New Posts New Posts RSS Feed - Ratings calculation
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

Topic ClosedRatings calculation
 Post Reply Post Reply Page  123>
Author
Message
  Topic Search Topic Search  Topic Options Topic Options
Rivertree View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator / Band Submissions

Joined: March 22 2006
Location: Germany
Status: Offline
Points: 17628 		Direct Link To This Post Topic: Ratings calculation
    Posted: July 10 2007 at 09:44
Question

I'm wondering about the calculation result with only one rating.
Here's an example where I wrote a review with 3 stars

Forest

The calculated result is 3.45
Is it a problem of the algorithm? I might remember that we have a different weighting for collabs and non collabs? Whats's wrong here?


Back to Top
avestin View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: September 18 2005
Status: Offline
Points: 12625 		Direct Link To This Post Posted: July 10 2007 at 20:31
Here's even a better example:
 
3.54
(Warning: only 0 ratings)

 
So, now the PA server has come to life and has started giving ratings of its own but for some reason doesn't count itself as part of the number of ratings...
 
 
Seriously though, there's a systemic (chaos) problem here...
 
 
Hanging Sounds

PA Index of prog music vendors


Back to Top
Rivertree View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator / Band Submissions

Joined: March 22 2006
Location: Germany
Status: Offline
Points: 17628 		Direct Link To This Post Posted: July 11 2007 at 04:36
WOW! It looks like the PA server has its own ratings for the music.
So this must be a breakthrough with the development of ARTIFICIAL INTELLIGENCE.

Clap  Congratulations!  Clap

It would be interesting to know who is feeding the server with the songs?

BTW - The calculation is raising the results (dynamically??) - yesterday 3.45 - today 3.82






Edited by Rivertree - July 11 2007 at 04:52


Back to Top
Rocktopus View Drop Down
Forum Senior Member
Forum Senior Member
Avatar

Joined: March 02 2006
Location: Norway
Status: Offline
Points: 4202 		Direct Link To This Post Posted: July 11 2007 at 04:41
Originally posted by avestin avestin wrote:

Here's even a better example:
 
3.54
(Warning: only 0 ratings)

 
So, now the PA server has come to life and has started giving ratings of its own but for some reason doesn't count itself as part of the number of ratings...
 
 
Seriously though, there's a systemic (chaos) problem here...
 
 


The server has changed its mind. Now up to:  3.86
(Warning: only 0 ratings)


(I'd give it a four myself. Great album)
Over land and under ashes
In the sunlight, see - it flashes
Find a fly and eat his eye
But don't believe in me
Don't believe in me
Don't believe in me
Back to Top
Mandrakeroot View Drop Down
Forum Senior Member
Forum Senior Member

Italian Prog Specialist

Joined: March 01 2006
Location: San Foca, Friûl
Status: Offline
Points: 5851 		Direct Link To This Post Posted: July 11 2007 at 08:51

FRANCO MUSSIDA "Racconti Della Tenda Rossa" ratings distribution

3.55 / 5
(1 ratings)
Essential: a masterpiece of progressive music (0%)
0%
Excellent addition to any prog music collection (100%)
100%
Good, but non-essential (0%)
0%
Collectors/fans only (0%)
0%
Poor. Only for completionists (0%)
0%

Strange case because the only review is the mine review that have 4.00 and not 3,55 valutation!!!
Back to Top
Mandrakeroot View Drop Down
Forum Senior Member
Forum Senior Member

Italian Prog Specialist

Joined: March 01 2006
Location: San Foca, Friûl
Status: Offline
Points: 5851 		Direct Link To This Post Posted: July 11 2007 at 09:19

APHRODITE'S CHILD

The Art Of Démis Roussos And Aphrodite's Child

(Boxset/Compilation, 1993)
3.45 / 5
(1 ratings)

Another case of false rating!!! Because with one rating is impossible 3.45. Also because my rating is 3!!!

Edited by Mandrakeroot - July 11 2007 at 09:21
Back to Top
M@X View Drop Down
Forum & Site Admin Group
Forum & Site Admin Group
Avatar
Co-founder, Admin & Webmaster

Joined: January 29 2004
Location: Canada
Status: Offline
Points: 4028 		Direct Link To This Post Posted: July 11 2007 at 09:40
Ok -- ill check it out 
Prog On !
Back to Top
M@X View Drop Down
Forum & Site Admin Group
Forum & Site Admin Group
Avatar
Co-founder, Admin & Webmaster

Joined: January 29 2004
Location: Canada
Status: Offline
Points: 4028 		Direct Link To This Post Posted: July 11 2007 at 11:11
Fixed
Prog On !
Back to Top
Chris H View Drop Down
Prog Reviewer
Prog Reviewer
Avatar

Joined: October 08 2006
Location: Charlotte, NC
Status: Offline
Points: 8191 		Direct Link To This Post Posted: July 11 2007 at 11:14

THE BLACK NOODLE PROJECT "And Life Goes On" ratings distribution

3.68 / 5
(2 ratings)
Essential: a masterpiece of progressive music (50%)
50%
Excellent addition to any prog music collection (50%)
50%
Good, but non-essential (0%)
0%
Collectors/fans only (0%)
0%
Poor. Only for completionists (0%)
0%
 
 
 
 
Two collabs rated it 4 and 5 stars...
Back to Top
bhikkhu View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 06 2006
Location: A² Michigan
Status: Offline
Points: 5109 		Direct Link To This Post Posted: July 11 2007 at 12:17
There is still something going on. My lone 4-star review of Amos Key, "First Key," is calculated at 3.55.

http://www.progarchives.com/album.asp?id=10590
a.k.a. H.T.

http://riekels.wordpress.com
Back to Top
Mandrakeroot View Drop Down
Forum Senior Member
Forum Senior Member

Italian Prog Specialist

Joined: March 01 2006
Location: San Foca, Friûl
Status: Offline
Points: 5851 		Direct Link To This Post Posted: July 11 2007 at 12:50
Originally posted by M@X

Originally posted by Mandrakeroot

M@X now you should concentrate yourself on the ratings of the individual album because how written in other thread there are weird cases (album with 1 rating and decimals [for example 3,45/1])


I may have fix this already ...

Wich album ?
----------------------------------------------------

How already written from other, the album are much.  They would have been lost it lose days to list the all.  I am noting that they are all those with 1 rating.  For the other I would not know to say. 
Back to Top
Easy Livin View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator / Retired Admin

Joined: February 21 2004
Location: Scotland
Status: Offline
Points: 15585 		Direct Link To This Post Posted: July 11 2007 at 12:58

Could you say that again Mandie, I'm afraid I can't understand it.  Sorry.
Back to Top
bhikkhu View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 06 2006
Location: A² Michigan
Status: Offline
Points: 5109 		Direct Link To This Post Posted: July 11 2007 at 13:02
there is something wrong with the rating system. It's obvious when you look at some albums with only one rating. For example, I am the only one to rate Amos Key, and I gave it four stars. However, the rating is 3.55.
a.k.a. H.T.

http://riekels.wordpress.com
Back to Top
Mandrakeroot View Drop Down
Forum Senior Member
Forum Senior Member

Italian Prog Specialist

Joined: March 01 2006
Location: San Foca, Friûl
Status: Offline
Points: 5851 		Direct Link To This Post Posted: July 11 2007 at 13:26
I saw that all of the album with 1 rating have this problem: 

(example)

3,44/ 5
(1 rating)

But this isn't possible. In fact If I appraised the album with 4 stars the middle vow wouldn't have to be 4/5? 
Back to Top
Easy Livin View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator / Retired Admin

Joined: February 21 2004
Location: Scotland
Status: Offline
Points: 15585 		Direct Link To This Post Posted: July 11 2007 at 13:34
I think, and I'm speaking from shaky ground hereEmbarrassed, that the rating shown should not be seen as a straight average of the ratings posted.
 
It is a figure calculated by taking the rating or ratings of the album, running them through an algorithm which takes other factors into account, an coming up with a result. This result allows the album to find its relative position among all the others.
 
I know it looks strange that the figure shown for one album is not the same as the only rating for that album, but it reflects all the other constituent parts of the algorithm too.
Back to Top
Andrea Cortese View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: September 05 2005
Status: Offline
Points: 4411 		Direct Link To This Post Posted: July 11 2007 at 13:34
Originally posted by Rivertree Rivertree wrote:

WOW! It looks like the PA server has its own ratings for the music.
So this must be a breakthrough with the development of ARTIFICIAL INTELLIGENCE.

Clap  Congratulations!  Clap

It would be interesting to know who is feeding the server with the songs?

BTW - The calculation is raising the results (dynamically??) - yesterday 3.45 - today 3.82




 
LOLLOL
 
Prog reviewers has been fired!!!
 
The site does not need them anymore!
Back to Top
Andrea Cortese View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: September 05 2005
Status: Offline
Points: 4411 		Direct Link To This Post Posted: July 11 2007 at 13:40
I've seen that many albums of the ISP genre has been (mysteriously) downrated. Hybla Act 1 by Randone, for example, which was 4,30, now is languishing below the excellence status...
 
 
No, the rating is evolving...now at 4,03!Confused
 
 
 

RANDONE "Hybla Act 1" ratings distribution

4.03 / 5
(11 ratings)
Essential: a masterpiece of progressive music (73%)
73%
Excellent addition to any prog music collection (9%)
9%
Good, but non-essential (9%)
9%
Collectors/fans only (9%)
9%
Poor. Only for completionists (0%)


Edited by Andrea Cortese - July 11 2007 at 13:42
Back to Top
bhikkhu View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator

Joined: April 06 2006
Location: A² Michigan
Status: Offline
Points: 5109 		Direct Link To This Post Posted: July 11 2007 at 13:44
Originally posted by Easy Livin Easy Livin wrote:



I think, and I'm speaking from shaky ground hereEmbarrassed, that the rating shown should not be seen as a straight average of the ratings posted.
 

It is a figure calculated by taking the rating or ratings of the album, running them through an algorithm which takes other factors into account, an coming up with a result. This result allows the album to find its relative position among all the others.

 

I know it looks strange that the figure shown for one album is not the same as the only rating for that album, but it reflects all the other constituent parts of the algorithm too.


Well then, that means that people have to start reviewing these lonely albums. Let's start a collaborator drive to get some solid ratings for our underprivileged obscurities. You know, something along the lines of, "For just a few few minutes a day, you could get little "Spark of Light" here the attention it deserves." Who's with me?

a.k.a. H.T.

http://riekels.wordpress.com
Back to Top
Ivan_Melgar_M View Drop Down
Special Collaborator
Special Collaborator

Honorary Collaborator

Joined: April 27 2004
Location: Peru
Status: Offline
Points: 19535 		Direct Link To This Post Posted: July 11 2007 at 14:17

HT wrote:

Quote there is something wrong with the rating system. It's obvious when you look at some albums with only one rating. For example, I am the only one to rate Amos Key, and I gave it four stars. However, the rating is 3.55.

 

I believe it’s a common problem when you add too many variables to an algorithm, we had that same problem once in the office, one of the equations was giving flawed results.

 

For example, if an extra factor is added to albums that have many reviews like + 14%, the system will automatically subtract the same percentage from albums that have a very short number of reviews to keep the equivalence.

 

Take for instance X being the rating for Close to the Edge

 

X = 4

14% the bonus for albums with more than 20 reviews

The result will be 4.56

 

In this case being that there are too many reviews, we would never notice the difference, much less if there are other factors like giving more weight to Collaborators reviews that make it hard to discover.

 

But the computer will automatically subtract that same percentage from albums that have very few reviews. like

 

Y being a review of  Amos Key The first Key.

 

Y = 4

-14% will be subtracted  from the review being that this album has less than 20 reviews.

The new result will be: 3.44

 

If you add other distorting but necessary factors like less weight for ratings without reviews and extra value for Collaborators reviews, you may get a  different final result in the average of only one review.

 

Sounds illogical, but it’s absolutely normal, maybe adding a new variable that will exclude any case in which the reviews are less than two (<2)....Would make it easier to accept.

 

Iván



Edited by Ivan_Melgar_M - July 11 2007 at 14:20
            
Back to Top
Rivertree View Drop Down
Special Collaborator
Special Collaborator
Avatar
Honorary Collaborator / Band Submissions

Joined: March 22 2006
Location: Germany
Status: Offline
Points: 17628 		Direct Link To This Post Posted: July 11 2007 at 15:05
Originally posted by Rocktopus Rocktopus wrote:

Originally posted by avestin avestin wrote:

Here's even a better example:
 
3.54
(Warning: only 0 ratings)

 
So, now the PA server has come to life and has started giving ratings of its own but for some reason doesn't count itself as part of the number of ratings...
 
 
Seriously though, there's a systemic (chaos) problem here...
 
 


The server has changed its mind. Now up to:  3.86
(Warning: only 0 ratings)


(I'd give it a four myself. Great album)


CASSIBER "Beauty and the Beast" ratings distribution

3.50 / 5
(0 ratings)
Essential: a masterpiece of progressive music (0%)
0%
Excellent addition to any prog music collection (0%)
0%
Good, but non-essential (0%)
0%
Collectors/fans only (0%)
0%
Poor. Only for completionists (0%)
0%


now actually we have a surprising 3.5 calculation for CASSIBER ...


Back to Top
 Post Reply Post Reply Page  123>

Forum Jump Forum Permissions View Drop Down



This page was generated in 0.172 seconds.
Donate monthly and keep PA fast-loading and ad-free forever.