Not sure about 'Brain Salad Surgery' or 'Relayer' being too controversial- from what I've gathered, they are hugely popular on this board.
Of the rest I've heard, I think 'A Passion Play' is an over-egged disappointment; I've listened to it quite a few times and the only part I remember is 'The Story Of The Hare That Lost Its Spectacles', which is because it's so embarrassing.. It'd get 2-3 stars from me; it's not a terrible album, but 'Thick As A Brick' is SO much better than this and is in a similar vein.
'The Wall' has a mixed rep on this forum I feel, and it's not my fave Floyd album, but there's nothing wrong with it conceptually or musically- it's a great work, and definitely worth at least 4 stars even though I prefer other albums.
'Atom Heart Mother' is ruined by the terrible 'Alan's Psychedelic Breakfast- apart from that, it's top flight, with some of their sweetest songs in 'If' and 'Fat Old Sun'.
'The Lamb..' is an unquestionable 5 stars for me- I do prefer their other albums, but it is faultless to these ears, with some brilliant moments of sublime musicanship.
'TFTO' is another album I like hugely, and 'The Revealing Science Of God' is my fave Yes song ever, but the album is brought down by the mind-numbingly tedious 'The Ancient'. Whatever, it's still 4 stars from me.
'ATTWT' is a top class album for me, which I've always enjoyed hugely- it's still definitely progressive, but the songs are shorter, and I like 'Follow You...' as the solo is brilliant! A definite four stars!
'90125' I'm not a great lover of- it's way too mired in the 1980s due to the production effects and horrid keyboard sounds- and I hate 'Owner Of A Lonely Heart'. Only 2 stars for that one.