It's not really like this everywhere, the divide in Camberwell is a lot greater than any other part of South London IMHO. Maybe parts of Battersea could claim to have such a huge divide but certainly not many other places. Yes you have your posh parts in Stockwell, Peckham, Brixton, Herne Hill & Clapham...hey you have posh parts of pretty much any place in South London...but the divide isn't as big in these mentioned places as it is in Camberwell. We're literally talking about parts of Camberwell where folks won't walk around and parts which look like Millionaires row, that's how big the divide is. The Myatts Field is another fine example of the lopsidedness in Camberwell...some of the Streets around there are beautiful....lined with huge houses...then you have the Myatts Field Estate
On the whole I'd say Herne Hill, Brixton & Streatham are a lot more desirable than Camberwell if your excluding Camberwell Grove. Yes there are not so nice parts of Herne Hill, Streatham & Brixton...but IMHO...they're not a patch on the Loughborough part of Camberwell or even around some of the parts of Camberwell around Southampton Way or even the parts up towards Albany Road.
The fact that Maudsley Hospital is in Camberwell makes it a lot less desirable than the mentioned places for a start.
I just personally think you have a lot more choices in Herne Hill, Brixton & Streatham as both a youngster and as a young family.
Obviously this is just my opinion.