Me too. First moved to the area in 1993, then spent eight or so ill-advised months in Dalston in 1999/2000, before moving back.
Moving away from Brixton was really strange - being in Dalston was like being in another town entirely. I felt rootless there and quite lost and unhappy, even though some good friends of mine (still) live there and The George is a fantastic pub. Moving back to Brixton was a total relief - I remember feeling like cheering when the removal van turned into the top of Brixton Road.
So that's it. I'm stuck with it. This is my home and always will be.