Friends of mine moved down there a few years ago - middle class outsiders as they were seen. They moved after lots of intimidation, stuff thrown at the windows, teenagers hanging around outside. Most locals very sympathetic, but nothing they could do. The last straw was when the man was badly beaten up by said teenagers.
Still, it might have changed. See related thread (can't remember what it was called) on living where you can afford as opposed to where you want. The best idea is probably spend some time hanging out down there, local pub etc, see what its like after dark.