I found a similar problem with track and terrain and the only answer was to divide things up more. I added more surfaces to the track and created sections of terrain that weren't connected to the rest of the terrain to get the light working again. So, it's possible that you've already answered your own question and you'll need to divide your wall up. It could be a pain, but it sounds like that's what's happening.