Drivers door window seal

Has anyone else had trouble with the seal at the base of teh window (Outside face) moving away from the glass ?? There is about a 5mm gap, but you can see down into the door. Just concerned with the amount of rain we have been having lately. By the looks of things there is not alot that can be done as the seal in mounted on the outside of the door build up.