Gravity, sunlight and a lack of exercise are the main causes of a sagging neck. However, as with any other muscle, you can firm and tone your neck muscles.