People who have cancer, arthritis or certain disabilities can be particularly sensitive to the cold, adds Whitehead. But there are less obvious problems, too. Consider those who may choose to wear a coat indoors or a pair of gloves to keep the cold away.