Depends on how many of those days there are. If it's only half a dozen or so, I can deal with putting on an extra layer of clothing in the house for a handful of days per year. As long as it's warm enough inside to prevent damage like pipes freezing, a small amount of personal discomfort for a few days is acceptable.