In 1659, the Massachusetts General Court ordered a "hefty 5 shilling fine" to be paid by anyone caught celebrating Christmas. The ban was revoked in 1681. (A fine ought to be re-instated for celebrating Christmas before Thanksgiving Day. Just saying.)
Christmas became an official federal holiday in 1870.