Remove unused CalendarColors class

Summary: This class is no longer used after D12850.

Test Plan: grep

Reviewers: epriestley, Blessed Reviewers

Reviewed By: epriestley, Blessed Reviewers

Subscribers: Korvin, epriestley

Differential Revision: https://secure.phabricator.com/D13119