Remove unused CalendarColors class
Summary: This class is no longer used after D12850.
Test Plan: grep
Reviewers: epriestley, Blessed Reviewers
Reviewed By: epriestley, Blessed Reviewers
Subscribers: Korvin, epriestley
Differential Revision: https://secure.phabricator.com/D13119