According to the Weather Channel website:
Key West's average temperatures for January are between 65 and 75 degrees with 2 inches of precipitation expected.
Cozumel is a bit warmer (and wetter) with temperatures averaging about 68 to 82 degrees with about 4 inches of precipitation.