I verified that the shortcuts are enabled (in Keyboard preference), but occasionally Control+1, Control+2, etc stop working on my computer. It works again when I reboot. I'm on Yosemite 10.10.3
What's strange is I can still switch spaces via Control+arrow key.