There's hotkeys for setting control groups but it would be nice to have hotkeys to add units to a group and remove them from a group.
Usually those are accessed with another modifier, for example alt+n adds the selected unit to control group n