Unless I’m doing something wrong, contacts can only be added to groups from the group view, not the contact view. An obvious place to put a control would be where it already shows you how many groups the contact is in.