Click the Trashcan icon to remove a group. Groups can only be removed if all menu items have been moved to a different group.
More:
Editing Group Labels