Group actions in geometric and arithmetic combinatorics