In this paper we consider the structure of the group $C^*$-algebras of the generalized disconnected Dixmier groups. As an application we estimate the stable rank and connected stable rank of these $C^*$-algebras.