A group can get duplicated when the GroupHeaderDisplayMode is Frozen (this is the default mode). In this case, a group visual is drawn in both the frozen headers area and the scrollable area below.
To work this around, set the GroupHeaderDisplayMode property to Scrollable.
<telerikGrid:RadDataGrid x:Name="dataGrid" GroupHeaderDisplayMode="Scrollable">