It seems that the GridViewColumnGroup.MinHeight has a big influence on the height of the filter cell.
Workaround:
this.radGridView1.AutoSizeRows = true;