Please refer to the attached gif file for better illustration.
Workaround:
Private Sub RadGalleryElement_DropDownClosed(sender As Object, args As RadPopupClosedEventArgs)
For Each item As RadGalleryItem In Me.RadGalleryElement1.Items
item.VisualState = ""
Next
End Sub