A StackOverflowException occurs when you press a RadDropDownButton placed into the DropDownContent of another RadDropButton.
To work this around, subscribe for the LostMouseCapture event of the parent drop down button and handle it.
private void DropDownButton_LostMouseCapture(object sender, MouseEventArgs e)
{
e.Handled = true;
}