Is there a way to designate which element is the area to start a drag?
=====ADMIN EDIT=====
In the interim, as an alternative approach, you have the option to specify the drag handle element using JavaScript to selectively disable the dragging functionality for all elements within the ItemTemplate, except for the intended drag handle. Here is an example: REPL link.