A developer should be able to remove certain fields from there, so his end-users cannot use them to build their expressions.
In R1 2017 we will introduce an event named ExpressionEditorFormCreated, which will be fired every time the expression editor form is shown. This will allow developers to access the form and make modifications to it as they see fit.