This might be a public  event (File/FolderSelecting) or property (IsSelectable) of the FileSystemInfoWrapper but user will need a mechanism to set it (control over the file/folder wrapper creation).

For example some files might be visible and not filtered in main pane but should be disabled for user selection.