The issue happens when one test is being executed several times during the test list execution. On every new execution of the same test, a new character is added to the length of the file names of ImageOnFailure.png and DomTreeOnFailure.txt Eventually this leads to Exception. To reproduce: Sample test is attached to the internal bug description.