So, one more thing I just discovered (for myself):
This checkbox "Mark build Failed on Error“ does only apply to the log parsing. Usually, the ant task would fail, and the build would be flagged as failed by Jenkins. In this case, the ant script just goes on and we only find the errors in the log file.
So, it might not be bad to check this box but ideally the ant task should already fail.