Explicitly setting IsXltTemplate to false did not make any difference. This is as expected because it is false by default when creating a new file.
Changing the mime-type for "xls" from "application/vnd.ms-excel" to "application/excel" solved the problem!