Found the issue:
I had two disabled writers that were included in the Data Streaming (by default).
Therefor FME Server expected multiple files as output and defaulted to the download service.
Excluding the writers from the service (Edit service settings) solved the issue.