It does seem like this is a very general error, however in my case the problem was either that I didn’t run karma start from the correct folder, or that I didn’t restart it after changing the configuration.
I’ll leave this question open and hopefully it can become a resource for others who experience this error message.