UPDATE: this answer is no longer valid, see the below answer for more up-to-date guidelines.
I believe they have to be 32x32dp, but the actual image itself should be 24dpx24dp centred. The Android design website has the correct guidelines.
I’ve submitted a bug report about this but have yet to hear anything…