My C# application is returning 0xE0434352 to Windows Task Scheduler but it is not crashing

Another option is to simply use the Application log accessible via the Windows Event Viewer. The .Net error will be recorded to the Application log.

You can see these events here:

Event Viewer (Local) > Windows Logs > Application