I’m not sure if you have already solved it. I had the same issue.
It’s because AWS S3 is looking for that folder (projects) to serve from, which you don’t have.
Simply point Error document to index.html
.
This worked for me. You can handle error pages in react-router.