Is deep learning bad at fitting simple non linear functions outside training scope (extrapolating)?
Is my analysis correct? Given my remarks in the comments that your network is certainly not deep, let’s accept that your analysis is indeed correct (after all, your model does seem to do a good job inside its training scope), in order to get to your 2nd question, which is the interesting one. If the … Read more