Where is my System.Numerics namespace?

You need to add an assembly reference to System.Numerics.dll

The MSDN entry on BigInteger states:

BigInteger Structure
…
Namespace: System.Numerics
Assembly: System.Numerics (in System.Numerics.dll)