Recovering missing information when projecting 3D points or unprojecting image pixels