Because there are more sources of risk (some unobservable) than there are observable market instruments. Seen from the reverse-angle, imagine a yield curve. There are infinitely many possible rate paths/curves that could result in the same vector of discrete yields seen today. The system is underdetermined, there are more unknown paths and risks, these include the equations for the assets themselves,including than there are instruments to calibrate them.