Why is time lag an issue for direct realism?
The light from distant objects (such as the sun) takes time to reach our eyes.
So what we are seeing now may no longer exist.
so what we are seeing and what is there are different
This is no less true for physical objects at any distance. And so, what we directly see are appearances not the physical objects, and direct realism is false.