A lack of vitamin C in a guinea pig's diet can lead to a condition known as scurvy, which can cause symptoms such as poor appetite, weight loss, lethargy, rough coat, swollen joints, and bleeding gums. To prevent this, it is important to provide guinea pigs with a diet that includes sufficient vitamin C.