When polar molecules are unpolarised they lie in random directions. They align (polarise) when an electric field is applied, negative ends pointed towards the positive plate.
This polarisation produces an internal electric field (each molecule has its own electric field) which opposes the electric field produced by the charges on the plates, reducing this field.
TF reducing the potential difference required to charge the capacitor decreases, causing capacitance to increase as C = Q/V