The boats for trade grew in size, so they couldn't fit down the river, so went to Avonmouth or Royal Portbury ports instead.
Bristol Harbourside was predominantly based off secondary sector employment, so when the boats couldn't fit, people couldn't work there anymore, and the area transitioned to tertiary, so the harbour fell into dereliction.