Using crushed coral, you're going to have residual calcium "dust" that will need to settle or filter out of your tank.
If you had to clean your filter media 6 hours after you added the coral, then it's probably the coral. Usually a bacterial bloom will take about a day (depending on the temp.)