May I ask if I should stop using GFO then so that I can leave that for bacteria?
GFO can serve the specific purpose of lowering phosphates. Rapidly, which is not always good. Bacteria can also consume phosphates perhaps more gently, and COULD be a better long term answer.
As @Daddy-o asks what are your current phosphate levels? And do you have a present algae issue that you are dealing with?