So as you can see from the picture I have grown a ton of nuisance algae in my fuge area and it acts as a refugium keeping the levels of algae in the display low should I try and remove all this nuisance algae and replace it with say a Cheato ball or should I keep it as is?
If it's doing a good job, keep it! The only reason people use chaeto, caulerpa, etc, is that they are usually easy to grow and harvest. Remove some of the "nuisance algae" every once in a while and let it regrow. No different from harvesting excess chaeto.
I was just about to post the same question. I tried to grow macro algae in my fuge several times but it was always overtaken by nuisance algae, so I decided to grow it instead. I scrape it every 3-4 weeks. Rocks in my display tank are clean and phosphates and nitrates are down.