I won't argue that what BRS does is not technically science but it has certainly helped me learn about reefing topics while providing some confidence in their conclusions based on reasonable levels of controls and planned studies. I'm advocating for simple studies like taking the same coral in the same tank and light half with LED and the other half with T5 at equal Par - what are the resulting color differences and growth rates presented clearly and professionally. Not looking for true academic level science here as that is almost certainly unrealistic.
Just keep in mind what you are concluding. In your example, you take frags of the same coral (hopefully very close to the same size, and fragged at the same time, etc., etc.) and place them in the same body of water and place them under different lights. Then observe the results. You can conclude that the corals look/grow differently under the different lights, if they are any different, but you don't know if that would happen if you did the same thing again. Without replication you cannot control for a number of important testing variables that are necessary for high confidence in the results. I have conducted studies with larval fish, and had really good results with a certain protocol for a few systems (replicates), and one of the systems under that protocol did really poorly leading there to be no difference from the control. Another example would be folks that get frags of the same exact coral at different times (like the same coral from battlecorals that is the same colony from the same system), and see different growth rates and coloration even after months in their system.
Again, anecdote is an important part of science. I find anecdote quite useful, and I am not advocating against simple experiments without replication. I also appreciate those folks like
@Dr. Reef and
@Ryanbrs and the work they do, I find it helpful and informative. But I do think drawing conclusions from anecdote is perilous. You risk post hoc ergo propter hoc, and the biggest risk is extrapolating from that one observation. What light, NO3 level, PO4 level, alkalinity level colors up a coral in another tank might not work the same in your tank.
A simple way to say it is assign confidence linearly with the amount and confidence in the evidence. In practical terms, would you want a drug company to test a drug on one person with cancer, observe that they were cancer free, and then start treating you with that drug instead of a more well studied alternative? Probably not, you would probably want more evidence than that one person to take the risk. What about the same scenario with the family pet, your siblings beloved dog? Your favorite fish?
Final example:
BRS found that higher alkalinity resulted in higher growth rates and benefited coloration of some corals, but not others in their study. Many folks say that alkalinity levels as such kill corals. Was
BRS wrong? Are the other people wrong?
Ok, enough rambling.
TLDR; Be careful with how you (everyone) uses anecdote, I care about the living organisms in your tank and I think you probably do too.