Never had yellow water? Didn't know this was a thing...
It's not really visible when you look at your tank (unless your tank is REALLY dirty), if you want to check you can fill some tank water in a white bucket, if you have yellowish water it'll show