If fish have memories then the wild caught ones probably miss their homes but if we give them everything they need to thrive (not just survive) then they will most likely be happy with us. The same applies to captive bred and depending on where/how they're bred they might be better off in our homes. I have no doubt they feel stress and pain so we better be providing them everything they need so they don't experience either of these. In the absence of these that's probably happiness for a fish. I also have to wonder with pollution ravaging our waters (fresh and salt) that maybe they're better off with us for that simple reason.