Yes the AC tester thing is whack, although humidity is low right now and I was wearing socks yesterday on a tiled floor and have a cat, could be static, though the doubt it, I'll replace the PSU's hopefully this week and report back.
My guess is the Y capacitor or a similar capacitor across the isolation gap is leaking. You should not be getting shocked anywhere.
Was this off the relay pack or somewhere else?