Just for a reference for everyone I got a a ds18b20 from adafruit. It was the first probe I got and was coated in silicone before I put it into use. I started getting erratic readings in the reef-pi interface and took it out to check it. Apparently the silicone didn't do it's job very well because I noticed it had some rust on it. I just took it apart to check it to see if the sensor was intact and found this.
These are supposed to be waterproof and the only reason I used silicone was to keep the probe from rusting. After inspecting the sensor I found that whatever they used to seal the probe and keep it water tight had a big gap in it that allowed water to get into the probe and short it out.