-A PERFECTLY SUCCESSFUL FAILURE-

Discussion in 'Battlecorals' started by Battlecorals, Aug 18, 2015.

  1. Battlecorals

    Battlecorals Aquaculturist R2R Supporter Gold Sponsor

    Joined:
    Oct 15, 2009
    Messages:
    4,286
    Likes Received:
    5,653
    Location:
    Wisconsin
    One week ago...

    [​IMG]


    There was nothing different about today. I had gone about my daily routine just as I do any other day. Walked downstairs, a quick lights out inspection of the display followed by a couple alk tests, then off to work. It was sometime around midmorning, while in the middle of a text, my phone buzzed. It was my Apex alerting me that one of my power bars had lost power. Odd I thought. Maybe the wife tripped a circuit breaker or something. Could be anything really at this point but it was the first time I'd had a single module power outage like this, so I did not hesitate to call home and ask if there had been any power flutters or anything of that sort. Then I asked her to take peek under the stand and see if the power bar was still on or not, or if anything seems wrong at all. As she got closer, she said she heard something odd. "splashing maybe?" I heard her say.

    [​IMG]


    “There’s Water!" she cried. “It's falling down the back wall!” “I’m on my way” I replied, as I proceeded to rush home. The plan was already in motion. What kind of leak was it and how was I going to deal with it? Hoping for a simple problematic drain, a snail maybe but the realist in me was already preparing for the worst. I thought, well this may be it. The day I had been carefully planning for and dreading at the same time, was here. But she wasn’t frantic when she cried "water" so I was sure it wasn’t a total blow out. When I walked in the door I took my time, abandoning urgency I grabbed a flashlight and put in some new batteries. In blissful hesitation as to what I was about to see, I had already begun executing a plan that had been in my head for years now.

    I admit I swore. I swore loudly. Not at anyone or anything. Just out loud. My two sons near, and wife clenching our one year old daughter, I shouted at the top of my lungs, the kind of profanity that no child should should be exposed to. Yes I was mad, but not in a panic. There it was pouring from the freshly separated seam of my external overflow. I saw a small but very real and almost adorable saltwater-fall cascading onto the wall behind, the equipment below and everything inbetween. The sight I had prepared myself mentally for so long now was right in front of me. Real as ever.

    [​IMG]



    Calculating risk and damage control both operating in perfect unison as I assessed the situation and began to execute my contingency plan. Pumps shut off. The acros had to come out. That I was certain of. Was the tank done for? Wasn’t sure about that yet. All I knew is the first thing I had to do was make a little room in one of my tanks downstairs, get those thriving colonies out of there ASAP and into safety. And like a well oiled machine my plan continued to roll. I was calm and I was collected. Once the coral was secure, I had a little more time to assess the seam and the scope of the problem. The tank manufacturer had been called early on in the shuffle and had a sound idea on how to repair it that made perfect sense to me.

    [​IMG]


    Ultimately the actual damage was minimal. I believe that some acrylic pieces in the overflow designed to keep a screen in place had, in the last three years expanded to the point of excess and caused the rear wall of the overflow to pull away just enough to cause a decent leak. The rest of the tank was perfectly in tact. I decided that I did not have to drain it and kept the fish in there with a heater and a pump. I expect to get parts to repair it in day or two and have it back up and running soon after.

    [​IMG]

    So what does this all mean and why am I even chronicling the whole fiasco? I’ll tell you now.


    This is a situation that could have easily been a disaster. A fire, a shock, a bad shock, massive livestock losses etc. While still a giant pain, and a ultimately a heartbreaker for yours truly, I feel extremely fortunate that every single mechanism I have in place to avoid massive failure or catastrophe was in place and did its job perfectly. The GFI on the wall that shut down as soon as it got wet. The Apex that instantly notified me that the bar had lost power. And even out of paranoid anticipation, I had always left a generous portion of my halide lit prop tank vacant just in case I needed to do this. So once I set the ball in motion, it all went exactly as I had planned it would go. I was not rushed, hurried or even stressed throughout the entire ordeal. The only thing that wasn’t protected were my children's ears from the river of vulgarity that did flow from my mouth on first confirmation of the gaping seam.


    So I’ll leave you with this but I do not want to scare you. Please plan for every possible scenario you can come up with, and and when you’ve thought of everything, think even harder about the ones you can’t and how you’d respond when the time comes. As unlikely as big problems are to happen, unfortunately things can go wrong, and the more prepared you are, the less chaotic and dangerous the situation will be when it does. I have exacerbated many a problem by not having a solid plan and rather than running around like a chicken with its head cut off, as I was methodically scrambling this morning, I thought to myself, this is not so bad, in fact it’s been a perfectly successful failure.

    [​IMG]
     
    Last edited: Aug 19, 2015

  2. TheEngineer

    TheEngineer Formerly icecool2 R2R Supporter R2R Excellence Award Reef Squad Showcase Editor Delaware Reef Club Build Thread Contributor

    Joined:
    Nov 26, 2011
    Messages:
    7,281
    Likes Received:
    7,550
    Location:
    PA
    Geez. Glad you got it worked out. Still sucks though. Any damage to your house from the water? How much do you think drained out?
     
  3. Aquaph8

    Aquaph8 Love The Fish R2R Supporter R2R Excellence Award Moderator Emeritus

    Joined:
    Feb 20, 2011
    Messages:
    8,906
    Likes Received:
    299
    Location:
    Tucson, AZ
    Nice job on the save, I gotta get an apex. One of those things I've needed to do for a while. Sorry about the tank, hopefully you get it all going again soon man.
     
    Russ265 and Tahoe61 like this.
  4. buckeye82

    buckeye82 Active Member

    Joined:
    Sep 25, 2014
    Messages:
    218
    Likes Received:
    64
    Location:
    Indiana
    Wow. Glad you were able to salvage and have free ready to go spare tank space. From the pictures I'm shocked the wall and trim is not in worse shape.
     
  5. Reefmon

    Reefmon Active Member

    Joined:
    Jul 13, 2013
    Messages:
    325
    Likes Received:
    109
    Location:
    Tampa/zephyrhills
    Wow..felt like I was reading a suspense. Glad everything worked out for you and it wasn't as bad as you planned for. WHEW!!!!
     
    KliJefs likes this.
  6. MikeyB

    MikeyB Valuable Member

    Joined:
    Oct 14, 2013
    Messages:
    1,099
    Likes Received:
    116
    Location:
    Bartlett, IL
    Wow. Glad you were able to save everything AND it didnt turn into a giant disaster for you. It could of ended up real bad, which im very glad to hear that it didnt. My tank is in my basment so unless im down here id never know if the tank sprung a leak or anything bad happened.
     
  7. Amoo

    Amoo Professional Thread Derailer R2R Supporter R2R Excellence Award Reef Squad Partner Member 2019 Build Thread Contributor

    Joined:
    Jul 18, 2015
    Messages:
    2,897
    Likes Received:
    7,065
    Location:
    Alapaha, GA
    Adam, first I'm sorry for your inconvenience, but it looks like due to good planning you were indeed able to skirt a major disaster. I know tanks can fail, it happens, but in this instance, it sounds like the manufacturer was quick to react and responded to your problem appropriately. Would you be willing to divulge who made this tank? I know some may see it as a negative, so I can understand if not, but I personally see it as a positive, that they were quick to respond and react.
     
  8. johnanddawn

    johnanddawn Valuable Member

    Joined:
    Sep 23, 2006
    Messages:
    1,081
    Likes Received:
    92
    I feel for you, just went through the same thing a month ago and yes after all the disaster control, disappointment, loss, and discouragement, in the end you realize that things could have been much, much worse
    You always hear about the tank crashes but tank failures fortunately seem to be more rare

    It takes a different sort of person to see a perfectly successful failure
     
  9. Diesel

    Diesel String Stalker. R2R Supporter R2R Excellence Award Reef Spotlight Award Photo of the Month Award

    Joined:
    Apr 14, 2012
    Messages:
    13,613
    Likes Received:
    15,828
    Location:
    Katy
    Dang Adam!
    I hope it wasn't my text that buzzed through your alarm email.
    Nobody wants to go through this and if it happens we all say stuff that we later regret.
    You're blessed that it stayed just with some minor damage.
     
  10. dodgerblew

    dodgerblew Valuable Member

    Joined:
    Aug 22, 2008
    Messages:
    2,508
    Likes Received:
    976
    Location:
    So Cal
    Very relieved to hear that this situation worked out as good as it did for you Adam, especially the coral since its part of your livelihood. Made me think though of my own situation where I don't have any more available space. This hobby can be so daggum stressful!
     
  11. kacrocorals581

    kacrocorals581 Gotta have that acro

    Joined:
    Apr 13, 2013
    Messages:
    1,898
    Likes Received:
    384
    Location:
    south Carolina
    glad everything turned out OK considering how bad things could have gone.
     
  12. Battlecorals

    Battlecorals Aquaculturist R2R Supporter Gold Sponsor

    Joined:
    Oct 15, 2009
    Messages:
    4,286
    Likes Received:
    5,653
    Location:
    Wisconsin


    It was daniel LOL were were chatting about nitrate dosing!

    But thanks so much guys. really appreciate all the comments. indeed it was a potential disaster and if a single link in the chain had been broken it would have undoubtedly been worse. Even the side that leaked was right over the outlet, with was actually a good thing because it was that gfi tripping that had the apex send me the alert. if it was the other corner I'd have gotten the frantic call about water everywhere for sure. The whole situation would have been much more manic from the beginning.
     
    Russ265 likes this.
  13. cb684

    cb684 Well-Known Member

    Joined:
    Apr 28, 2015
    Messages:
    581
    Likes Received:
    445
    Knowing about your backups and quarantine procedures I am not surprised by your preparedness. That's how one can separate amateurs from professionals. Good job man, and thank you for sharing the knowledge.
    Camilo.
     
  14. Andyf30

    Andyf30 Member

    Joined:
    Jul 23, 2014
    Messages:
    40
    Likes Received:
    10
    Location:
    United States
    Nice save Adam! Sorry to hear about it but glad to see it seems like a fairly fixable situation
     
  15. PaulKreider

    PaulKreider Valuable Member

    Joined:
    Feb 6, 2013
    Messages:
    1,799
    Likes Received:
    100
    Location:
    Tallahassee-Venice Fl
    Sorry to hear about the tank, but luckily it wasn't a full blow out. When my 120 front panel cracked at 3 am there were more than a few curse words throw around. But luckily I was able to pull it together and get everything under control. It's definitely a very stressful situation. Especially when you're battling saving your creatures and protecting your house from water damage at the same time.

    Hopefully it all turns out well for you though! And glad you caught everything in time! It's definitely a situation I wouldn't wish upon my worse enemy!
     
    Last edited: Aug 18, 2015
  16. dkray944

    dkray944 Active Member

    Joined:
    Dec 31, 2014
    Messages:
    129
    Likes Received:
    59
    Location:
    San Antonio
    I think the apex just paid for it self
     
    MrSquid likes this.
  17. Reef Pets

    Reef Pets Bioprospector

    Joined:
    Mar 7, 2008
    Messages:
    10,013
    Likes Received:
    1,396
    Location:
    Ohio
    I hate reading things like this because I know how failures generally end up, a total disaster. Good to hear you were able to catch it in time to minimize damage.
     
  18. Jlobes

    Jlobes Valuable Member

    Joined:
    Jun 30, 2012
    Messages:
    5,996
    Likes Received:
    1,212
    Location:
    Behind the redwood curtain
    dang. sorry to hear about that. every aquarists nightmare, indeed. sounds like you were prepared and weathered the storm fairly well.

    maybe its time to have a busted seam frag pack sale!?!? Im sure some of those amazing colonies have some accidental new frags. put me on the list, if so. ;)
     
  19. Russ265

    Russ265 Valuable Member

    Joined:
    Jul 28, 2015
    Messages:
    2,752
    Likes Received:
    1,885
    looks like a well-executed "battle" plan.

    while the hobby is rewarding for all our hard work, it could go up in smoke at any minute and murphy's law is always at play.

    this truly was the perfect failure.
    get those fail safes! and have a SHTF plan of action :)
     
  20. kannon50

    kannon50 Well-Known Member

    Joined:
    Aug 8, 2014
    Messages:
    629
    Likes Received:
    104
    Location:
    Houston, TX
    congratulations on not getting a speeding ticket on the way home!!

    glad you were able to save the day.

    for all the beginner Apex Users out there how about you share your Alarm programming for everyone to see :)
     
    Russ265 likes this.
Draft saved Draft deleted

Share This Page