Almost lost all the site data and archive.

Discussion in 'Industry News' started by ASSEMbler, Jul 24, 2015.

  1. ASSEMbler

    ASSEMbler Administrator Staff Member

    Joined:
    Mar 13, 2004
    Messages:
    19,394
    Likes Received:
    995
    The site data all resides on a Raid 6 redundant server. It has all the backups since 2006,
    as well as all the data from the old FTP that I hope to get online someday. It also has gigs and
    gigs of data from many dev houses.

    I got emergency notice from program that one drive had failed completely, and the last parity drive was only 2% away from failure (reallocation almost used). I knew I needed to replace the dying drive, but the new drive sat in the box for a while as I thought I had time. The outright failure of the second drive was a shocker.

    After changing my pants, I immediately copied the most crucial data to an external drive, and then inserted a new drive into the array (it took 18 hours to rebuild). I now have to get another drive (2tb) and rebuild once more. The failed drive was a Seagate that failed something like a month after the warranty expired, and was one of the post flood Thailand drives that have been failing in great numbers. Selection was very limited at the time.

    I've decided to build a new Raid Z3 system so we have triple redundancy, as well as the old array.

    array2.PNG array1.PNG

    If anyone has a spare 2tb drive, or a few bucks they can send the sites way, it is appreciated as I expect the new archive to cost a bit with 8 drives @ $69 a piece being $550.

    I'm also debating cloud backup of crucial files, but cloud just means "someone else's computer" I feel like I'm never going to get a ps4 at this rate, all the dosh winds up vanishing!

    Never buy oem drives, only retail box drives. Most retail hard drives have a one year warranty, so shop around for a Toshiba (3 year) or WD Black (5 year)
     
  2. MBMM

    MBMM Powered by Pied Piper

    Joined:
    Aug 19, 2013
    Messages:
    2,432
    Likes Received:
    401
    Woah, not fun. I was wondering what was up. Thanks for handling all that so quickly! I can donate a bit. I'll do that now.
     
  3. supersega

    supersega I have 7 and a half PS1s in my room alone.

    Joined:
    Jul 25, 2014
    Messages:
    491
    Likes Received:
    145
    Shoot! That was scary I bet. I have no money, but once I do, I will see what I can find. I suggest Reds, not Blacks, for this.
     
  4. Mord.Fustang

    Mord.Fustang My goodness, it's nipley out!

    Joined:
    Feb 17, 2013
    Messages:
    818
    Likes Received:
    182
    I've mentioned before that since the site's transition/reboot whatever that it has not been as easy to donate as before. I can't even find where I can donate anymore. You should seriously make it very easy and accessible for anybody to donate because I said I would have donated a small amount.

    There should be a Donate button or something similar right on the main page.
     
  5. A Toubib

    A Toubib Midnight Xbox Crew

    Joined:
    Jun 22, 2013
    Messages:
    647
    Likes Received:
    109
    I've been on a forum where the data has been lost. 10+ years of shared car knowledge lost in a couple hours. It was a sad day, that forum never really recovered, and questions that were answered ages ago were popping up and no one had the answers bc the old threads were gone. Would hate for that to happen here. I'm in to chip in.
     
  6. DeChief

    DeChief Rustled.

    Joined:
    Jan 25, 2014
    Messages:
    1,704
    Likes Received:
    712
    [​IMG]
     
    K7Sniper likes this.
  7. Mord.Fustang

    Mord.Fustang My goodness, it's nipley out!

    Joined:
    Feb 17, 2013
    Messages:
    818
    Likes Received:
    182
    How did I miss that? Maybe it was recently added on. Duly noted. :p

    Edit: Donated.
     
    DeChief likes this.
  8. DeChief

    DeChief Rustled.

    Joined:
    Jan 25, 2014
    Messages:
    1,704
    Likes Received:
    712
    [​IMG]
     
    K7Sniper and HEX1GON like this.
  9. Mord.Fustang

    Mord.Fustang My goodness, it's nipley out!

    Joined:
    Feb 17, 2013
    Messages:
    818
    Likes Received:
    182
    Ok I get it. :p

    Edit: I remember asking where it was when the move was first made and it wasn't around, I swear I'm not crazy!
     
    Last edited: Jul 24, 2015
    DeChief likes this.
  10. supersega

    supersega I have 7 and a half PS1s in my room alone.

    Joined:
    Jul 25, 2014
    Messages:
    491
    Likes Received:
    145
    I highly suggest HGST (aka Hitachi) drives as they are very durable and seem to work well. Seagates are crap in a tin can, and Western Digital drives are great, if not pretty expensive like you said.

    http://www.amazon.com/dp/B002WGH2QK/?tag=pcpapi-20
     
  11. HEX1GON

    HEX1GON FREEZE! Scumbag

    Joined:
    May 4, 2011
    Messages:
    9,916
    Likes Received:
    837
    Any drives can be bad, always pointing the finger to Seagate doesn't mean "failure". In fact most of my failing drives have been WD, and they're meant to be the best.

    Would a Cloud service as another form of backup work just as good, like a premium OneDrive? For the more rarer data.. I wouldn't go for Dropbox or anything vastly 3rd party. Microsoft would probably be a more secure bet. I suppose you'd want an offsite backup as well, to be extra safe incase of a disaster.
     
  12. Paulo

    Paulo PoeticHalo

    Joined:
    Mar 13, 2004
    Messages:
    5,354
    Likes Received:
    7
    Depending on how much data i would stick it on amazon glacier storage. Best place to keep cold backups that wont be touched often.
     
  13. ASSEMblergames_Admin

    ASSEMblergames_Admin Administrator

    Joined:
    May 20, 2015
    Messages:
    357
    Likes Received:
    88
    HGST helium drives. They are welded shut. he8 is an incredible drive.
     
  14. supersega

    supersega I have 7 and a half PS1s in my room alone.

    Joined:
    Jul 25, 2014
    Messages:
    491
    Likes Received:
    145
    Agreed. HGST drives are just all sorts of awesome.

    @HEX1GON , did you return them to WD? Normally, they will recover all the data they can for free and make it up to you somehow. Seagate doesn't give 2 craps about customers. And their drives suck, thats the popular consensus.
     
  15. Bad_Ad84

    Bad_Ad84 The Tick

    Joined:
    May 26, 2011
    Messages:
    8,566
    Likes Received:
    1,308
    Seagate actually have the highest failure rate at the moment, there was data posted by a company using retail drives and posted all the failure data.

    Link here: http://www.extremetech.com/computin...clear-winners-and-losers-but-is-the-data-good

    I have also been running around the country replacing <year old seagate drives recently too.

    Not to say in a few years it wont be different, but at the moment - dont buy seagate.
     
  16. LeHaM

    LeHaM Site Soldier

    Joined:
    May 5, 2013
    Messages:
    2,634
    Likes Received:
    292
    How much more would enterprise drives be?
    Do you do tape backups?
     
  17. ASSEMblergames_Admin

    ASSEMblergames_Admin Administrator

    Joined:
    May 20, 2015
    Messages:
    357
    Likes Received:
    88
    I ran out and got the other 2tb, rebuild and all is good now.

    I will have to consider backing it up ultrium drive, it's about $500 for a drive and $20 each 1.6tb tape.
     
  18. -=FamilyGuy=-

    -=FamilyGuy=- Site Supporter 2049

    Joined:
    Mar 3, 2007
    Messages:
    3,033
    Likes Received:
    891
    Glad you avoided the disaster.

    If you want to do remote backup and don't trust 3rd parties, I'd suggest using syncthing : https://syncthing.net/

    It only uses a central server to allow you to find your paired clients, but there's ways to use your own server as well.
    Transfer is crypted and you can select a Master client, so if something goes wrong on the distant backup it won't erase the files elsewhere.
    It also supports different versionning methods.
     
  19. Flash

    Flash Dauntless Member

    Joined:
    Oct 18, 2011
    Messages:
    739
    Likes Received:
    67
    Remote backups FTW! and keep a copy at home. And yeah, LTO is the best thing for backups.
    Also HGST vs WD vs Seagate - i had a LOT more troubles with Seagate but ANY drive can fail. Also there's a chance of power problems like high voltage goes into PSU because of some dumb electrician ass or rare but unfortunate lightning hit. Not to mention fire in the data center. Shit happens.
     
  20. Greg2600

    Greg2600 Resolute Member

    Joined:
    Jun 23, 2010
    Messages:
    931
    Likes Received:
    106
    My office has had a lot of multiple drive failures on our servers (IBM), which were found to be caused by a bug, and required an immediate firmware update to the RAID controller.
     
sonicdude10
Draft saved Draft deleted
Insert every image as a...
  1.  0%

Share This Page