Jump to content

UNRAID Drive Failure Advice

Go to solution Solved by OddOod,

There is a plugin called unBALANCE which will level the distribution in your array

Hi guys,

 

One of my 4TB drives in  my UNRAID array as moved from having a single SMART error that I've been nursing for a while now with no issues however, a couple of days ago I started getting more errors so now I want to look at getting the data off that drive.

 

While I could go ahead and buy an new drive and go through the steps of rebuilding the data from parity, I've got plenty of space on the other drives so wanted to know how to shift / reallocate the data currently stored on the failing drive onto the other drives.

 

My intention would be to empty the faulty drive then just remove it from the array.

 

Thx

Living Room PC - Lian-Li O11 XL Evo - MSI X870 Tomahawk Mobo - AMD 9800X3D - 32GB DDR5 Ram - RTX 4090 - 2TB Samsung 990Pro NVMe - Antec 1200w PSU - Dual Custom Loop Cooling - GPU cooled with EK Quantum Surface S240 + EK Quantum Surface P360M X-Flow Rads - CPU cooled with EK Quantum Surface X360M Rad

 

Bedroom PC - Hyte Y60 - Intel Core i5 13600k - MSI Pro-A Wifi Z790 Mobo DDR5 - 32GB Ram - RTX 5070ti - 1TB Samsung 990Pro NVMe - Corsair HX1200i PSU - CPU + GPU cooled with Hyte Y60 Corner Distro Plate - EK Coolstream S120 + EK Quantum Surface S360 + EK Quantum Surface X240M

 

Extension PC - Lian Li o11 Dynamic - Intel Core i9 9900k - MSI Meg Ace Z390 Mobo - 16GB Ram - RTX 3080ti - 256GB Samsung NVMe - Corsair AX850 PSU - CPU + GPU cooled with dual EKWB 360 Rads + G1 side EKWB distro plate.

 

Office PC - Thermaltake Tower 100 - Intel Core i7 8086K - Gbyte Z390 I Aorus Pro Wifi Mobo - 16GB Ram - iGPU - 256GB Samsung NVMe - EVGA B5 850W PSU - CPU cooled with dual EK Quantum Surface P120M Rads + Barrow 3-in-1 Block, Res & Pump.

 

Spare - Corsair 250D - Intel Core i7 8700k - Gbyte Z390 I Aorus Pro Wifi Mobo - 16GB Ram - GTX 980ti - 256GB Samsung NVMe - BeQuiet P11 750 PSU - CPU cooled with EK Coolstream S240 + S120 Rads + EK Pump / Res Combo

 

Annex - Corsair 280X - Intel Core i7 4790k - Asrock H97M ITX Mobo  - 16GB Ram - EVGA GTX 1080ti - Corsair SFXL600 PSU - CPU + GPU cooled with triple EK Coolstream S240s + EK Pump / Res Combo

 

NAS PC - Fractal Node 804 - Intel Core i7 3770k - Asus P8Z77-M Mobo - 16GB Ram - MSI GTX 1660 Ventus - Corsair AX850 PSU - Unraid 21TB Storage Server

 

Living Room AV Setup 5.1.4 - Nvidia Shield - Yamaha RX-A6A - 2 x B&W CM9s2 - 2 x Monitor Audio FX Silvers - 4 x B&W CCM665s - B&W CMCs2 - SVS SB13 Ultra - LG OLED65C1

 

Extension AV Setup - Sonos ARC + Sub (Gen 3) - LG OLED65C6V + Sonos Amp - 5 x Monitor Audio C265s

 

Bedroom AV Setup - Yamaha WXC-50 - 2 x B&W CM1s - Rel Quake - LG OLED42C2.

Link to comment
https://linustechtips.com/topic/1623531-unraid-drive-failure-advice/
Share on other sites

Link to post
Share on other sites

I have wondered the same before and looked up guides. Unfortunately they don't seem to have a one button script to do it. There are a multiple versions of ways to do this you can look up and try. Some preserve parity, some don't so require a rebuild. I never did it in the end because I thought the risk of me making a mistake and losing data was not worth it. I'm just waiting for a specific drive to be at the right price before I wholesale replace a bunch. It might just be easier to get a replacement drive as swapping and rebuilding is easy.

Gaming system: R7 7800X3D, Asus ROG Strix B650E-F Gaming Wifi, Thermalright Phantom Spirit 120 SE ARGB, Corsair Vengeance 2x 32GB 6000C30, MSI Ventus 3x OC RTX 5070 Ti, MSI MPG A850G, Fractal Design North, Samsung 990 Pro 2TB, Alienware AW3225QF (32" 240 Hz OLED)
Productivity system: i9-7980XE, Asus X299 TUF mark 2, Noctua D15, 64GB ram (mixed), RTX 4070 FE, NZXT E850, GameMax Abyss, Samsung 980 Pro 2TB, iiyama ProLite XU2793QSU-B6 (27" 1440p 100 Hz)
Gaming laptop: Lenovo Legion 5, 5800H, RTX 3070, Kingston DDR4 3200C22 2x16GB 2Rx8, Kingston Fury Renegade 1TB + Crucial P1 1TB SSD, 165 Hz IPS 1080p G-Sync Compatible

Link to post
Share on other sites

5 minutes ago, OddOod said:

There is a plugin called unBALANCE which will level the distribution in your array

Thanks buddy,

 

I've just found unBALANCE now and it looks like it does what I need.

 

The only issue I'm finding with it is its doesn't appear to 'Scatter' all the data on the source drive to all other drives even if there's enough space.

 

Unless I'm missing something, I'm currently selecting xyzTB of data then moving it to a single drive with at least that free. Once that drive fills up, I repeat with another selection of folders and move them to the next drive. Rinse and repeat!

 

Anyhoo, this seems to be working and Parity appears to be rewriting as this progresses so fingers crossed I'll have everything off this drive by tomorrow and I just remove the offending drive from the array. 

Living Room PC - Lian-Li O11 XL Evo - MSI X870 Tomahawk Mobo - AMD 9800X3D - 32GB DDR5 Ram - RTX 4090 - 2TB Samsung 990Pro NVMe - Antec 1200w PSU - Dual Custom Loop Cooling - GPU cooled with EK Quantum Surface S240 + EK Quantum Surface P360M X-Flow Rads - CPU cooled with EK Quantum Surface X360M Rad

 

Bedroom PC - Hyte Y60 - Intel Core i5 13600k - MSI Pro-A Wifi Z790 Mobo DDR5 - 32GB Ram - RTX 5070ti - 1TB Samsung 990Pro NVMe - Corsair HX1200i PSU - CPU + GPU cooled with Hyte Y60 Corner Distro Plate - EK Coolstream S120 + EK Quantum Surface S360 + EK Quantum Surface X240M

 

Extension PC - Lian Li o11 Dynamic - Intel Core i9 9900k - MSI Meg Ace Z390 Mobo - 16GB Ram - RTX 3080ti - 256GB Samsung NVMe - Corsair AX850 PSU - CPU + GPU cooled with dual EKWB 360 Rads + G1 side EKWB distro plate.

 

Office PC - Thermaltake Tower 100 - Intel Core i7 8086K - Gbyte Z390 I Aorus Pro Wifi Mobo - 16GB Ram - iGPU - 256GB Samsung NVMe - EVGA B5 850W PSU - CPU cooled with dual EK Quantum Surface P120M Rads + Barrow 3-in-1 Block, Res & Pump.

 

Spare - Corsair 250D - Intel Core i7 8700k - Gbyte Z390 I Aorus Pro Wifi Mobo - 16GB Ram - GTX 980ti - 256GB Samsung NVMe - BeQuiet P11 750 PSU - CPU cooled with EK Coolstream S240 + S120 Rads + EK Pump / Res Combo

 

Annex - Corsair 280X - Intel Core i7 4790k - Asrock H97M ITX Mobo  - 16GB Ram - EVGA GTX 1080ti - Corsair SFXL600 PSU - CPU + GPU cooled with triple EK Coolstream S240s + EK Pump / Res Combo

 

NAS PC - Fractal Node 804 - Intel Core i7 3770k - Asus P8Z77-M Mobo - 16GB Ram - MSI GTX 1660 Ventus - Corsair AX850 PSU - Unraid 21TB Storage Server

 

Living Room AV Setup 5.1.4 - Nvidia Shield - Yamaha RX-A6A - 2 x B&W CM9s2 - 2 x Monitor Audio FX Silvers - 4 x B&W CCM665s - B&W CMCs2 - SVS SB13 Ultra - LG OLED65C1

 

Extension AV Setup - Sonos ARC + Sub (Gen 3) - LG OLED65C6V + Sonos Amp - 5 x Monitor Audio C265s

 

Bedroom AV Setup - Yamaha WXC-50 - 2 x B&W CM1s - Rel Quake - LG OLED42C2.

Link to post
Share on other sites

13 minutes ago, ChrisLoudon said:

The only issue I'm finding with it is its doesn't appear to 'Scatter' all the data on the source drive to all other drives even if there's enough space.

 

I think you want this section of the unraid docs
https://docs.unraid.net/unraid-os/using-unraid-to/manage-storage/array-configuration/#removing-data-disks

5950X/4090FE primary rig  |  1920X/1070Ti Unraid for dockers  |  200TB TrueNAS w/ 1:1 backup

Link to post
Share on other sites

5 minutes ago, OddOod said:

Thanks.

 

I did a bit of Googling earlier on this.

 

Am I right or wrong in thinking, a parity rebuild after a drive has been removed due to failure requires another new drive to be installed in its place?

 

I think that's what Google was telling me so that's why I'm just moving the data and allowing parity to be rewritten so I don't need to fork out for another drive.

 

I'm sure someone on Reddit had asked a similar question in the hope he could just yoink the offending drive, do a parity rebuild and have it redistribute the recovered data across the remaining drives but the answer appeared to be no.

Living Room PC - Lian-Li O11 XL Evo - MSI X870 Tomahawk Mobo - AMD 9800X3D - 32GB DDR5 Ram - RTX 4090 - 2TB Samsung 990Pro NVMe - Antec 1200w PSU - Dual Custom Loop Cooling - GPU cooled with EK Quantum Surface S240 + EK Quantum Surface P360M X-Flow Rads - CPU cooled with EK Quantum Surface X360M Rad

 

Bedroom PC - Hyte Y60 - Intel Core i5 13600k - MSI Pro-A Wifi Z790 Mobo DDR5 - 32GB Ram - RTX 5070ti - 1TB Samsung 990Pro NVMe - Corsair HX1200i PSU - CPU + GPU cooled with Hyte Y60 Corner Distro Plate - EK Coolstream S120 + EK Quantum Surface S360 + EK Quantum Surface X240M

 

Extension PC - Lian Li o11 Dynamic - Intel Core i9 9900k - MSI Meg Ace Z390 Mobo - 16GB Ram - RTX 3080ti - 256GB Samsung NVMe - Corsair AX850 PSU - CPU + GPU cooled with dual EKWB 360 Rads + G1 side EKWB distro plate.

 

Office PC - Thermaltake Tower 100 - Intel Core i7 8086K - Gbyte Z390 I Aorus Pro Wifi Mobo - 16GB Ram - iGPU - 256GB Samsung NVMe - EVGA B5 850W PSU - CPU cooled with dual EK Quantum Surface P120M Rads + Barrow 3-in-1 Block, Res & Pump.

 

Spare - Corsair 250D - Intel Core i7 8700k - Gbyte Z390 I Aorus Pro Wifi Mobo - 16GB Ram - GTX 980ti - 256GB Samsung NVMe - BeQuiet P11 750 PSU - CPU cooled with EK Coolstream S240 + S120 Rads + EK Pump / Res Combo

 

Annex - Corsair 280X - Intel Core i7 4790k - Asrock H97M ITX Mobo  - 16GB Ram - EVGA GTX 1080ti - Corsair SFXL600 PSU - CPU + GPU cooled with triple EK Coolstream S240s + EK Pump / Res Combo

 

NAS PC - Fractal Node 804 - Intel Core i7 3770k - Asus P8Z77-M Mobo - 16GB Ram - MSI GTX 1660 Ventus - Corsair AX850 PSU - Unraid 21TB Storage Server

 

Living Room AV Setup 5.1.4 - Nvidia Shield - Yamaha RX-A6A - 2 x B&W CM9s2 - 2 x Monitor Audio FX Silvers - 4 x B&W CCM665s - B&W CMCs2 - SVS SB13 Ultra - LG OLED65C1

 

Extension AV Setup - Sonos ARC + Sub (Gen 3) - LG OLED65C6V + Sonos Amp - 5 x Monitor Audio C265s

 

Bedroom AV Setup - Yamaha WXC-50 - 2 x B&W CM1s - Rel Quake - LG OLED42C2.

Link to post
Share on other sites

13 minutes ago, ChrisLoudon said:

Am I right or wrong in thinking, a parity rebuild after a drive has been removed due to failure requires another new drive to be installed in its place?

You are correct. But if you follow the steps they lay out, step 4 will let the system know that it needs to rebuild parity ignoring that drive

5950X/4090FE primary rig  |  1920X/1070Ti Unraid for dockers  |  200TB TrueNAS w/ 1:1 backup

Link to post
Share on other sites

15 hours ago, OddOod said:

Looking at that again reminds me why I didn't go ahead with my own disk removal. That standard process leaves you without parity until you rebuild it. The advanced parity preserving method, if you make a typo things can go bad fast.

 

14 hours ago, ChrisLoudon said:

Am I right or wrong in thinking, a parity rebuild after a drive has been removed due to failure requires another new drive to be installed in its place?

If you replace the drive, you're rebuilding the data on the replaced drive, not rebuilding parity information itself.

If you don't replace the drive, you need to rebuild the parity data unless you zero'd the outgoing drive while it was in the array to keep the parity data correct.

 

14 hours ago, ChrisLoudon said:

I'm sure someone on Reddit had asked a similar question in the hope he could just yoink the offending drive, do a parity rebuild and have it redistribute the recovered data across the remaining drives but the answer appeared to be no.

In theory it might not be impossible, but it would be complicated to implement and risky. Better to do the existing documented methods.

 

Think about the steps involved. You'd still have to create the virtual failed drive using parity data and remaining drive data. Then you move data off that virtual disk onto real disks, updating parity as you go. Only when you've moved all data off, you can zero out the virtual disk and remove it.

Gaming system: R7 7800X3D, Asus ROG Strix B650E-F Gaming Wifi, Thermalright Phantom Spirit 120 SE ARGB, Corsair Vengeance 2x 32GB 6000C30, MSI Ventus 3x OC RTX 5070 Ti, MSI MPG A850G, Fractal Design North, Samsung 990 Pro 2TB, Alienware AW3225QF (32" 240 Hz OLED)
Productivity system: i9-7980XE, Asus X299 TUF mark 2, Noctua D15, 64GB ram (mixed), RTX 4070 FE, NZXT E850, GameMax Abyss, Samsung 980 Pro 2TB, iiyama ProLite XU2793QSU-B6 (27" 1440p 100 Hz)
Gaming laptop: Lenovo Legion 5, 5800H, RTX 3070, Kingston DDR4 3200C22 2x16GB 2Rx8, Kingston Fury Renegade 1TB + Crucial P1 1TB SSD, 165 Hz IPS 1080p G-Sync Compatible

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×