56

The S.M.A.R.T C5 value of my Samsung HM640JJ Hard Drive (in an HP Pavilion dv6 laptop) is "yellow status = caution"

C5 was 10 yesterday, and it's 21 today.

C4 (Reallocation Event Count) = 0 and 05 (Reallocated Sectors Count) = 0

How can I force the firmware to reallocate them?

  • I removed the partitions, recreated them again and formatted the entire drive.
  • I ran chkdsk /r /f
  • I ran the BIOS disk check utility and other diagnose/repair tools
sblair
  • 12,757
edteke
  • 703

9 Answers9

154

Short answer: Write something new to the sector (even zeros - which a long format does).

Long Answer

Hard drives today try to hide bad sectors from the host computer. The host computer simply asks the drive to return the contents of a particular sector number. Normally the drive reads the sector, returns it to the host machine, and everything is fine.

The hard drive knows if the value it read is valid or not, because the drive uses Error-correcting code (ECC) to validate that the contents it read are correct. If the drive detects that the contents of the sector are invalid, it will retry the read. The hope is that if it simply reads it again, it might get the correct sector contents. It will keep retrying until it gets a good value, or it's reached its time limit (formally known as the Command completion time limit, or CCTL).

During these retries, the drive will appear dead; as it is no longer responding to commands.

Spare Sectors

Most modern drives contain a number of "spare" sectors (e.g. 1,024 spare sectors). If the drive recognizes a sector as bad, it will stop using it. Any requests to read or write to that damaged sector will transparently be redirected to a spare sector. This marking off of a bad sector, and reallocating its data to a spare sector, is called a Reallocation Event. And the total number of sectors that have been reallocated (and so how many of your spare sectors have been used up) is the Reallocated Sector Count.

In this example from one of my own hard drives, 64 sectors were found to be bad. That means that 64 of the drive's spare sectors have been called into use:

ID                             Current  Worst  Threshold  Raw  
=============================  =======  =====  =========  ===
(05) Reallocated Sector Count  192      192    140         64

On this same hard drive, there have been 4 Reallocation Events. This means that there were four occasions where the drive marked sectors as bad, and used spare sectors instead.

ID                             Current  Worst  Threshold  Raw  
=============================  =======  =====  =========  ===
(05) Reallocated Sector Count  192      192    140         64
(C4) Reallocated Event Count   196      196    0            4

What if it can't ever read the data?

These actions of re-reading sectors, consuming spares, all behind the computer's back is a good thing. It means the host operating system doesn't have to deal with the issue of failing sectors. The drive itself can handle those details itself.

Bonus Chatter: In the olden days, your hard drive shipped with a sticker fastened to it. This sticker contained the Factory Defect List; the list of all known bad spots on the drive.

enter image description here

If you performed a low-level format of the drive, you had to use a tool to type in all the Cylinder-Head-Sector locations of the bad spots.
SCSI drives have a command, IOCTL_DISK_REASSIGN_BLOCKS, to tell them to reallocate a bad spot on the drive after the operating system detects it. In IDE drives this all happens automatically, without the need for operating system intervention.

Ideally the drive would recognize the sector is failing, move the data to a spare sector, and never use the original sector again. But what happens if the drive hasn't been able to read the sector successfully?

This is what Pending Sectors are. The drive has detected that a sector is failing, and needs to be remapped to a spare. But it cannot do that until it can successfully read the data. When the drive knows that a sector is bad, and needs to be remapped, but it cannot do it yet because it's waiting to get a good read from the sector: that's called the Pending Sector Count:

ID                             Current  Worst  Threshold  Raw  
=============================  =======  =====  =========  ===
(05) Reallocated Sector Count  192      192    140         64
(C4) Reallocated Event Count   196      196    0            4
(C5) Current Pending Sector    100      100    0            2

My hard drive has 2 sectors that the drive recognizes as bad, but cannot be reallocated yet. If you were to read one of these ‘Pending sectors’, the drive would likely retry (and retry, and retry), and eventually return a read error to the host operating system:

enter image description here

Give up on the pending sector and it will get reallocated

There are two ways that the drive can finally reallocate the sector, and consume another spare sector:

  • it finally gets a good read
  • you don't care what's in the sector anymore

If the drive finally read the sector, then it knows that it can reallocate the sector.

The other way the drive can reallocate the sector is if you let it know that the contents of that sector are irrelevant; that you don't care what's in it anymore. How do you do that?

By writing something new to the sector.

Whenever you read from, or write to, a sector on a hard drive, you have to read/write the entire 512-byte sector1. You are not able to write only part of a sector. When the OS writes data to a sector, it has to specify the entire 512-bytes. If you tell the hard drive that you want these new contents to replace this bad sector, the drive then knows you don't even care what's currently in the bad sector. It can then Reallocate a bad sector to one of the spares, and the sector is no longer Pending.

This is why when people ask about having some Current Pending Sectors, the common advice is to use a tool (such as Western Digital's Data LifeGuard) to write all zeros to the drive.

enter image description here

By writing zeros to every sector on the drive, you are telling the drive that it can finally reallocate all those pesky pending sectors. After the wipe, all your Pending Sectors will become Reallocated Sectors:

ID                             Current  Worst  Threshold  Raw  
=============================  =======  =====  =========  ===
(05) Reallocated Sector Count  192      192    140         66
(C4) Reallocated Event Count   196      196    0            5
(C5) Current Pending Sector    100      100    0            0

Note: It's not strictly necessary to use a "low level" tool like Western Digital's Data LifeGuard. If you instruct Windows to perform a full format (i.e. non-Quick format) of a volume, it will write zeros to every sector in the volume.

The OS filing system supports marking sectors as bad

Armed with this knowledge, we'll explore a commonly confusing scenario.

Before the advent of Integrated Drive Electronics (IDE), the host operating system was responsible for detecting bad sectors, retrying the reads, moving data to another sector, and marking old sectors as bad.

If you were to run a chkdsk /r c: using the host operating system, it would recognize that the "pending" sectors are bad, and mark them as bad itself, and never try to use them again:

> C:\Windows\system32>chkdsk /r c:
The type of the file system is NTFS.
Volume label is OS.
    12 KB in bad sectors.

So assuming a 512-byte sector hard drive, 12 KB of ‘Pending Sectors’ or in this example 12KB marked by the OS as ‘bad sectors’, that would correspond to decimal 24 or hexadecimal 0x18 as would be shown by a S.M.A.R.T. disk utility such as Crystal Disk Information:

ID   Attribute Name            Current  Worst  Threshold  Raw  
=============================  =======  =====  =========  ===
(C5) Current Pending Sector    100      100    0           18

Note: Western Digital’s Data LifeGuard v1.31 (latest as of 8/31/2017) utility does not appear to show the current S.M.A.R.T. ‘Raw’ counter values correctly.

Now if you perform a full format (which writes zeros to every sector in the volume):

enter image description here

That means all those sectors that were Pending are going to get reallocated. It is now safe for the filing system to use those sectors again. In order to instruct the filing system that those sectors are no longer "bad", you perform an option where it reevaluates bad sectors:

>chkdsk c: /B

where the command documentation says

/B              NTFS only: Re-evaluates bad clusters on the volume
                (implies /R)

Or

According to: https://docs.microsoft.com/en-us/windows-server/administration/windows-commands/chkdsk

Parameter Description
/B Use with NTFS only. Clears the list of bad clusters on the volume and rescans all allocated and free clusters for errors. /b includes the functionality of /r. Use this parameter after imaging a volume to a new hard disk drive.

This was a whole lotta writing, and a whole lotta screenshots, for something that will never be read.

Pang
  • 1,017
Ian Boyd
  • 23,066
7

You don't need to do anything - yet. The reallocation count means "disk found defective sector and successfully reallocated it". The firmware already fixed the issue.

You just need to be aware that the drive is starting to fail. At some point in the future, the drive won't have spare sectors left for the reallocation and you will lose data. If some important block is lost, you might lose all the data on the drive.

So keep an eye on this value or buy a new drive right away so you can forget about it.

2

I had good experience with the method describe here https://www.smartmontools.org/wiki/BadBlockHowto. My disk was making noise and stop working so I use smart report and the formula to calculate the bad block and use dd to clear it. I was lucky because smart is still reporting a current sector count but the disk is working since 2 years or so. I did bought a replacement but I've never used it. It seems to me that smart isn't that accurate either.

Anton
  • 138
Cybercartel
  • 1,962
2

Maybe you do not know this tool: HD Sentinel

Hard Disk Sentinel (HDSentinel) is a multi-OS SSD and HDD monitoring and analysis software. Its goal is to find, test, diagnose and repair hard disk drive problems, report and display SSD and HDD health, performance degradations and failures. Hard Disk Sentinel gives complete textual description, tips and displays/reports the most comprehensive information about the hard disks and solid state disks inside the computer and in external enclosures (USB hard disks / e-SATA hard disks). Many different alerts and report options are available to ensure maximum safety of your valuable data.

This seems to be a great tool to do such actions. But take care, some run options can completely destroy data.

slhck
  • 235,242
Estevan TH.
  • 129
  • 1
1

You cannot force the firmware to reallocate your pending sectors as there might be not enough spare sectors for reallocation. But overwritting the content of a pending sector the firmware learns that its content is abandoned and will try to remap that sector if possible.

In the windows world you can use an outdated version of the Western Digital tool which is writing zeros to every sector. WD limited the zeroing support for new versions of this tools by not allowing to zeroing out a full drive - for undisclosed reasons. :)

In the linux world you would use dd or ddrescue writing a stream of zeros inputting from the zero device dd if=/dev/zero of=/dev/sdX where X denotes the drive to be erased.

I removed the partitions, recreated them again and formatted the entire drive. I ran chkdsk /r /f I ran the BIOS disk check utility and other diagnose/repair tools

Except for partitioning and quick formating the drive afterwards the rest of your operations is unnecessary.

Ian Boyd (first answer) is wrong right from the start when stating:

Spare Sectors

Most modern drives contain a number of "spare" sectors (e.g. 1,024 spare sectors). If > the drive recognizes a sector as bad, it will stop using it. Any requests to read or write to that damaged sector will transparently be redirected to a spare sector.

No! A read request does not trigger the remapping of sector, only a write request can do that assuming there are spare sectors left. Any following read attempts will try to get information out of the sector in question unless there is no write operation on this sector.

This is the reason why a drive on the operating system seems to hang when experiencing such a situation.

As for the post of Estevan TH. about HDD sentinel which claims to "repair hard disk drive problems" I pretend that there is no repair for hardware problems such as pending sectors in software. Remapping is not repair. For file system problems you have your chkdsk command on a Windows machine. Any free SMART monitoring software can monitor changes at the hardware level but there is not necessarily a SMART warning before any drive failure.

As for the post of Danwatts [... SpinRite now brings its legendary data recovery and drive maintenance magic to the latest file systems ...]

Due to the advertised "drive maintenance magic" I consider it as much as snake oil as I do for "HDD sentinel".

Full format does not necessarily trigger a remapping of a pending sector because it works on file system level inside a partition.

There could be other partitions containing pending sectors, the space between partitions can contain pending sectors - although rarely been read, and finally other structures like MBR and partion tables can contain pending sectors as well.

As for the post of Chris Abbott,

modern drive are not being low-level formated by operating systems. Writing zeros to a sector has to be considered as a "high level" operation.

Low level takes places when you are able to write the full content of a sector including the information the operating system never sees. This will involve more than the typical 512 or 4096 bytes of today's sectors and is being handled by the firmware of the drive.

r2d3
  • 4,050
1

You need to use a tool that writes to every sector of the drive. Otherwise, there's no way to do it. If the drive allocated a spare sector and remapped, what data should it put in the spare sector? It has no idea, since its attempt to read from the existing sector failed. Only a write operation can clear the error.

0

To add another solution, I recently used Victoria to repair 2 disks that failed with pending sectors, yet the disk wouldn't remap them automatically on it's own.

Victoria is a low level graphical interface to your disk, and includes (if you really want to!) actual byte by byte editing of the disk, force sector remapping on failures, supports USB drives and those cheap China-bay USB-2-sata adaptors, change factory set smart attributes and features, and more.

The downside - it's developed by a Russian developer, and I leave you to open that Pandora's box if you have issues with it...

With Victoria, I grabbed the first sector that failed to remap, ran a "Read" scan of each sector after that with a force remap. I then ran a "Verify" of the entire disk, re-ran the smart check, and it is now fine...

...But, I have spare disks, so I'm in the process of swapping them out now. This was a little scary, as I'm also between backup solutions, of all times!

KolonUK
  • 230
0

Zero write, otherwise known as Low Level Format. You can only do this with a manufacturer disk utility usually. If there is a hard drive failure causing this error it may come back almost right away.

0

Try Spinrite 6 or HDD regenerator bootable CDs. They do write surface tests so it should clear out the pending bad sectors and bump up the reallocated count.