Michael Vargo | Senior Support Escalation Engineer
UPDATED 1/6/2014 – New hotfixes available
Some customers are experiencing failures on Windows Server 2012 Hyper-V hosts that utilize Cluster Shared Volumes (CSVs) when backing up virtual machines (VM’s) using System Center 2012 Data Protection Manager (DPM 2012) with Service Pack 1 (SP1) or later.
When this occurs the following error is logged on the Hyper-V hosts.
Log Name: System Source: Microsoft-Windows-FailoverClustering Event ID: 5120 Logged: <date/time> Details: Cluster Shared Volume 'Volume2' ('ClusterStorage Volume 2') is no longer available on this node because of 'STATUS_CLUSTER_CSV_AUTO_PAUSE_ERROR(c0130021)'. All I/O will temporarily be queued until a path to the volume is reestablished.
You may also see the VM’s pause temporarily, go in to a paused state, shut down, see memory spikes or CSV go into a failed state on the Hyper-V hosts. Configuring serialized backups doesn't help the problem.
It has been determined that any backup product using shadow copies results in the same errors, thus this isn't necessarily a DPM 2012 issue.
The Windows and DPM teams have released a series of fixes to address some general Cluster, CSV backup and DPM issues and are now available for download.
KB2886362 - Hotfix for System Center 2012 SP1 Data Protection Manager (http://www.microsoft.com/en-us/download/details.aspx?id=40318)
NOTE The above fix requires a prerequisite fix: 2836751 - Description of Update Rollup 3 for System Center 2012 Service Pack 1 (http://support.microsoft.com/kb/2836751/EN-US)
KB2878635 - Update is available that improves the resiliency of the cloud service provider in Windows Server 2012: December 2013 (http://support.microsoft.com/kb/2878635/EN-US)
Also see KB2784261 - Recommended hotfixes and updates for Windows Server 2012-based Failover Clusters (http://support.microsoft.com/kb/2784261/EN-US)
Michael Vargo | Senior Support Escalation Engineer | Microsoft GBS Management and Security Division
Get the latest System Center news on Facebook and Twitter:
System Center All Up: http://blogs.technet.com/b/systemcenter/ System Center – Configuration Manager Support Team blog: http://blogs.technet.com/configurationmgr/ System Center – Data Protection Manager Team blog: http://blogs.technet.com/dpm/ System Center – Orchestrator Support Team blog: http://blogs.technet.com/b/orchestrator/ System Center – Operations Manager Team blog: http://blogs.technet.com/momteam/ System Center – Service Manager Team blog: http://blogs.technet.com/b/servicemanager System Center – Virtual Machine Manager Team blog: http://blogs.technet.com/scvmm
Windows Intune: http://blogs.technet.com/b/windowsintune/ WSUS Support Team blog: http://blogs.technet.com/sus/ The AD RMS blog: http://blogs.technet.com/b/rmssupp/
The Forefront Endpoint Protection blog : http://blogs.technet.com/b/clientsecurity/ The Forefront Identity Manager blog : http://blogs.msdn.com/b/ms-identity-support/ The Forefront TMG blog: http://blogs.technet.com/b/isablog/ The Forefront UAG blog: http://blogs.technet.com/b/edgeaccessblog/
Any idea when the final hotfix will be released? It's been quite some time now.
C'mon MSFT it's been like three months
also using lun and host serialization on dpm side will minimize the impact of error 5120/5142
Is this fixed? I see there is an update, but the TechNet forums look like folks are still experiencing issues.
I'm glad to see that R2 is coming out, but maybe instead some effort can be put into fixing this once and for all?
sad that there is nothing but SILENCE about this
Some of the confusion may stem from the fact that this is affected by a few different things, so the update in the post may fix things in one scenario but not for another. On a positive note, there is a new update that should make things work much more seamlessly.
KB2848344 - Update improves cluster resiliency in Windows Server 2012 (support.microsoft.com/.../2848344)
Note that this replaces KB2838669 mentioned in the post above. If you continue to see problems protecting Windows Server 2012 Hyper-V guests after installing this hotfix please open a support case for further investigation.
Installed both Hotfixes (KB2838669 & KB2848344) but still having the issue. This is ridiculous. How could Microsoft's own products not work together properly.
We still have this issue...on 2012 cluster and using dpm 2012 R2 and have the rollup hotfix KB2870270 installed.
This has been a problem on 2008 R2 cluster as-well, we have never been able to do host level backup's on the Microsoft clusters....
Good day. The contribution to the community is great, and I read the publication arose a question. The company has a Storage IBM V3700. Currently scdpm want to install a VM with Windows server 2012 presenting an HBA to the VM. I could confirm whether this
is possible or that you should consider. Thanks
Hi... We have same issues but with hyper-v failover cluster 2012 R2 along with SCDPM 2012 R2... Same errors, and same behavior. Are there gonna be any hotfixes or updates that will fix this soon?
We are also experiencing this issue with Windows Server 2012 R2 and SCDPM 2012 R2. The weird thing is it only occurs with one of the two CSVs.
We have this issue on 5node cluster with Hyper-V servers 2012r2 OS with DPM2012R2 and VMM2012R2. Any solution?
We too are seeing errors ID 5120 / 5214 during backup on our 5-node cluster Hyper-V 2012 R2 with CSVs using System Center 2012 R2 DPM. We thought this issue is fixed with 2012 R2. Any idea...?