You rebooted your server hosted in VMware ESXi environment and got error “Duplicate IP address detected on your network” specifically when you are using Cisco switches for your routing needs. Well, you do not need to worry anymore, we have a workaround for you.
With Microsoft Windows Vista and later versions, Microsoft introduced a new mechanism that is used in order to detect duplicate addresses on the network when the DHCP process occurs. This new detection flow is described in RFC 5227.
One of the triggers for this detection flow is defined in section 2.1.1:
In addition, if during this period the host receives any ARP Probe where the packet’s ‘target IP address’ is the address being probed for, and the packet’s ‘sender hardware address’ is not the hardware address of any of the host’s interfaces, then the host SHOULD similarly treat this as an address conflict and signal an error to the configuring agent as above. This can occur if two (or more) hosts have, for whatever reason, been inadvertently configured with the same address, and both are simultaneously in the process of probing that address to see if it can safely be used.
Cisco IOS® uses the Address Resolution Protocol (ARP) Probe that is sourced from an address of 0.0.0.0 in order to maintain the IP device-tracking cache during IP device tracking, and a feature that uses it is enabled (such as 802.1x) on a Cisco IOS switch. The purpose of IP device tracking is for the switch to obtain and maintain a list of devices that are connected to the switch via an IP address. The probe does not populate the tracking entry. It is used in order to activate and maintain the entry in the table after it is learned. This IP address is then used when an Access Control List (ACL) is applied to the interface in order to substitute the source address in the ACL with the client IP address. This function is critical whenever access lists are used with 802.1x or any other Flex-Auth function on Cisco switches.
Root Cause of Duplicate IP Address
If the switch sends out an ARP Probe for the client while the Microsoft Windows PC is in its duplicate-address detection phase, then Microsoft Windows detects the probe as a duplicate IP address and presents a message that a duplicate IP address was found on the network for 0.0.0.0. The PC does not obtain an address, and the user must either manually release/renew the address, disconnect and reconnect to the network, or reboot the PC in order to gain network access.
Here is an example of the failed packet sequence:
The Ultimate Solution
There are multiple methods that are used in order to work around this issue. Here is a list of possible workarounds:
The most effective method that is used in order to prevent this issue is to configure the switch so that it sends a non-RFC compliant ARP Probe to source the probe from the Switch Virtual Interface (SVI) in the VLAN where the PC resides. If an SVI is configured for the VLAN and either of the two commands that follow are used, then the sender IP address in the IPDT probes will never be 0.0.0.0. Thus, it is certain that the duplicate IP address error will not occur.
Here is the command format for older code versions:
ip device tracking probe use-svi
This configuration currently does not trigger the duplicate address detection error message in Microsoft Windows. The caveat to this method is that an SVI must exist on every switch in every VLAN where Microsoft Windows clients who run DHCP reside. This method is difficult to scale, so Cisco recommends that you use the IP device-tracking probe delay as the primary method. SVI is not currently available on the 6500 Series Switch platform. This command was implemented in Cisco IOS Version 12.2(55)SE on 2900, 3500, and 3700 Series Switch platforms, and in Version 15.1(1)SG on the 4500 Series Switch platform.
Here is the command format for newer code versions:
ip device tracking probe auto-source fallback <host-ip> <mask> [override]
This latest CLI command was introduced through Cisco bug ID CSCtn27420 in Cisco IOS Version 15.2(2)E. It was added in order to allow a user-defined ARP request source IP address instead of the requirement to use the default source IP address of 0.0.0.0. The new global command ip device tracking probe auto-source fallback 0.0.0.x 255.255.255.0 override allows the user to use the host address of 0.0.0.x in the subnet in order to avoid any duplicate IP address problems. If there is no SVI for a particular VLAN the fallback host-ip will be used to source the probe instead.
The primary non-SVI alternative that is used in order to work around the issue is to delay the probe from the switch so that Microsoft Windows has time to finish the duplicate IP address detection. This is effective only on access ports and link-up scenarios. Enter this command in order to delay the probe:
ip device tracking probe delay 10
The RFC specifies a ten-second window for duplicate address detection, so if you delay the device-tracking probe, it resolves the issue in nearly all cases. In addition to probe-delay, the delay also resets when the switch detects a probe from the PC. For example, if the probe timer has counted down to five seconds and detects an ARP Probe from the PC, the timer resets back to ten seconds. This window can be further reduced if you enable DHCP snooping as well, as this similarly resets the timer. In rare circumstances, the PC sends an ARP Probe milliseconds before the switch sends its probe, which still triggers a duplicate address message to the end user. This command was introduced in Cisco IOS Version 15.0(1)SE on 2900, 3500, and 3700 Series Switch platforms, Version 15.0(2)SG on the 4500 Series Switch platform, and Version 12.2(33)SXI7 on the 6500 Series Switch platform.
Another method that is used in order to resolve this issue involves a troubleshoot of the client in order to determine the reason that duplicate address detection occurs so late after the link comes online. The switch has no way to determine the time that this process occurs, so you must estimate the time that is set for the probe delay in order to prevent the conflict. In order to effectively troubleshoot the reason that duplicate address detection occurs so late, further information on the behavior of the IP device-tracking probe is useful.
The ARP probe is sent under two circumstances:
- A link that is associated with a current entry in the IPDT database moves from a DOWN to an UP state.
- A link already in the UP state that is associated with an entry in the IPDT database has an expired probe interval.
Enter this command in order to set the IP device-tracking probe interval:
ip device tracking probe interval <seconds>
The default interval is thirty seconds. In order to view this information, enter this command:
show ip device tracking all IP Device Tracking = Enabled IP Device Tracking Probe Count = 3 IP Device Tracking Probe Interval = 30 IP Device Tracking Probe Delay Interval = 0 ------------------------------------------------------------ IP Address MAC Address Vlan Interface STATE ------------------------------------------------------------ 10.0.0.1 a820.661b.b384 301 GigabitEthernet0/1 INACTIVE Total number interfaces enabled: 1 Enabled interfaces: Gi0/1
After the initial entry moves from a DOWN to an UP state, no further probes are sent unless the switch does not see traffic from that device for the probe-delay interval. Also, as stated earlier, the conflict only occurs if the PC sends out the ARP Probe milliseconds before the switch sends the ARP Probe (simultaneously).
The final method that is used in order to workaround the issue that is described in this document is to disable duplicate-address detection on the client-side. This procedure is described in the How to Disable the Gratuitous ARP Function Microsoft Support-Base article. Centrally deploy this change in order to make this option more scalable.
To work around this issue, turn off gratuitous ARP in the guest operating system.
Note: This procedure modifies the Windows registry. Before making any registry modifications, ensure that you have a current and valid backup of the registry and the virtual machine. For more information on backing up and restoring the registry, see the Microsoft Knowledge Base article 136393.
To turn off gratuitous ARP in the guest operating system:
- Shut down the guest operating system and power off the virtual machine.
- Change the virtual machine to a network vSwitch with no uplink. You can create one for this procedure.
- Power on the virtual machine and log in.
- Open the Registry editor.
- In Windows XP to Windows Server 2003 – Click Start > Run, type regedit, and click OK.
- In Windows 7 and Current – Click Start, type regedit, and click OK.
- Locate this registry key:
- Click Edit > New, and click DWORD Value.
- Type ArpRetryCount.
- Right-click the ArpRetryCount registry entry and click Modify.
- In the Value box, type and click OK.
- Exit the Registry Editor.
- Shut down the guest operating system and power off the virtual machine.
- Change the virtual machine back to a network vSwitch with the uplink.
- Power on the virtual machine.
Alternatively, you can disable gratuitous ARP on the physical switch.
To disable gratuitous ARP in Cisco IOS, run this command:
# no ip gratuitous-arps
For more information, see the Microsoft TechNet Article ArpRetryCount .
Note: The preceding links were correct as of May 19, 2015. If you find a link is broken, provide the feedback and a VMware employee will update the link.