If these are Windows VMs, have a look at Firewall settings of the VM and allow the ICMP, if not done yet
# For IPv4
netsh advfirewall firewall add rule name="ICMP Allow TCP V4" protocol="icmpv4:8,any" dir=in action=allow
#For IPv6
netsh advfirewall firewall add rule name="ICMP Allow TCP V6" protocol="icmpv6:8,any" dir=in action=allow