SR-IOV on 82576 on, VM on VF can not talk to VM on Bridged network

I have set up SR-IOV on a Dell C6145 that has an Intell 82576.

Configuration is

VM1 is assigned a direct VF,  on network 10.10.6.0/22

VM2 on same host is not assigned a VF, and has a bridged network br0 to 10.10.6.0/22

VM3 on same host is also on bridged network br0

Separate Physical machine Ph1 is also on 10.10.6.0/22

Ph1 can ping VM1, VM2, VM3

VM1 can ping Ph1 , but not VM2 or VM3

VM2 can ping VM3 and Ph1

VM3 can ping VM2 and Ph1

using tcpdump on VM1, I can see arp broadcast asking for mac address, and arp tables shows it knows the mac address, but no packets are being delivered/routed.

Is there something I am overlooking?