Forum Discussion

Jeff_Riechers's avatar
Jeff_Riechers
Copper Contributor
Mar 04, 2024

VMXnet3 Server 2025 performance issues

Had an odd one crop up today.  I updated my Server 2025 template to the 26063.1 release and then sysprepped it.  Converted it back to a new VM and network performance was .25 Mbps down.  Both on my local lan and on the internet.

 

I removed the VMXnet3 and put in an E1000 and performance was exactly as expected.

 

I shut the VM down, removed the E1000 put in a new network with vmxnet3 and again got horrible performance.

 

I have not seen this with other deployments of 2025 earlier builds.

  • philippeannet's avatar
    philippeannet
    Occasional Reader

    Got a similar issue with a W11 VM on an Intel MBP (MacOS 15.3) with Fusion Pro... Speedtest.net gets me a solid 450-500Mbps upload, but barely half of that in download (???????????), although the host gets 6-700Mbps in download... I played with all possible offloads in the adapter settings (VMXnet3 and e1000), same story, pretty incomprehensible !!

  • MysticFoxDE's avatar
    MysticFoxDE
    Brass Contributor

    Hi Jeff,
    which NIC exactly (manufacturer type) does your ESXi use as an uplink interface for the corresponding vSwitch?

    My crystal ball tells me that maybe VMQ is activated on the VMXnet3 vNIC, but that this is not configured correctly in terms of hardware.
    You can try VMXnet3 without VMQ, which should run much better and would also confirm my suspicions.
    But, without VMQ or SR-IOV, you can't really utilize a 10G or even faster vNIC.

    As mentioned, you should also deactivate both RSC in the VM and its counterpart, i.e. TSO in the ESXi.

    Best Regards from Germany
    Alex

  • Bhanous's avatar
    Bhanous
    Copper Contributor

    E1000 are not supported in some scenarios. Jeff could it be that the RSS / RSC config got compromised or receive buffers?

  • alexeybes's avatar
    alexeybes
    Copper Contributor

    I had same issues. After I disabled all kinds of "offloads" and "interruptions" options VMXnet3 works fine.

    • Jeff_Riechers's avatar
      Jeff_Riechers
      Copper Contributor

      I have moved back to E1000 at this point so I can use NVMe memory tiering.  Some people have started seeing issues with Windows 11 24H2 as well.  Do you have a breakdown of the mods you did so I can test them in my lab?

      • alexeybes's avatar
        alexeybes
        Copper Contributor

        Control Panel - Network and Sharing Center - Change adapter settings
        Right Click on vmxnet3 Ethernet Adapter - Properties - Configure... - Advanced

        Interrupt Coalescing Sheme Mode - Disabled
        Interrupt Moderation - Disabled
        IPv4 Checksum Offload - Disabled
        IPv4 TSO Offload - Disabled
        Large Send Offload V2 (IPv4) - Disabled
        Large Send Offload V2 (IPv6) - Disabled
        Offload IP Option - Disabled
        Offload tagged traffic  - Disabled
        Offload TCP Option - Disabled
        Priority / VLAN tag - Priority & VLAN Disabled
        Receive Side Scaling - Disabled
        Recv Segment Coalescing (IPv4) - Disabled
        Recv Segment Coalescing (IPv6) - Disabled
        Speed & Duplex - 10 Gbps Full Duplex
        TCP Checksum Offload (IPv4) - Disabled
        TCP Checksum Offload (IPv6) - Disabled
        UDP Checksum Offload (IPv4) - Disabled
        UDP Checksum Offload (IPv6) - Disabled

        I'm not sure which one helped.
        Didn't have time to check one-by-one.

  • aru_vmw's avatar
    aru_vmw
    Copper Contributor
    Hi Jeff
    Do you still see the problem reproduced with 26080 build?
    • jeffriechers's avatar
      jeffriechers
      Copper Contributor
      2025 has gotten better. But as soon as I enable RDS on it the performance tanks. Just was testing out the latest pre-releases and still seeing this.
      • Karl-WE's avatar
        Karl-WE
        MVP

        Hi Jeff what about the b26100 and December LCU? 

  • J_Hawkins1460's avatar
    J_Hawkins1460
    Copper Contributor

    Jeff_Riechers Delete your ghost NIC and your vmxnet driver. When you add the new NIC it'll poll for the actual VMware tools driver vs what it thinks works. Sysprep seems to do this in 2019+ sometimes if you don't have the drivers manually added to drivers and just VMware tools. E1000 will always work.

    • Karl-WE's avatar
      Karl-WE
      MVP
      E1000 are not supported in some scenarios. Jeff could it be that the RSS / RSC config got compromised or receive buffers?
      • jeffriechers's avatar
        jeffriechers
        Copper Contributor

        Karl-WE I don't see how. I have built machines from templates, and from ISO.  All seem to fail.  Same hardware 2022, 2019, 10 and 11, Debian and Ubuntu all run fine.  Just 2025 seems to not like vmxnet3.

         

        It is VMWare 7 still, so it could be something with that build of ESX.

  • aru_vmw's avatar
    aru_vmw
    Copper Contributor

    Jeff_Riechers

    Could you provide further information about your setup? For example, which version of ESXi are you using? Also, what is the version of the vmxnet3 driver?how many vCPU you allocated to your VM?

     

Resources