DL185 G6 server with poor ethernet speed

I picked up this server for like $20 and just using it for my homelab setup. The problem is that the ethernet speeds are peaking at 8MB/s on the LAN and even worse to the internet down to like 5MB/s. This would normally point to being connected at 100Mbps but both server and router are reporting a 1000Mbps link. This is both pulling to server and pushing out which rules out drive speeds. Plus testing on SSD. My computer will do gigabit speeds connected to same router. I have used the same cable on the server with no change. Running Proxmox on Debian with kernel 5.3.18-2-pve. Any ideas or suggestions would be greatly appreciated

ethtool:

Settings for enp2s2f0:
        Supported ports: [ TP ]
        Supported link modes:   10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
                                1000baseT/Half 1000baseT/Full
        Supported pause frame use: No
        Supports auto-negotiation: Yes
        Supported FEC modes: Not reported
        Advertised link modes:  10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
                                1000baseT/Half 1000baseT/Full
        Advertised pause frame use: Symmetric
        Advertised auto-negotiation: Yes
        Advertised FEC modes: Not reported
        Link partner advertised link modes:  10baseT/Half 10baseT/Full
                                             100baseT/Half 100baseT/Full
                                             1000baseT/Full
        Link partner advertised pause frame use: Symmetric
        Link partner advertised auto-negotiation: Yes
        Link partner advertised FEC modes: Not reported
        Speed: 1000Mb/s
        Duplex: Full
        Port: Twisted Pair
        PHYAD: 1
        Transceiver: internal
        Auto-negotiation: on
        MDI-X: off
        Supports Wake-on: g
        Wake-on: g
        Current message level: 0x000000ff (255)
                               drv probe link timer ifdown ifup rx_err tx_err
        Link detected: yes

lspci:

Ethernet controller: Broadcom Limited NetXtreme BCM5704 Gigabit Ethernet (rev 10)