network issues

[chris]

So I'm getting intermittent packet loss over ethernet, for all ethernet devices on the network, but everything is fine over wifi.

 

192.168.1.1: router, linksys EA6500 (only broadcasting 802.11ac)

192.168.1.3: my computer, connected to router via an unmanaged switch

192.168.1.39: another computer, also connected to same switch

192.168.1.44: raspberrypi connected directly to the router

192.168.1.50 AP, ENS202EXT (broadcasting n), connected to same switch as 1.3 and 1.39

 

(vpn=192.168.1.44)

root@vpn:~# ping 192.168.1.1PING 192.168.1.1 (192.168.1.1) 56(84) bytes of data.64 bytes from 192.168.1.1: icmp_req=1 ttl=64 time=59.5 ms64 bytes from 192.168.1.1: icmp_req=2 ttl=64 time=60.2 ms64 bytes from 192.168.1.1: icmp_req=4 ttl=64 time=64.1 ms64 bytes from 192.168.1.1: icmp_req=5 ttl=64 time=64.0 ms^C--- 192.168.1.1 ping statistics ---6 packets transmitted, 4 received, 33% packet loss, time 5006msrtt min/avg/max/mdev = 59.539/61.981/64.112/2.112 msroot@vpn:~# ping 192.168.1.3PING 192.168.1.3 (192.168.1.3) 56(84) bytes of data.64 bytes from 192.168.1.3: icmp_req=1 ttl=128 time=1.89 ms64 bytes from 192.168.1.3: icmp_req=2 ttl=128 time=0.714 ms64 bytes from 192.168.1.3: icmp_req=3 ttl=128 time=1.15 ms64 bytes from 192.168.1.3: icmp_req=4 ttl=128 time=0.678 ms64 bytes from 192.168.1.3: icmp_req=5 ttl=128 time=0.831 ms^C--- 192.168.1.3 ping statistics ---5 packets transmitted, 5 received, 0% packet loss, time 4005msrtt min/avg/max/mdev = 0.678/1.053/1.892/0.452 msroot@vpn:~# ping 192.168.1.39PING 192.168.1.39 (192.168.1.39) 56(84) bytes of data.64 bytes from 192.168.1.39: icmp_req=1 ttl=64 time=45.9 ms64 bytes from 192.168.1.39: icmp_req=2 ttl=64 time=20.6 ms64 bytes from 192.168.1.39: icmp_req=3 ttl=64 time=21.8 ms64 bytes from 192.168.1.39: icmp_req=4 ttl=64 time=19.2 ms64 bytes from 192.168.1.39: icmp_req=5 ttl=64 time=20.4 ms64 bytes from 192.168.1.39: icmp_req=6 ttl=64 time=23.0 ms

(from 192.168.1.3 over 802.11n)

C:\Users\whyrlpool>ping 192.168.1.1Pinging 192.168.1.1 with 32 bytes of data:Reply from 192.168.1.1: bytes=32 time=35ms TTL=64Reply from 192.168.1.1: bytes=32 time=13ms TTL=64Reply from 192.168.1.1: bytes=32 time=16ms TTL=64Reply from 192.168.1.1: bytes=32 time=19ms TTL=64Ping statistics for 192.168.1.1:    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),Approximate round trip times in milli-seconds:    Minimum = 13ms, Maximum = 35ms, Average = 20msC:\Users\whyrlpool>ping 192.168.1.44Pinging 192.168.1.44 with 32 bytes of data:Reply from 192.168.1.44: bytes=32 time=6ms TTL=64Reply from 192.168.1.44: bytes=32 time=74ms TTL=64Reply from 192.168.1.44: bytes=32 time=76ms TTL=64Reply from 192.168.1.44: bytes=32 time=75ms TTL=64Ping statistics for 192.168.1.44:    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),Approximate round trip times in milli-seconds:    Minimum = 6ms, Maximum = 76ms, Average = 57ms

(switched to ethernet here)

C:\Users\whyrlpool>ping 192.168.1.1Pinging 192.168.1.1 with 32 bytes of data:Reply from 192.168.1.1: bytes=32 time=60ms TTL=64Reply from 192.168.1.1: bytes=32 time=80ms TTL=64Reply from 192.168.1.1: bytes=32 time=58ms TTL=64Reply from 192.168.1.1: bytes=32 time=60ms TTL=64Ping statistics for 192.168.1.1:    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),Approximate round trip times in milli-seconds:    Minimum = 58ms, Maximum = 80ms, Average = 64msC:\Users\whyrlpool>ping 192.168.1.44Pinging 192.168.1.44 with 32 bytes of data:Reply from 192.168.1.44: bytes=32 time=1ms TTL=64Reply from 192.168.1.44: bytes=32 time<1ms TTL=64Reply from 192.168.1.44: bytes=32 time<1ms TTL=64Reply from 192.168.1.44: bytes=32 time<1ms TTL=64Ping statistics for 192.168.1.44:    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),Approximate round trip times in milli-seconds:    Minimum = 0ms, Maximum = 1ms, Average = 0ms

is it just me or do these just make no sense?

I'm getting intermittent packet loss over ethernet to the router, which is what i'm trying to fix. I rebooted the router, AP, and switch, and after rebooting the router everything was fine for 2-3 minutes but then returned to getting packet loss. In addition to this, when i get packet loss my download speed drops to about .1mbps but my upload speed seems unaffected at 12mbps

 

this is when I start getting packet loss:

C:\Users\whyrlpool>ping google.comPinging google.com [62.253.72.168] with 32 bytes of data:Reply from 62.253.72.168: bytes=32 time=132ms TTL=59Request timed out.Reply from 62.253.72.168: bytes=32 time=143ms TTL=59Reply from 62.253.72.168: bytes=32 time=125ms TTL=59Ping statistics for 62.253.72.168:    Packets: Sent = 4, Received = 3, Lost = 1 (25% loss),Approximate round trip times in milli-seconds:    Minimum = 125ms, Maximum = 143ms, Average = 133ms

C:\Users\whyrlpool>ping 192.168.1.1Pinging 192.168.1.1 with 32 bytes of data:Request timed out.Reply from 192.168.1.1: bytes=32 time=58ms TTL=64Reply from 192.168.1.1: bytes=32 time=63ms TTL=64Request timed out.Ping statistics for 192.168.1.1:    Packets: Sent = 4, Received = 2, Lost = 2 (50% loss),Approximate round trip times in milli-seconds:    Minimum = 58ms, Maximum = 63ms, Average = 60ms

 

 

[Neil]

Is there anything saturating the network during those times?

 

What is the switch everything is connected to?

[chris]

Is there anything saturating the network during those times?

 

What is the switch everything is connected to?

two web browsers, no p2p, nothing saturating the network. The switch is a 5 port ProSafe.

[chris]

So after some poking around, it appears my router is at 100% CPU usage

top -bn1Mem: 76880K used, 47476K free, 0K shrd, 9068K buff, 30480K cachedCPU:  0.0% usr 16.6% sys  0.0% nic  0.0% idle  0.0% io  0.0% irq 83.3% sirqLoad average: 1.40 1.33 1.19 2/84 18773  PID  PPID USER     STAT   VSZ %MEM CPU %CPU COMMAND    4     2 root     RW<      0  0.0   0 94.1 [events/0]18773 18674 root     R     1928  1.5   0  5.8 top -bn1  5544  5540 root     S <   8676  6.9   0  0.0 /usr/bin/guardian  5434     1 root     S <   8676  6.9   0  0.0 /usr/bin/guardian  5543  5540 root     S <   8676  6.9   0  0.0 /usr/bin/guardian  5547  5540 root     S <   8676  6.9   0  0.0 /usr/bin/guardian  5545  5540 root     S <   8676  6.9   0  0.0 /usr/bin/guardian  5546  5540 root     S <   8676  6.9   0  0.0 /usr/bin/guardian  5540  5434 root     S <   8676  6.9   0  0.0 /usr/bin/guardian  4831     1 root     S     8248  6.6   0  0.0 devidentd -r /tmp/devregex.json -p 4866     1 root     S     7260  5.8   0  0.0 lighttpd -f /etc/lighttpd.conf 

UpTime: 14:09:11 up  1:18, load average: 1.35, 1.31, 1.18

QoS is off, and i'm not sure whats causing this

[superfly06]

run this command on a computer. 

tracert 192.168.1.44

[chris]

run this command on a computer. 

tracert 192.168.1.44

C:\Users\whyrlpool>tracert 192.168.1.44Tracing route to vpn [192.168.1.44]over a maximum of 30 hops:  1    <1 ms    <1 ms    <1 ms  vpn [192.168.1.44]Trace complete.

[chris]

So after some poking around, it appears my router is at 100% CPU usage

top -bn1Mem: 76880K used, 47476K free, 0K shrd, 9068K buff, 30480K cachedCPU:  0.0% usr 16.6% sys  0.0% nic  0.0% idle  0.0% io  0.0% irq 83.3% sirqLoad average: 1.40 1.33 1.19 2/84 18773  PID  PPID USER     STAT   VSZ %MEM CPU %CPU COMMAND    4     2 root     RW<      0  0.0   0 94.1 [events/0]18773 18674 root     R     1928  1.5   0  5.8 top -bn1  5544  5540 root     S <   8676  6.9   0  0.0 /usr/bin/guardian  5434     1 root     S <   8676  6.9   0  0.0 /usr/bin/guardian  5543  5540 root     S <   8676  6.9   0  0.0 /usr/bin/guardian  5547  5540 root     S <   8676  6.9   0  0.0 /usr/bin/guardian  5545  5540 root     S <   8676  6.9   0  0.0 /usr/bin/guardian  5546  5540 root     S <   8676  6.9   0  0.0 /usr/bin/guardian  5540  5434 root     S <   8676  6.9   0  0.0 /usr/bin/guardian  4831     1 root     S     8248  6.6   0  0.0 devidentd -r /tmp/devregex.json -p 4866     1 root     S     7260  5.8   0  0.0 lighttpd -f /etc/lighttpd.conf 

UpTime: 14:09:11 up  1:18, load average: 1.35, 1.31, 1.18

QoS is off, and i'm not sure whats causing this

Also to note: lighttpd is running on port 10000 on this router, which i hadnt picked up before, all it shows is 403: Forbidden though

[techguru]

are you using ddwrt?

and if so ...is it the newest version

[chris]

are you using ddwrt?

and if so ...is it the newest version

 

nope, using standard firmware (latest version available for this revision)

Firmware Version: 1.1.29.162351Firmware Builddate: 2014-07-16 10:59Product.type: productionLinux: Linux version 2.6.22 (root@build-vm) (gcc version 4.2.3) #1 PREEMPT Wed Jul 16 03:00:48 PDT 2014Board: carrera

[superfly06]

the load average u got b4 was in % so it was 1.35% utilisation thats fine

the path between your computer to the raspberry pi is fine 

run this

tracert google.com

this will test your computer to router to google

[chris]

the load average u got b4 was in % so it was 1.35% utilisation thats fine

the path between your computer to the raspberry pi is fine 

run this

tracert google.com

this will test your computer to router to google

CPU: 0.0% usr 16.6% sys 0.0% nic 0.0% idle 0.0% io 0.0% irq 83.3% sirq

also I recommend you read this guide about load averages: http://www.howtogeek.com/194642/understanding-the-load-average-on-linux-and-other-unix-like-systems/

1.35, -> system overloaded by 35% average over past 1 minute

1.31, -> system overloaded by 31% average over past 5 minutes

1.18 -> system overloaded by 18% average over paste 15 minutes

 

so the router is overloaded.

 

nevertheless, here's the traceroute you wanted 

$ tracert google.comTracing route to google.com [62.253.72.148]over a maximum of 30 hops:  1    54 ms    56 ms    57 ms  NSACollectionHu [192.168.1.1]  2     *      130 ms   118 ms  cpc4-enfi18-2-0-gw.20-2.cable.virginm.net [77.99.180.1]  3   126 ms     *        *     hari-core-2a-ae7-627.network.virginmedia.net [81.96.18.61]  4   133 ms   123 ms   125 ms  brnt-bb-1a-ae8-0.network.virginmedia.net [81.96.16.201]  5   126 ms   121 ms   117 ms  brnt-icdn-1-ae0-0.network.virginmedia.net [62.254.84.18]  6     *       16 ms    19 ms  148.72-253-62.static.virginmediabusiness.co.uk [62.253.72.148]Trace complete.

[chris]

from what i can glean from google, sirq is using 83% CPU usage to handle ethernet interrupts, which would explain why it has such high latency over ethernet.

Anyone got any ideas about how to fix this?

[techguru]

install a good 3rd party firmware first of all

then we can see if theres still a problem

[superfly06]

the only thing i can think of is re flash the router or you are suffering a ddos attack which is unlikely

[chris]

dmesg | tail -200:xt_TCPMSS: bad length (1047 bytes)printk: 45952 messages suppressed.xt_TCPMSS: bad length (1047 bytes)printk: 45995 messages suppressed.xt_TCPMSS: bad length (1047 bytes)printk: 45950 messages suppressed.(same thing over and over)

it would appear something is causing a shitload of CPU utilisation whenever I get packet loss, and xt_TCPMSS: bad length shows up a LOT in dmesg

[chris]

gonna try flashing dd-wrt

[MrStraightface]

 

So I'm getting intermittent packet loss over ethernet, for all ethernet devices on the network, but everything is fine over wifi.

 

192.168.1.1: router, linksys EA6500 (only broadcasting 802.11ac)

192.168.1.3: my computer, connected to router via an unmanaged switch

192.168.1.39: another computer, also connected to same switch

192.168.1.44: raspberrypi connected directly to the router

192.168.1.50 AP, ENS202EXT (broadcasting n), connected to same switch as 1.3 and 1.39

 

(vpn=192.168.1.44)

 

Are those static IP addresses?  If yes, what is your DHCP range pool on the router?  How about the AP?

 

Since you're broadcasting two seperate wifi bands (one on the router and one on the AP) am I correct in assuming you would need a completely separate DHCP pool for the AP that is broadcasting N?

 

Also, make sure that AP's default gateway is the IP of your router.

[dzonidev]

I have a feeling that something in the ISP network might be attacking your router, check the logs for any dropped inbound connections. Also disable the firewall I wonder if that will lower the CPU usage..

[chris]

Are those static IP addresses?  If yes, what is your DHCP range pool on the router?  How about the AP?

 

Since you're broadcasting two seperate wifi bands (one on the router and one on the AP) am I correct in assuming you would need a completely separate DHCP pool for the AP that is broadcasting N?

 

Also, make sure that AP's default gateway is the IP of your router.

all static, DHCP is handled by the router regardless of which AP it's connected to.

[chris]

ok so I installed DD-WRT, and it still spiked once, but as far as i can tell the issue has gone away, for now at least.

[chris]

nope, still getting 99-100% sirq at seemingly random times which effectively prevent network access.

Also happened when the router was disconnected from the modem, so I'm not sure what's causing it.

[chris]

Time: 00:19:21 up 19 min, load average: 2.12, 2.16, 1.56

/var/log/messages on DD-WRT shows nothing.

[dzonidev]

Time: 00:19:21 up 19 min, load average: 2.12, 2.16, 1.56

/var/log/messages on DD-WRT shows nothing.

 

 

Well I guess it's time to contact Linksys and replace the device. Just flash it back to stock. In my opinion you pretty much ruled out every possible cause.

[Neil]

Time: 00:19:21 up 19 min, load average: 2.12, 2.16, 1.56

/var/log/messages on DD-WRT shows nothing.

Give us a top and also a

free -m

[Neil]

Sorry for the double post... But also. What vpn server are you running? I have a feeling that might be the issue if it's running broadcasts. Would explain the high ethernet usage on the router.