lost and found ( for me ? )

lost and found ( for me ? )

↑ Grab this Headline Animator

Ubuntu 13.04 : KVM virtio warning log

just a memo for me.
When generating massive traffic from a KVM host to a VM which is running within the KVM host, I saw the following error on the KVM host.
I generated about 30,000 packet/sec with tcpreplay.
KVM host
# tail -1 /etc/lsb-release ;uname -ri
DISTRIB_DESCRIPTION="Ubuntu 13.04"
3.8.0-35-generic x86_64

# qemu-system-x86_64 --version
QEMU emulator version 1.4.0 (Debian 1.4.0+dfsg-1expubuntu4), Copyright (c) 2003-2008 Fabrice Bellard
on the KVM host ( /var/log/syslog )
Jan 16 22:54:31 kvm-host1 kernel: [851574.079105] ------------[ cut here ]------------
Jan 16 22:54:31 kvm-host1 kernel: [851574.079113] WARNING: at /build/buildd/linux-3.8.0/net/core/dev.c:2032 skb_warn_bad_offload+0xcf/0xdc()
Jan 16 22:54:31 kvm-host1 kernel: [851574.079114] Hardware name: foo
Jan 16 22:54:31 kvm-host1 kernel: [851574.079116] : caps=(0x00000000401b4849, 0x0000000000000000) len=2538 data_len=0 gso_size=1480 gso_type=6 ip_summed=3
Jan 16 22:54:31 kvm-host1 kernel: [851574.079117] Modules linked in: nfnetlink_log(F) nfnetlink(F) xt_nat(F) veth(F) xt_addrtype(F) xt_conntrack(F) aufs vhost_net macvtap(F) macvlan(F) xt_multiport(F) ip6table_filter(F) ip6_tables(F) ebtable_nat(F) ebtables(F) xt_state(F) ipt_REJECT(F) xt_CHECKSUM(F) iptable_mangle(F) xt_tcpudp(F) iptable_filter(F) ipt_MASQUERADE(F) iptable_nat(F) nf_conntrack_ipv4(F) nf_defrag_ipv4(F) nf_nat_ipv4(F) nf_nat(F) nf_conntrack(F) ip_tables(F) x_tables(F) bridge(F) stp(F) llc(F) hid_generic usbhid hid coretemp parport_pc(F) ppdev(F) kvm_intel(F) radeon kvm(F) ttm ghash_clmulni_intel(F) drm_kms_helper rfcomm aesni_intel(F) bnep aes_x86_64(F) xts(F) drm psmouse(F) bluetooth lrw(F) gf128mul(F) ablk_helper(F) cryptd(F) i2c_algo_bit ipmi_si gpio_ich i7core_edac dm_multipath(F) lp(F) serio_raw(F) edac_core scsi_dh(F) parport(F) ipmi_msghandler hpwdt microcode(F) mac_hid lpc_ich shpchp hpilo binfmt_misc(F) tg3 ptp pps_core hpsa e1000e(F)
Jan 16 22:54:31 kvm-host1 kernel: [851574.079158] Pid: 27301, comm: vhost-27300 Tainted: GF       W I  3.8.0-35-generic #50-Ubuntu
Jan 16 22:54:31 kvm-host1 kernel: [851574.079159] Call Trace:
Jan 16 22:54:31 kvm-host1 kernel: [851574.079161]  <IRQ>  [<ffffffff81058a3f>] warn_slowpath_common+0x7f/0xc0
Jan 16 22:54:31 kvm-host1 kernel: [851574.079167]  [<ffffffff81058b3c>] warn_slowpath_fmt+0x4c/0x50
Jan 16 22:54:31 kvm-host1 kernel: [851574.079169]  [<ffffffff816cad03>] skb_warn_bad_offload+0xcf/0xdc
Jan 16 22:54:31 kvm-host1 kernel: [851574.079173]  [<ffffffff815c8d7c>] skb_checksum_help+0x14c/0x160
Jan 16 22:54:31 kvm-host1 kernel: [851574.079177]  [<ffffffffa0365071>] checksum_tg+0x21/0x28 [xt_CHECKSUM]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079180]  [<ffffffffa0246fc3>] ipt_do_table+0x2c3/0x5c0 [ip_tables]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079183]  [<ffffffffa03b4b99>] ? vhost_poll_queue+0x19/0x20 [vhost_net]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079185]  [<ffffffffa03b4bbd>] ? vhost_poll_wakeup+0x1d/0x30 [vhost_net]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079188]  [<ffffffff81086905>] ? __wake_up_common+0x55/0x90
Jan 16 22:54:31 kvm-host1 kernel: [851574.079191]  [<ffffffffa036b10b>] iptable_mangle_hook+0x7b/0x134 [iptable_mangle]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079194]  [<ffffffff815f6416>] nf_iterate+0x86/0xb0
Jan 16 22:54:31 kvm-host1 kernel: [851574.079199]  [<ffffffffa0317a10>] ? br_parse_ip_options+0x230/0x230 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079202]  [<ffffffff815f64b4>] nf_hook_slow+0x74/0x130
Jan 16 22:54:31 kvm-host1 kernel: [851574.079206]  [<ffffffffa0317a10>] ? br_parse_ip_options+0x230/0x230 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079210]  [<ffffffffa0318373>] br_nf_post_routing+0x2a3/0x340 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079212]  [<ffffffff815f6416>] nf_iterate+0x86/0xb0
Jan 16 22:54:31 kvm-host1 kernel: [851574.079216]  [<ffffffffa0310d00>] ? deliver_clone+0x60/0x60 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079218]  [<ffffffff815f64b4>] nf_hook_slow+0x74/0x130
Jan 16 22:54:31 kvm-host1 kernel: [851574.079221]  [<ffffffffa0310d00>] ? deliver_clone+0x60/0x60 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079225]  [<ffffffffa0311082>] br_forward_finish+0x52/0x60 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079229]  [<ffffffffa0317b63>] br_nf_forward_finish+0xc3/0x190 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079233]  [<ffffffffa031867c>] br_nf_forward_ip+0x26c/0x3e0 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079235]  [<ffffffff815f6416>] nf_iterate+0x86/0xb0
Jan 16 22:54:31 kvm-host1 kernel: [851574.079239]  [<ffffffffa0311030>] ? br_multicast_flood+0x180/0x180 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079241]  [<ffffffff815f64b4>] nf_hook_slow+0x74/0x130
Jan 16 22:54:31 kvm-host1 kernel: [851574.079245]  [<ffffffffa0311030>] ? br_multicast_flood+0x180/0x180 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079248]  [<ffffffffa0311118>] __br_forward+0x88/0xc0 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079252]  [<ffffffffa031130d>] br_forward+0x5d/0x70 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079255]  [<ffffffffa0312036>] br_handle_frame_finish+0x1e6/0x270 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079259]  [<ffffffffa0317f03>] br_nf_pre_routing_finish+0x193/0x360 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079264]  [<ffffffffa0318cdd>] br_nf_pre_routing+0x2ed/0x680 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079266]  [<ffffffff815f6416>] nf_iterate+0x86/0xb0
Jan 16 22:54:31 kvm-host1 kernel: [851574.079270]  [<ffffffffa0311e50>] ? br_handle_local_finish+0x40/0x40 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079272]  [<ffffffff815f64b4>] nf_hook_slow+0x74/0x130
Jan 16 22:54:31 kvm-host1 kernel: [851574.079275]  [<ffffffffa0311e50>] ? br_handle_local_finish+0x40/0x40 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079279]  [<ffffffffa0312250>] br_handle_frame+0x190/0x270 [bridge]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079282]  [<ffffffff815ca312>] __netif_receive_skb+0x512/0x890
Jan 16 22:54:31 kvm-host1 kernel: [851574.079285]  [<ffffffff810773fa>] ? __queue_work+0xea/0x370
Jan 16 22:54:31 kvm-host1 kernel: [851574.079287]  [<ffffffff815ca751>] process_backlog+0xc1/0x1a0
Jan 16 22:54:31 kvm-host1 kernel: [851574.079289]  [<ffffffff81077680>] ? __queue_work+0x370/0x370
Jan 16 22:54:31 kvm-host1 kernel: [851574.079291]  [<ffffffff815caf29>] net_rx_action+0x129/0x250
Jan 16 22:54:31 kvm-host1 kernel: [851574.079294]  [<ffffffff8106118f>] __do_softirq+0xcf/0x200
Jan 16 22:54:31 kvm-host1 kernel: [851574.079298]  [<ffffffff816d7b9c>] call_softirq+0x1c/0x30
Jan 16 22:54:31 kvm-host1 kernel: [851574.079299]  <EOI>  [<ffffffff81016605>] do_softirq+0x75/0xb0
Jan 16 22:54:31 kvm-host1 kernel: [851574.079303]  [<ffffffff815cb608>] netif_rx_ni+0x28/0x30
Jan 16 22:54:31 kvm-host1 kernel: [851574.079282]  [<ffffffff815ca312>] __netif_receive_skb+0x512/0x890
Jan 16 22:54:31 kvm-host1 kernel: [851574.079285]  [<ffffffff810773fa>] ? __queue_work+0xea/0x370
Jan 16 22:54:31 kvm-host1 kernel: [851574.079287]  [<ffffffff815ca751>] process_backlog+0xc1/0x1a0
Jan 16 22:54:31 kvm-host1 kernel: [851574.079289]  [<ffffffff81077680>] ? __queue_work+0x370/0x370
Jan 16 22:54:31 kvm-host1 kernel: [851574.079291]  [<ffffffff815caf29>] net_rx_action+0x129/0x250
Jan 16 22:54:31 kvm-host1 kernel: [851574.079294]  [<ffffffff8106118f>] __do_softirq+0xcf/0x200
Jan 16 22:54:31 kvm-host1 kernel: [851574.079298]  [<ffffffff816d7b9c>] call_softirq+0x1c/0x30
Jan 16 22:54:31 kvm-host1 kernel: [851574.079299]  <EOI>  [<ffffffff81016605>] do_softirq+0x75/0xb0
Jan 16 22:54:31 kvm-host1 kernel: [851574.079303]  [<ffffffff815cb608>] netif_rx_ni+0x28/0x30
Jan 16 22:54:31 kvm-host1 kernel: [851574.079307]  [<ffffffff814dfd29>] tun_get_user+0x3a9/0x750
Jan 16 22:54:31 kvm-host1 kernel: [851574.079309]  [<ffffffff814e0127>] tun_sendmsg+0x57/0x80
Jan 16 22:54:31 kvm-host1 kernel: [851574.079312]  [<ffffffffa03b7646>] handle_tx+0x266/0x580 [vhost_net]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079315]  [<ffffffffa03b7995>] handle_tx_kick+0x15/0x20 [vhost_net]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079317]  [<ffffffffa03b495f>] vhost_worker+0xff/0x1b0 [vhost_net]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079320]  [<ffffffffa03b4860>] ? vhost_work_flush+0x130/0x130 [vhost_net]
Jan 16 22:54:31 kvm-host1 kernel: [851574.079322]  [<ffffffff8107d5e0>] kthread+0xc0/0xd0
Jan 16 22:54:31 kvm-host1 kernel: [851574.079324]  [<ffffffff8107d520>] ? kthread_create_on_node+0x120/0x120
Jan 16 22:54:31 kvm-host1 kernel: [851574.079326]  [<ffffffff816d666c>] ret_from_fork+0x7c/0xb0
Jan 16 22:54:31 kvm-host1 kernel: [851574.079328]  [<ffffffff8107d520>] ? kthread_create_on_node+0x120/0x120
Jan 16 22:54:31 kvm-host1 kernel: [851574.079330] ---[ end trace 0ea7450f79ee47be ]---
Googling this error, it seems that this message is virtio warning message stating socket buffer offload, not a bug.
Virtio driver error on Ubuntu

https://bugs.launchpad.net/fuel/+bug/1264070

Labels: , , , ,

No comments:

Post a Comment

Note: Only a member of this blog may post a comment.

Subscribe to: Post Comments (Atom)