Comments (6)
tohojo
commented on June 12, 2024
1
Looks like XDP is not enabled on the peer veth device. This can be done
in one of two ways:
- Load a dummy XDP program on the peer
- Enable GRO on both peers of the veth device
I'm not sure if the second method works on a kernel that old, though, so
going for the first option is probably safer...
from xdp-tutorial.
vincent5753
commented on June 12, 2024
@tohojo Thanks for the reply.
Can you provide your Kernel version for me, so I can test this in the newer version of Kernel?
from xdp-tutorial.
vincent5753
commented on June 12, 2024
Here's how I setup my ENV
I am trying to implement a LB like lb-from-scratch from lizrice
I started 4 container for client / LB / nginx1(backend) / nginx2(backend)
and loaded dummy XDP onto veth of client / nginx1(backend) / nginx2(backend)
and LB XDP onto veth of LB.
Enabled NAPI using ethtool -K ${vethname} gro on
And disabled rp_filer using echo 0 | sudo tee /proc/sys/net/ipv4/conf/${vethname}/rp_filter
I oringaly tried this on Ubuntu 20.04(with Kernel 5.4.0-144-generic), but I tried on Ubuntu 22.04(with Kernel 5.15.0-94-generic) yesterday, I could not figure out what was missing.
My setup can be found at hire
https://github.com/vincent5753/MASTER-VP/tree/main/eBPF/redirect_icmp/docker
from xdp-tutorial.
tohojo
commented on June 12, 2024
The GRO thing was added in kernel 5.13, so on that 5.15 kernel it should
be enough to just enable GRO on both ends of the veth device (i.e., both
outside and inside the container). No idea how to get docker to do this
for you, but it should be possible to just do it manually with ethtool
after starting up the containers...
from xdp-tutorial.
vincent5753
commented on June 12, 2024
I tried entering container and manually installed ethtool after starting up the containers,
did ethtool -K eth0 gro on inside the container and ethtool -K ${vethname} gro on on host.
But it did not work either.
Maybe this don't work on docker env because the veth pair?
ref: Re: Veth pair swallow packets for XDP_TX operation
But I tried mounting dummy onto other containers, that did not work either.
I am wondering if I can mount eBPF to tc to redirect packet to other interfaces instead?
Maybe sacrifice some performance but works?
from xdp-tutorial.
tohojo
commented on June 12, 2024
VP ***@***.***> writes:
I tried entering container and manually installed ethtool after starting up the containers,
did `ethtool -K eth0 gro on` inside the container and `ethtool -K ${vethname} gro on` on host.
But it did not work either.
Yeah, that should work (on the 5.15 kernel). Did the error codes change?
Maybe this don't work on docker env because the veth pair?
ref: [Re: Veth pair swallow packets for XDP_TX operation](https://www.spinics.net/lists/netdev/msg625217.html)
But I tried mounting dummy onto other containers, that did not work either.
I am wondering if I can mount eBPF to tc to redirect packet to other interfaces instead?
Maybe sacrifice some performance but works?
Sure, you can use TC instead. If you're only doing things on veth
devices that won't hurt performance either; XDP on veth only really
makes sense performance-wise if you're redirecting frames into the veth
devices from a physical NIC using XDP. If you're just sending traffic
around between containers, just use TC :)
from xdp-tutorial.
Related Issues (20)
- BPF_MAP_TYPE_XSKMAP is hash or array type ?
- Xdp mode via api? HOT 1
- Xdp in run to completion and poll mode HOT 3
- extend packet HOT 5
- Modify outer IP header of GENEVE encapsulated packets
- Can AF XDP modify tcp payload in user-space HOT 4
- AF XDP forward only work in layer 2 HOT 1
- Tutorial: Basic01 missing file
- Missing file HOT 1
- run ./xdp_pass_user --dev lo error! in Ubuntu 20.04 HOT 4
- About umem frame_headroom HOT 3
- Can't understand the two prototype of bpf_map_lookup_elem
- Is AF_XDP socket thread-safe HOT 8
- Test
- Questions about running XDP sockets on top of bonding device or on the physical interfaces behind the bond HOT 2
- Is AF_XDP socket thread-safe for TX ring and other rings ? HOT 9
- How to solve this problem: *** ERROR: Cannot find tool m4 HOT 3
- there is no ./xdp_loader HOT 1
- af_xdp sending with run to completion mode HOT 21
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from xdp-tutorial.