OVS agent: Use python binding instead of ovs-ofctl command¶
OVS agent uses ovs-ofctl command to program flow. it works but has some drawbacks:
Instead of invoking ovs-ofctl each times, use OpenFlow python library (“Ryu ofproto library” 3) provided by Ryu SDN Framework (“Ryu” 2) to program OVS. This approach was taken for ofagent 4 and proved to work.
Turn the existing code which uses ovs-ofctl into a driver 16
Introduce Ryu-based driver 17 as a non-default option.
Maintain both of drivers for a while. (one release cycle?) It would need Experimental/non-voting jenkins jobs to cover the non-default driver. Looking the result of the jobs, once the Ryu-based driver gets reasonably stable, consider to switch the default.
Deprecate ovs-ofctl driver later
OVS agent currently uses OpenFlow 1.0. The new Ryu-based driver will use OpenFlow 1.3 for reasons mentioned below. ovs-ofctl based driver will keep using OpenFlow 1.0 with the exactly same flows as it currently uses.
OpenFlow 1.3 provides some features possibly useful for OVS agent. For example, ofagent uses metadata to implement “local vlan” isolation. OVS agent can do the same.
Ryu ofproto library API for OpenFlow 1.0 is not sophisticated compared to later versions like OpenFlow 1.3. It works well, but only provides older unsophisticated API 13.
OpenFlow 1.3 works well with the recent versions of Open vSwitch. Open vSwitch v2.0.0 introduced OpenFlow 1.3 support and Open vSwitch v2.3.0 enabled it by default.
OVS-agent itself configures the switch to use the appropriate OpenFlow version. There’s no need for extra operator investigations.
Open vSwitch version in distributions:
XenAPI Integration needs updates.
Currently OVS agent uses a special rootwrap 14 15 to proxy ovs-ofctl/ovs-vsctl requests from neutron node to dom0. This proposal replaces the use of ovs-ofctl. This proposal doesn’t change ovs-vsctl part.
As we can assume IP reachability between neutron node and dom0 20 , a simple set-controller to teach OVS the IP address of the corresponding neutron node (thus the embedded OpenFlow controller) should be enough.
OVS-agent will have a new option to specify the address and port to listen for OpenFlow connections.
Nicira extensions (NX)
Currently OVS agent uses Nicira extensions for OpenFlow 1.0 in a several places. Even with OpenFlow 1.3, some of them still need the extensions.
The following is a list of Nicira extensions used by OVS agent. Ryu>=3.18 supports all of them.
Local ARP responder uses Nicira extensions heavily:
For longer term, probably it might be cleaner to replace it with ofagent’s packet-in based implementation entirely. In that way, there’s no need to use Nicira extensions.
The following Nicira extensions will be replaced by OpenFlow 1.3 native equivalents.
Resubmit and tables
OpenFlow channel establishment
Currently, on each invocation, ovs-ofctl command connects to the switch via unix domain socket. Instead, this blueprint proposes to make OVS agent listen on a local TCP port, e.g. 127.0.0.1:6633, and wait for the switch to connect to that port. TCP is the typical transport for an OpenFlow channel and removes a need of rootwrap. It’s the same as how ofagent currently works.
To make the above work, the switch needs to be configured to connect to that port. OVS agent itself can configure the switch accordingly by accessing ovsdb on startup.
Example of typical code changes
br.add_flow(priority=2, in_port=in_port, actions="output:%s" % out_port)
match = ofpp.OFPMatch(in_port=in_port) actions = [ ofpp.OFPActionOutput(port=out_port) ] instructions = [ ofpp.OFPInstructionActions(ofp.OFPIT_APPLY_ACTIONS, actions) ] msg = ofpp.OFPFlowMod(dp, priority=2, match=match, instructions=instructions]) self.send_msg(msg)
As you see, Ryu version is a straightforward representation of OpenFlow protocol.
Instead of making OVS agent switch to OpenFlow 1.3, improve Ryu’s OpenFlow 1.0 support. This would minimize changes in neutron. This isn’t an attractive option though, given the limited functionality of OpenFlow 1.0.
Fold ofagent into OVS agent. It would bring in some additional ofagent improvements including drastic flow table design changes 5 and packet-in based local arp responder 7. If we want to merge these agents in a long term keeping ofagent’s “avoid OVS-specific features as far as reasonable” property, this option would be the most straightforward and minimize the total amount of work a lot. If we go this route, probably the appropriate steps would be:
Port lacking features like DVR, canary table, etc to ofagent
Assuming it’s more important to keep compatibility for OVS-agent (right?), resurrect features which was removed in ofagent. (br-ex support etc)
Once ofagent has feature parity, replace OVS-agent with it.
Data Model Impact¶
REST API Impact¶
A local user on the node would be able to connect to the OpenFlow port on which the agent listening and try to confuse the agent. It isn’t a problem as the local management network is considered safe, though.
The OpenFlow channel can be protected using TLS if desirable. Both of Open vSwitch and Ryu support TLS 12. In that case, we need to introduce some agent options to specify certs.
Other End User Impact¶
Per FlowMod overhead would be smaller than rootwrap and ovs-ofctl command.
Other Deployer Impact¶
Ryu SDN Framework will be required for OVS agent to work:
The latest version can be pulled via pip.
Ryu and its (non-optional) required packages are mostly pure-python 19. A few exceptions like eventlet are already covered by Neutron itself.
It isn’t packaged for Fedora Rawhide yet.
Developers of OVS agent need to be familiar with Ryu ofproto library API, instead of ovs-ofctl command flow syntax.
- Primary assignee:
- Other contributors:
See “Proposed Change” section.
Update and improve the existing tests if necessary.
Ryu SDN Framework will be required for gate jobs.
Experimental/non-voting jobs for the new driver will be needed.
The existing tempest tests should work as-is.
Update and improve the existing tests if necessary.
There’s an on-going effort for functional tests for drivers 18 . Suggestions are welcome.
A new option to specify address/port to listen for OpenFlow connections needs to be documented. It will be used by XenAPI integration.
If we want to support other transports like TLS, more options will be needed:
The option to specify the transport
Transport specific parameters. E.g. certs for TLS
It’s nice to have a documentation on how to debug OpenFlow flows. Some notes:
Even after switching to the proposed Ryu-based driver, you can keep using ovs-ofctl command etc for debugging purposes as of today.
Ryu has a functionality to JSON-serialize OpenFlow messages 21 . It might be useful for logging purposes.