Scheduling support for Routed Networks

https://blueprints.launchpad.net/nova/+spec/routed-networks-scheduling

Neutron provides network segments support thanks to Routed Networks where you can create a port allocated to a specific segment. Unfortunately, Nova doesn’t verify the segment at every instance operation, including those where you move an instance, which leads to inconsistencies.

Problem description

Although it’s possible to create a Neutron port with a routed networks setup and boot an instance with this port, the network locality of the compute node associated with the instance won’t be verified by the scheduler and could lead to a wrong scheduling decision. This is problematic when a move operation sends an instance to a compute node that isn’t in the network segment that is related to the IP address that was allocated at boot time.

As a result of this gap, the only way to use routed networks in Nova currently is by creating a port having the ip_allocation value be deferred and making sure that all compute services are assigned to at least one network segment.

Use Cases

As an operator, I’d like to make sure that instances IP addresses can be correctly separated between the network segments I provided.

As an operator, I don’t want to see instances going to compute services that aren’t in network segments if the user asks for either a port or a routed network.

As a user, I’d like Nova to place my instance on the correct host according to the port or network I’ve requested for my instance, without having to specifically create a port with a ip_allocation=deferred value.

Proposed change

Once you configure routed networks in Neutron, network segments are represented as Placement Resource Providers. Neutron will then ask Nova to create a Nova host aggregate for each segment and will add compute services that are mapped with respective segments into the related aggregates. Eventually, Nova will mirror those aggregates into Placement aggregates.

What we then need for Nova is to have a way for asking the Placement API to only get resource providers (i.e. compute nodes) that are in the aggregate related to the segments that are in the network passed by the user (or related to the port that is asked).

As Nova needs to find which segments are related and then which aggregates, we could just provide a new pre-filter that would look at it if some configuration option (say query_placement_for_routed_network_aggregates) would be True.

A pseudo-code for it would be :

def support_routed_networks(ctxt, request_spec):
  if not CONF.query_placement_for_routed_network_aggregates:
    return False
  segment_ids = <get_all_segments_ids_from_network_or_port>
  for segment in segment_ids:
     agg_info = <get_provider_aggregates_from_segment_id>
     <append_agg_info_to_required_aggregates>

Note

As said below in the Alternatives section, we could have Neutron passing directly the aggregates, so this pre-filter could be deprecated once we do it.

Alternatives

Instead of having a new pre-filter, we could provide a specific scheduler filter. This said, given we limit the number of allocation candidates returned by Placement, we could miss some good resource providers so the filter couldn’t work.

Another alternative would be to have Neutron passing directly the needed aggregate to Nova instead of Nova asking Neutron for it, but that would mean that we should modify Neutron to return the Placement needed query in the port.resource_request attribute.

Data model impact

We may need to augment the RequestSpec object to be able to provide in its nested RequestLevelParams object attribute the specific aggregate.

REST API impact

None.

Security impact

None.

Notifications impact

None.

Other end user impact

None.

Performance Impact

There could be a performance impact if we would verify the segments for every instance in every cloud, but given we ask the operator to modify an option if they want to use routed networks, we don’t really think this would be an issue.

Other deployer impact

A new configuration option would be:

cfg.BoolOpt("query_placement_for_routed_network_aggregates",
            default=False),

Developer impact

None.

Upgrade impact

None.

Implementation

Assignee(s)

Primary assignee:

bauzas

Other contributors:

None

Feature Liaison

bauzas

Work Items

• Create a new pre-filter that would find the related aggregate

• Pass the aggregate to the RequestSpec asking to verify it by Placement

• That’s it.

Dependencies

None.

Testing

Functional tests of course, but Tempest tests would be nice as well.

Documentation Impact

Maybe modifying https://docs.openstack.org/neutron/latest/admin/config-routed-networks.html

References

None.

History

Revisions

Release Name	Description
Victoria	Introduced, Approved
Wallaby	Re-proposed