Skip to content

SD-WAN and WAN: path selection, failover and tunnel scale measured on impaired links

We test branch CPEs, hubs, cloud gateways and the underlay services behind them on the CloudLAB bench: two or three underlays per site through WAN emulators that add delay, jitter, loss and shaping per link, IPsec tunnels and application traffic from emulated branches, and the brownouts a datasheet never mentions. The report shows how fast the policy moves an application off a bad path, how many tunnels and sessions a hub holds, and what TCP really gets over the overlay.

Voice loss on an MPLS brownout 2 % loss and 40 ms jitter injected on the MPLS path, Internet path clean. Same policy before and after tuning
050100 VOICE DELIVERED, % 0306090120 TIME AFTER THE BROWNOUT, S design 5 s Delivered policy · 90 s Tuned probes, day 4 · 3 s Delivered policy Tuned probes, day 4
  • 1G–100GWAN emulators per link: delay, jitter, loss, shaping
  • 2–3underlays per site, each with its own impairments
  • From 2 weeksfor a run
  • 1–3 daystest plan and quote

When the number is needed

Three moments in an SD-WAN rollout when the vendor slide stops being an answer

A slide shows a failover in one second on two clean links. Each moment below asks what the CPE does with your applications, your underlays and the half-broken path, and ends in a number the project can sign.

  1. 1

    Shortlist

    Tender, 2–3 platforms

    Every candidate runs the same steering, failover, QoS and tunnel-scale cases on the same impaired links with the same emulated branches. Vendors see the plan before the first packet and get the same report.

    Ranked table per KPI, scale ceiling per platform, 3–4 weeks for 3 platforms

  2. 2

    Acceptance

    Before the branches migrate

    The delivered CPEs and hubs with the production policy: application classes, SLA probes, thresholds, QoS, breakout rules and tunnel settings from your export. Measured against your design on the underlays you will actually buy.

    Signed report with pass and fail per case, policy export, from 2 weeks

  3. 3

    Change

    Software release or policy change

    The acceptance cases run again on the new release, the new underlay or the new application policy. What moved, by how much, and whether the branch still clears the design. Repeatable from the same bench profile.

    Diff per KPI against the last run, 3 business days

What we test

Five device classes, and the numbers each one has to show

The bench is the same, the traffic and the pass criteria are not. The table is the starting point of the plan; your application list and your underlay contracts set the thresholds.

Device classNumbers in the reportTraffic and config on the benchTypical size
01Branch CPE IPsec throughput per packet size, steering time on loss, jitter and link down, QoS under congestion Two or three underlays via WAN emulators, voice, video and SaaS-like flows, your policy and probes 100 Mbps to 1 Gbps per branch, 2–3 underlays
02Hub and data-center gateway Tunnels held, new connections per second, throughput with all active, convergence on hub loss Emulated branches with IPsec and overlay routes, traffic on every tunnel, one hub taken down live 1–10 Gbps per hub, tunnel count from your design
03Cloud gateway, vCPE The same KPIs per instance size, throughput per core, behaviour when the host is loaded Image on the bench hypervisor or in your tenant, the same branches and impairments as hardware 200 Mbps to 5 Gbps per instance
04Controller and orchestrator Policy push time to all sites, re-admission after controller loss, data plane while it is down Controller on the bench or in your tenant, emulated sites joining, policy pushes under traffic Hundreds to thousands of sites
05Underlay Ethernet or Internet service Y.1564 per service: CIR, EIR, delay, jitter, loss; RFC 6349 TCP throughput over the path Generator and a loopback or second unit at the far end, 15 min to 24 h runs, TCP per window size 10 Mbps to 10 Gbps per service

Any SD-WAN vendor, physical or virtual, including a vendor you are leaving. Named test tools are picked for the setup and listed in the report.

The bench around one branch CPE
Users voice, video, SaaS flows Generator ports RFC 2544 frames, IPsec CPE Branch CPE under test your policy, probes, QoS IPsec · 3 underlays MPLSInternetLTE WAN emulator per link delay · jitter · loss Hub, branches a tunnel per branch Controller policy push, admission BROWNOUT OR CUT ON ONE PATH steering time · app score tunnel throughput · sessions

Around the box

What sits on each side of the CPE while it is measured

A failover number only means something with the right things around the device: the applications it will steer, the underlays it will see with their real delay and loss, and the half-broken path that production will hand it on a Tuesday afternoon

  1. Underlays with their real behaviour

    Each link goes through a WAN emulator with the delay, jitter, loss and shaping of the contract or the measured path. A brownout is a change in those numbers, not a cable pulled.

  2. Your policy, line by line

    Application classes, SLA probe intervals and thresholds, QoS queues, breakout and tunnel settings from your export. The report shows which line each slow move or dropped class traces back to.

  3. Branches and failures with traffic running

    Emulated users behind the CPE and emulated branches behind the hub, voice and video flows scored per second, the brownout and the cut timed from the last good second to the first good second after the move

Typical scenario

A platform rated for sub-second failover, a brownout on MPLS, and 90 seconds of broken voice

An enterprise hands over its branch platform for acceptance before 300 sites migrate. The vendor slide shows failover in under a second. With the production policy and a clean cable pull it does. With 2 % loss and 40 ms jitter on the MPLS path, the probes keep reporting the link as up and voice stays on it for 90 seconds. Tuning probe interval, loss threshold and the jitter rule brings the move to 3 seconds on day 4; the hub tunnel ceiling and the DIA breakout rules are measured on the same bench days.

90 s → 3 s
voice steering time on an MPLS brownout
91 %
of line rate for TCP over the overlay, RFC 6349
11 days
from the first packet to the signed report

Composite scenario from projects of this type. Numbers are realistic and not from one client.

Voice steering time on a brownout, s
Delivered policy Tuned probes, day 4 90 3 Design 5 0255075100 beyond the design clears the design

What you take away

Four numbers that end the argument, and the table they live in

The report is built for the meeting after the test: the vendor, the carrier and your network team read the same table, with the pass band from the design next to the measured value per path and per application

Each number comes with its evidence: per-second application scores, tunnel and session counters from the box, emulator settings per link, captures and the policy export of the run

Steering
Time to move each application class off a path on loss, jitter and link down, and back when the path recovers, with the probe settings that produced it
Scale
Tunnels, sessions, routes and sites where the hub or the controller stops or slows, so the design has a ceiling with a margin, not a slide maximum
Throughput
IPsec throughput per direction and packet size per branch class, QoS behaviour under congestion, and RFC 6349 TCP over the overlay against the line rate
Underlay
Y.1564 per underlay service against the carrier contract, so a slow failover is traced to the policy or to the link, not argued about
ACC-SDW-02 Acceptance, branch platform Rerun, day 4

Result table, 6 of 18 cases

KPIPass bandMeasuredResult
Voice steering on MPLS brownout≤ 5 s3 sPass
Voice steering on link down≤ 1 s0.6 sPass
IPsec throughput, 1 Gbps branch, 1400 B≥ 900 Mbps940 MbpsPass
Tunnels held per hub, traffic on all≥ design countdesign + 20 %Pass
TCP throughput over the overlay, RFC 6349≥ 85 % of line91 %Pass
Voice MOS under 3:1 congestion≥ 4.03.9Pass with a note

Where it runs

The CloudLAB WAN bench, and the pages behind this one

CPEs and hubs ship to the CloudLAB rack in Armenia or we connect the bench to your lab; virtual gateways run on the bench hypervisor or in your tenant, and you watch the run through the portal with an engineer on every session. The links are 1G to 100G with a WAN emulator on each, so a brownout is a setting, not a search for a bad cable.

Before the brief

What WAN teams ask first

Which SD-WAN platforms can you test?

Any vendor and any form factor: branch appliances, hub and data-center gateways, virtual CPEs on the bench hypervisor or in your cloud tenant, and the controller that drives them. Classic WAN routers with IPsec and policy routing run the same cases. The plan names the test tool behind each number; there is no single default vendor.

How do you make a link go bad on purpose?

Every underlay on the bench passes through a WAN emulator that sets delay, jitter, loss, reordering and bandwidth per direction. A brownout is a scripted change of those numbers at a known second, so the steering time is measured from the first bad second to the first good second after the move, and the same brownout repeats for every platform and every rerun.

Is it tested with our policy and our applications?

Yes. Application classes, SLA probes, thresholds, QoS and breakout rules come from an anonymised export; the traffic is built from your application list, with voice and video scored per second and SaaS-like flows over TLS. A vendor-default run can sit next to it, so the gap between the slide and your policy is a number.

How many branches does a run emulate?

As many as the design needs, on 1G to 100G ports: emulated branches with IPsec tunnels and overlay routes toward the hub, with traffic on every tunnel. The site count and a multi-hub design are agreed per setup and written into the plan before the quote.

What about the underlay itself, is the carrier at fault?

The underlay is measured on its own: ITU-T Y.1564 per service against the contract, RFC 6349 for TCP throughput and buffer delay over the path. With those numbers next to the steering times the report says whether a slow failover is the policy, the box or the link.

How long does it take and what do we get?

Test plan and quote in 1–3 business days after the brief. A run takes from 2 weeks for one branch class and a hub, 3–4 weeks for a shortlist of 3 platforms. The report holds every case with its pass band, the measured value, the emulator settings and the policy export, plus a one-page summary per platform.

Send the platforms, the underlay list and the policy export. The plan comes back in 1–3 business days.

No prices on the site: scope first, then the quote. The vendor and the carrier can sit in on the brief.

Send the shortlist

You have the method. Now get the numbers.

Name the models and the KPIs that matter. An engineer replies within one business day with a test plan draft and a quote.

Prefer to chat? Message an engineer on WhatsApp

We use what you send only to answer you. See our Privacy Policy.