Multipath TCP

The redundancy offered by Multipath TCP enables inverse multiplexing of resources, and thus increases TCP throughput to the sum of all available link-level channels instead of using a single one as required by standard TCP. Multipath TCP is backward compatible with standard TCP.

Multipath TCP is particularly useful in the context of wireless networks;{{cite conference|last1=Paasch|first1=Christoph|conference=ACM SIGCOMM workshop on Cellular Networks (Cellnet'12)|last2=Detal|first2=Gregory|last3=Duchene|first3=Fabien|last4=Raiciu|first4=Costin|last5=Bonaventure|first5=Olivier| title=Proceedings of the 2012 ACM SIGCOMM workshop on Cellular networks: Operations, challenges, and future design - Cell Net '12 |year=2012|pages=31|doi=10.1145/2342468.2342476|chapter-url=http://inl.info.ucl.ac.be/publications/exploring-mobilewifi-handover-multipath-tcp|chapter=Exploring mobile/WiFi handover with multipath TCP|isbn=9781450314756|doi-access=free}} using both Wi-Fi and a mobile network is a typical use case.{{cite journal|title=Analytical Modeling of Multipath TCP Over Last-Mile Wireless |journal=IEEE/ACM Transactions on Networking |volume=25 |issue=3 |pages=1876–1891 |author1=S. Pokhrel |author2=M. Panda |author3=H. Vu |date=2017-02-24|doi=10.1109/TNET.2017.2663524 |s2cid=21518823 }} In addition to the gains in throughput from inverse multiplexing, links may be added or dropped as the user moves in or out of coverage without disrupting the end-to-end TCP connection.{{cite journal|title= Improving Multipath TCP Performance over WiFi and Cellular Networks: an Analytical Approach |journal= IEEE Transactions on Mobile Computing |volume=25 |issue=3 |pages=1876–1891 |author1=S. Pokhrel |author2=M. Mandjes |date=2019-03-24|doi=10.1109/TMC.2018.2876366|s2cid= 69263415 }}

The problem of link handover is thus solved by abstraction in the transport layer, without any special mechanisms at the network or link layers. Handover functionality can then be implemented at the endpoints without requiring special functionality in the subnetworks - in accordance to the Internet's end-to-end principle.

Multipath TCP also brings performance benefits in datacenter environments.{{Cite journal | last1=Raiciu |last2=Barre |last3=Pluntke |last4=Greenhalgh |last5=Wischik |last6=Handley | title=Improving datacenter performance and robustness with multipath TCP | journal= ACM SIGCOMM Computer Communication Review|volume=41 |issue=4 |pages=266 | year=2011 | url=http://inl.info.ucl.ac.be/publications/improving-datacenter-performance-and-robustness-multipath-tcp |doi=10.1145/2043164.2018467 |citeseerx=10.1.1.306.3863 |s2cid=61962047 }} In contrast to Ethernet channel bonding using 802.3ad link aggregation, Multipath TCP can balance a single TCP connection across multiple interfaces and reach very high throughput.{{cite web|url=http://multipath-tcp.org/pmwiki.php?n=Main.50Gbps

|access-date=2013-09-20

|title=The fastest TCP connection with Multipath TCP

|author1=C. Paasch |author2=G. Detal |author3=S. Barré |author4=F. Duchêne |author5=O. Bonaventure }}

Multipath TCP causes a number of new issues. From a network security perspective, multipath routing causes cross-path data fragmentation that results in firewalls and malware scanners becoming inefficient when they only see one path's traffic. In addition, SSL decryption will become inefficient by way of the end-to-end encryption protocols.{{cite thesis|type=PhD|title=Life of a Security Middlebox Challenges with Emerging Protocols and Technologies|date=2020|isbn=978-91-7867-103-8|oclc=1139703033|last=Afzal|first=Zeeshan}}

In order to facilitate its deployment, Multipath TCP presents the same socket interface as TCP. This implies that any standard TCP application can be used above Multipath TCP while in fact spreading data across several subflows.{{cite web|url=http://www.multipath-tcp.org/

|access-date=2014-11-28

|title=The Linux kernel MultiPath TCP project

}}

File:Multipath TCP architecture.jpg

Some applications could benefit from an enhanced API to control the underlying Multipath TCP stack. Two different APIs have been proposed to expose some of features of the Multipath TCP stack to applications: an API that extends Netlink on Linux{{cite book|last1=Hesmans|first1=B.|last2=Detal|first2=G.|last3=Barre|first3=S.|last4=Bauduin|first4=R.|last5=Bonaventure|first5=O.|title= SMAPP towards smart Multipath TCP-enabled applications|year=2015|pages=1–7|doi=10.1145/2716281.2836113|chapter=SMAPP|isbn=9781450334129|s2cid=9940025}} and an enhanced socket API.{{cite book|last1=Hesmans|first1=Benjamin|title=Proceedings of the 2016 workshop on Applied Networking Research Workshop - ANRW 16|last2=Bonaventure|first2=Olivier|chapter=An enhanced socket API for Multipath TCP|year=2016|pages=1–6|doi=10.1145/2959424.2959433|isbn=9781450344432|s2cid=13799560}}

In July 2013, the MPTCP working group reported five independent implementations of Multipath TCP,{{cite web|url=http://datatracker.ietf.org/doc/draft-eardley-mptcp-implementations-survey/?include_text=1

|access-date=2013-09-20

|title=Survey of MPTCP Implementations (Internet-Draft, 2013)

}} including the initial reference implementation in the Linux kernel.{{Cite journal |last1=Barre |last2=Paasch |last3=Bonaventure | title=MultiPath TCP: From Theory to Practice | journal=IFIP Networking | year=2011 | url=http://inl.info.ucl.ac.be/publications/multipath-tcp-theory-practice }}{{Cite journal |last1=Raiciu |last2=Paasch |last3=Barre |last4=Ford | last5= Honda |last6=Duchene |last7=Bonaventure | last8=Handley| title=How Hard Can It Be? Designing and Implementing a Deployable Multipath TCP | journal=Usenix NSDI |pages=399–412 | year=2012 | url=https://www.usenix.org/conference/nsdi12/how-hard-can-it-be-designing-and-implementing-deployable-multipath-tcp }}

The currently available implementations are:

• Linux kernel (new reference implementation) introduced in the mainlined kernel in v5.6{{cite web|url=https://www.mptcp.dev|title=Linux MPTCP Upstream Project}}
• Linux kernel (initial reference implementation) fork from Université catholique de Louvain researchers and other collaborators
• FreeBSD (IPv4 only) from Swinburne University of Technology{{cite web|url=http://lists.freebsd.org/pipermail/freebsd-net/2013-March/034882.html|access-date=2013-09-23|title=Multipath TCP for FreeBSD v0.1}} and AI/ML-based from Deakin University{{cite journal |last1=Pokhrel|first1=Shiva Raj|title=Multipath TCP implementation under FreeBSD-13 for pluggable machine learning models|journal=Computer Networks|volume=252|pages=596–609|last2=Kua|first2=Jonathan|last3=Fleming|first3=Brenton|last4= Ozer|first4=Sebnem|last5= Howe|first5=Jeff|last6= Walid|first6=Anwar|year=2024|doi=10.1016/j.comnet.2024.110671}}
• F5 Networks BIG-IP LTM{{cite web|url=http://support.f5.com/kb/en-us/products/big-ip_ltm/releasenotes/product/relnote-ltm-11-5-0.html#rn_new|access-date=2014-05-30|title=Release Note: BIG-IP LTM and TMOS 11.5.0|publisher=f5 Networks|date=2014-05-30}}
• Citrix Netscaler{{cite web|url=http://blogs.citrix.com/2013/05/28/maximize-mobile-user-experience-with-netscaler-multipath-tcp/

|access-date=2013-09-20

|title=Maximize mobile user experience with NetScaler Multipath TCP

|author=John Gudmundson

|publisher=Citrix

|date=2013-05-28

}}

• Apple iOS 7, released on September 18, 2013 is the first large scale commercial deployment of Multipath TCP.{{cite web|url=http://perso.uclouvain.be/olivier.bonaventure/blog/html/2013/09/18/mptcp.html|access-date=2013-09-20|title=Apple seems to also believe in Multipath TCP}} Since iOS 7, any application can use Multipath TCP.
• Apple Mac OS X 10.10, released on October 16, 2014{{cite web|url=http://labs.neohapsis.com/2014/10/20/mptcp-roams-free-by-default-os-x-yosemite/|access-date=2015-09-16|title=MPTCP ROAMS FREE (BY DEFAULT!) – OS X YOSEMITE|date=2014-10-20}}
• Alcatel-Lucent released MPTCP proxy version 0.9 source code on October 26, 2012{{cite web|url=https://www.ietf.org/mail-archive/web/multipathtcp/current/msg01934.html|access-date=2016-12-28|title=code release for MPTCP Proxy|date=2012-10-26|author=Georg Hampel|publisher=Alcatel-Lucent}}{{cite web|url=https://www.ietf.org/proceedings/85/slides/slides-85-mptcp-0.pdf|title=MPTCP PROXY|access-date=2016-12-28|date=2012-10-26|author=Georg Hampel|author2=Anil Rana|publisher=Bell Labs/Alcatel-Lucent}}

In July 2014, Oracle reported that an implementation on Solaris was being developed. In June 2015, work is in progress.{{cite web|last1=Rao|first1=Shoaib|title=Some comments on RFC 6824|url=https://mailarchive.ietf.org/arch/msg/multipathtcp/ugMIu566McQMn8YCju-CTjW9beY|access-date=25 June 2015}} There is also an ongoing effort to push a new Multipath TCP implementation in the mainline Linux kernel.{{cite web|url=https://www.tessares.net/open-source/mptcp-upstream-project|access-date=2020-01-10|title=MPTCP Upstream Project|date=2019-12-17}}

During the MPTCP WG meeting at IETF 93, SungHoon Seo announced that KT had deployed since mid June a commercial service that allows smartphone users to reach 1 Gbit/s using a MPTCP proxy service.{{cite web|url=https://www.ietf.org/proceedings/93/slides/slides-93-mptcp-3.pdf|title=KT's GiGA LTE}} Tessares uses the Linux kernel implementation to deploy Hybrid Access Networks.

Multipath TCP was designed to be backward compatible with regular TCP. As such, it can support any application. However, some specific deployments{{Cite journal|last1=Bonaventure|first1=Olivier|last2=See|first2=SungHoon|year=2016|title=Multipath TCP Deployments|url=https://www.ietfjournal.org/multipath-tcp-deployments/|journal=IETF Journal}} leverage the ability of simultaneously using different paths.

Apple uses Multipath TCP to support the Siri application on iPhone. Siri sends voice samples over an HTTPS session to Apple servers. Those servers reply with the information requested by the users. According to Apple engineers, the main benefitsC. Paasch, iOS & Linux Implementation Updates, IETF-99, https://datatracker.ietf.org/meeting/99/materials/slides-99-mptcp-sessa-ios-linux-implementation-updates/ of Multipath TCP with this application are:

• User-feedback (Time-to-First-Word) 20% faster in the 95th percentile
• 5x reduction of network failures

Other deployment use Multipath TCP to aggregate the bandwidth of different networks. For example, several types of smartphones, notably in Korea, use Multipath TCP to bond WiFi and 4G through SOCKS proxies.S. Seo, KT’s GiGA LTE - Mobile MPTCP Proxy Deployment, IETF-97, https://www.ietf.org/proceedings/97/slides/slides-97-banana-kt-giga-lte-mobile-mptcp-proxy-development-01.pdf Another example are the Hybrid Access Networks that are deployed by network operators willing to combine xDSL and LTE networks. In this deployment, Multipath TCP is used to efficiently balance the traffic over the xDSL and the LTE network.Gregory Detal, Sebastien Barre, Bart Peirens, Olivier Bonaventure, "Leveraging Multipath TCP to create Hybrid Access Networks ", SIGCOMM'17 (Industrial demo), http://conferences.sigcomm.org/sigcomm/2017/files/program-industrial-demos/sigcomm17industrialdemos-paper4.pdf

In the standardisation of converged fixed and mobile communication networks, 3GPP and BBF are interoperating to provide an ATSSS (Access Traffic Selection, Switching, Splitting) feature to support multipath sessions, e.g, by applying Multipath TCP both in the User Equipment (UE) or Residential Gateway (RG) and on the network side.3GPP TR 23.793, "Study on access traffic steering, switch and splitting support in the 5G system architecture (Release 16)", https://www.3gpp.org/ftp/Specs/latest/Rel-16/23_series/23793-g00.zip

Multipath TCP uses options that are described in detail in {{IETF RFC|8684|link=no}}. All Multipath TCP options are encoded as TCP options with Option Kind 30, as reserved by IANA.{{cite web|url=https://www.iana.org/assignments/tcp-parameters/tcp-parameters.xhtml#tcp-parameters-1

|access-date=2013-09-24

|title=IANA Protocol Registry TCP Option Kind Numbers

}}

The Multipath TCP option consists of the standard Option-Kind (in this case 30) and Length values, followed by a 4-bit subtype field, for which the IANA maintains a sub-registry entitled "MPTCP Option Subtypes" under the "Transmission Control Protocol (TCP) Parameters" registry. This subtype field indicates the MPTCP header type, and its values are defined as follows:

Values 0x9 through 0xe are currently unassigned.

File:DifferenceTCP MPTCP-en.png

The core idea of multipath TCP is to define a way to build a connection between two hosts and not between two interfaces (as standard TCP does).

For instance, Alice has a smartphone with 3G and WiFi interfaces (with IP addresses 10.11.12.13 and 10.11.12.14) and Bob has a computer with an Ethernet interface (with IP address 20.21.22.23).

In standard TCP, the connection should be established between two IP addresses. Each TCP connection is identified by a four-tuple (source and destination addresses and ports). Given this restriction, an application can only create one TCP connection through a single link. Multipath TCP allows the connection to use several paths simultaneously. For this, Multipath TCP creates one TCP connection, called subflow, over each path that needs to be used.

The purpose of the different protocol operations (defined in RFC 6824) are:

• to handle when and how to add/remove paths (for instance if there's a connection lost or some congestion control)
• to be compatible with legacy TCP hardware (such as some firewalls that can automatically reject TCP connections if the sequence number aren't successive)
• to define a fair congestion control strategy between the different links and the different hosts (especially with those that don't support MPTCP)

File:MPTCP-session-en.png

Multipath TCP adds new mechanisms to TCP transmissions:

• The subflow system, used to gather multiple standard TCP connections (the paths from one host to another). Subflows are identified during the TCP three-way handshake. After the handshake, an application can add or remove some subflows (subtypes 0x3 and 0x4).
• The MPTCP DSS option contains a data sequence number and an acknowledgement number. These allow receiving data from multiple subflows in the original order, without any corruption (message subtype 0x2)
• A modified retransmission protocol handles congestion control and reliability.

The detailed protocol specification is provided in RFC 8684. Several survey articles provide an introduction to the protocol.{{cite journal|last2=Bonaventure|first2=Olivier|date=April 2014|title=Multipath TCP|url=http://queue.acm.org/detail.cfm?id=2591369|journal=Communications of the ACM|volume=57|issue=4|pages=51–57|doi=10.1145/2578901|last1=Paasch|first1=Christoph|s2cid=17581886|url-access=subscription}}{{cite book|url=http://www.sigcomm.org/content/ebook|title=Recent Advances in Reliable Transport Protocols|last2=Iyengar|first2=Janardhan|last3=Bonaventure|first3=Olivier|date=2013|publisher=ACM SIGCOMM|ref=mptcp-ebook|last1=Raiciu|first1=Costin|editor1-last=Haddadi|editor1-first=Hamed|editor2-last=Bonaventure|editor2-first=Olivier}}

Several congestion control mechanisms have been defined for Multipath TCP. Their main difference with classical TCP congestion control schemes is that they need to react to congestion on the different paths without being unfair with single path TCP sources that could compete with them on one of the paths. Four Multipath TCP congestion control schemes are currently supported by the Multipath TCP implementation in the Linux kernel.

• The Linked Increase Algorithm defined in RFC 6356
• The Opportunistic Linked Increase Algorithm{{cite book|last1=Khalili|first1=Ramin|last2=Gast|first2=Nicolas|last3=Popovic|first3=Miroslav|last4=Upadhyay|first4=Utkarsh|last5=Le Boudec|first5=Jean-Yves|title=Proceedings of the 8th international conference on Emerging networking experiments and technologies |chapter=MPTCP is not pareto-optimal |year=2012|pages=1–12|doi=10.1145/2413176.2413178|isbn=9781450317757|s2cid=14210629| url=http://infoscience.epfl.ch/record/182920 }}
• The wVegas delay based congestion control algorithm
• The Balanced Linked Increase Algorithm{{cite journal |last1=Peng|first1=Qiuyu|title=Multipath TCP: Analysis, Design and Implementation|journal=IEEE/ACM Transactions on Networking|volume=24|pages=596–609|last2=Walid|first2=Anwar|last3=Hwang|first3=Jaehyun|last4= Low|first4=Steven H.|year=2013|arxiv=1308.3119|bibcode=2013arXiv1308.3119P|doi=10.1109/TNET.2014.2379698|s2cid=250322}}

The IETF is currently developing the QUIC protocol that integrates the features that are traditionally found in the TCP, TLS and HTTP protocols. It can be extended to support the same use cases as Multipath TCP. A first design for Multipath QUIC has been proposed,{{cite web|url=https://tools.ietf.org/html/draft-deconinck-multipath-quic-00

|title=Multipath Extension for QUIC

|author1=Q. De Coninck |author2=O. Bonaventure |publisher=IETF

|date=2010-10-30

}} implemented and evaluated.{{cite web|url=http://multipath-quic.org/conext17-deconinck.pdf

|title=Multipath QUIC: Design and Evaluation

|author1=Q. De Coninck |author2=O. Bonaventure |publisher= Proc. Conext'2017, Seoul, Korea

|date=2010-12-12

}}

{{main article|Stream Control Transmission Protocol}}

Stream Control Transmission Protocol (SCTP) is a reliable in-order datagram stream transport protocol originally intended for telecommunication signaling. It supports concurrent use of multiple access links and allows the application to influence the access interface selections on a datagram stream basis. It also supports mobility via access renegotiation. Hence, SCTP is also a transport layer solution. It offers type 3 flow granularity with concurrency, but with more flow scheduling control than Multipath TCP. It also fully supports mobility in a fashion similar to Multipath TCP.{{cite web

|url = http://www-csag.ucsd.edu/projects/Optiputer/papers/2002-rodriguez.pdf

|title = Dynamic parallel access to replicated content in the Internet

|author1 = P. Rodriguez

|author2 = E. Biersack

|publisher = IEEE/ACM Transactions on Networking

|date = 2002-07-01

|url-status = dead

|archive-url = https://web.archive.org/web/20130927012704/http://www-csag.ucsd.edu/projects/Optiputer/papers/2002-rodriguez.pdf

|archive-date = 2013-09-27

}}

{{main article|Session Initiation Protocol|IP Multimedia Subsystem}}

Within the IP Multimedia Subsystem (IMS) architecture, Session Initiation Protocol (SIP) can support the concurrent use of multiple contact IP addresses for the registration of one or more IMS user agents. This allows for the creation of multiple IMS signaling paths. On these signaling paths, signaling messages carry Session Description Protocol (SDP) messaging to negotiate media streams. SDP allows for the (re-)negotiation of the streams of one media session over multiple paths. In turn, this enables application layer multipath transport. From this point of view, IMS can therefore offer application layer multipath support with flow granularity and concurrent access. A multipath extension to Real-time Transport Protocol (RTP) has been under discussion within the IETF.{{Cite web | url=https://tools.ietf.org/html/draft-ietf-avtcore-mprtp | title=Draft-ietf-avtcore-MPRTP-03 }} Multipath RTP can offer flow granularity with concurrent access and mobility (via IMS, SDP signaling or the RTP control protocol). Very recently in addition a proposal to extend also DCCP (Datagram Congestion Control Protocol) by a multipath feature is discussed at IETF in TSVWG (Transport Area Working Group) {{Cite web | url=https://tools.ietf.org/html/draft-ietf-tsvwg-multipath-dccp | title=Draft-ietf-TSVWG-multipath-DCCP-04 }} dubbed as MP-DCCP.

A deep Reinforcement Learning (DRL) framework for joint congestion control and packet scheduling with an intelligent agent that leverages policy gradients is developed to learn optimal congestion control and scheduling strategies from experience.

{{cite journal|title= Learning to Harness Bandwidth With Multipath Congestion Control and Scheduling |journal= IEEE Transactions on Mobile Computing |volume=22 |issue=2 |pages=996–1009 |author1=S. Pokhrel |author2=A. Walid |date=2023-02-01|doi=10.1109/TMC.2021.3085598|s2cid= 69245415 |arxiv=2105.14271 }} The advantage of DRL-based Multipath TCP has been shown for fair and efficient distributed edge learning application.{{cite journal|title= Fair and Efficient Distributed Edge Learning With Hybrid Multipath TCP |journal= IEEE/ACM Transactions on Networking |volume=31 |issue=4 |pages=1582–1594 |author1=S. Pokhrel|author2=J. Choi|author3=A. Walid |date=2023|doi=10.1109/TNET.2022.3219924|s2cid= 98245675|arxiv=2211.09723 }}

At the session layer, the Mobile Access Router project experimented in 2003 with the aggregation of multiple wireless accesses with heterogeneous technologies, transparently balancing traffic between them in response to the perceived performance of each of them.{{cite web|url=http://www.cl.cam.ac.uk/research/srg/netos/coms/mar.htm

|title=Mobile Access Router

|author1=R. Chakravorty |author2=I. Pratt |author3=P. Rodriguez |publisher= University of Cambridge, Microsoft Research

|date=2003-07-01

}}

Parallel access schemes used to accelerate transfers by taking advantage of HTTP range requests to initiate connections to multiple servers of a replicated content, are not equivalent to Multipath TCP as they involve the application layer and are limited to content of known size.

• {{IETF RFC|6181|link=no}} - Threat Analysis for TCP Extensions for Multipath Operation with Multiple Addresses
• {{IETF RFC|6182|link=no}} - Architectural Guidelines for Multipath TCP Development
• {{IETF RFC|6356|link=no}} - Coupled Congestion Control for Multipath Transport Protocols
• {{IETF RFC|6824|link=no}} - TCP Extensions for Multipath Operation with Multiple Addresses (v0; replaced by RFC 8684)
• {{IETF RFC|6897|link=no}} - Multipath TCP (MPTCP) Application Interface Considerations
• {{IETF RFC|7430|link=no}} - Analysis of Residual Threats and Possible Fixes for Multipath TCP (MPTCP)
• {{IETF RFC|8041|link=no}} - Use Cases and Operational Experience with Multipath TCP
• {{IETF RFC|8684|link=no}} - TCP Extensions for Multipath Operation with Multiple Addresses (v1)
• {{IETF RFC|8803|link=no}} - 0-RTT TCP Convert Protocol

• Transport protocol comparison table

{{Reflist|30em}}

{{Wikiversity | Transmission Control Protocol}}

• [https://www.mptcp.dev The Linux Kernel MultiPath TCP project]
• [http://www.multipath-tcp.org The Linux Kernel MultiPath TCP project] (former website)
• [https://lwn.net/Articles/544399/ A clear article explaining the Linux MPTCP implementation]

Category:TCP extensions