Jump to content

Matrix (protocol)

From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by Interneedus (talk | contribs) at 21:39, 1 May 2021 (History). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

Matrix
Communication protocol
[matrix]
PurposeFederated messaging and data synchronization
Developer(s)The Matrix.org Foundation CIC
IntroductionSeptember 2014; 10 years ago (2014-09)[1][failed verification]
Based onHTTP, WebRTC
OSI layerApplication layer
Websitematrix.org

Matrix (sometimes stylized as [matrix][disputeddiscuss]) is an open standard and communication protocol for real-time communication. It aims to make real-time communication work seamlessly between different service providers, in the way that standard Simple Mail Transfer Protocol email currently does for store-and-forward email service, by allowing users with accounts at one communications service provider to communicate with users of a different service provider via online chat, voice over IP, and videotelephony. It therefore serves a similar purpose to protocols like XMPP, but is not based on any existing communication protocol.[2]

From a technical perspective, it is an application layer communication protocol for federated real-time communication. It provides HTTP APIs and open source reference implementations for securely distributing and persisting messages in JSON format over an open federation of servers.[3][4] It can integrate with standard web services via WebRTC, facilitating browser-to-browser applications.

History

The initial project was created inside Amdocs, while building a chat tool called "Amdocs Unified Communications",[5] by Matthew Hodgson and Amandine Le Pape. Amdocs then funded most of the development work from 2014 to October 2017.[6] Matrix was the winner of the Innovation award at WebRTC 2014 Conference & Expo,[7] and of the "Best in Show" award at WebRTC World in 2015.[8] The protocol received praise mixed with some cautionary notes after it launched in 2014. Reviewers noted that other attempts at defining an open instant messaging or multimedia signalling protocol of this type had difficulties becoming widely adopted—e.g. XMPP and IRCv3—and have highlighted the challenges involved, both technological and political.[9] Some were unclear if there was enough demand among users for services which interoperate among providers.[10][11] In 2015, a subsidiary of Amdocs was created, named "Vector Creations Limited", and the Matrix staff was moved there.[12]

In July 2017, the funding by Amdocs was announced to be cut and in the following weeks the core team created their own UK-based company, "New Vector Limited",[13] which was mainly built to support the development of Matrix and Riot, which was later renamed to Element.[14] During this time period, there were multiple calls for support to the community and companies that build on Matrix,[15] to help pay for the wages of at least part of the core team. Patreon and Liberapay crowdfunding accounts were created,[16] and the core team started a video podcast, called Matrix "Live" to keep the contributors up to speed with ongoing developments.[17] This was expanded by a weekly blog format, called "This Week in Matrix", where interested community members could read, or submit their own, Matrix-related news.[18] The company was created with the goal of offering consultancy services for Matrix and paid hosting of Matrix servers (as a platform called modular.im, which was later renamed to Element matrix services[19]) to generate income.[20]

In the early weeks after its creation, the Matrix team and the company Purism published plans to collaborate in the creation of the Librem 5 phone.[21] The Librem 5 was intended to be a Matrix native phone, where the default pre-installed messaging and caller app should use Matrix for audio and video calls and instant messaging.[22]

In 2017, KDE announced it was working on including support for the protocol in its IRC client Konversation.[23]

In late January 2018, the company received an investment of USD $5 million from Status,[24][25] an  Ethereum based startup.

In April 2018, the French Government announced plans to create their own instant messaging tool.[26] Work on the application based on Riot and Matrix protocol—called Tchap after French scientists Claude Chappe—had started in early 2018[27] and the program was open-sourced and released on iOS and Android in April 2019.[28]

In October 2018, a Community Interest Company called "The Matrix.org Foundation C.I.C."[29] was incorporated, to serve as a neutral legal entity for further development of the standard.[30]

In February 2019, the KDE community announced plans to adopt Matrix for its internal communications needs, as a decentralized alternative to other instant messaging servers like Telegram, Slack, and Discord, and operate its own server instance.[31]

In April 2019, Matrix.org suffered a security breach in which the production servers were compromised.[32] This breach was not an issue with the Matrix protocol and did not directly affect home servers other than matrix.org.

In June 2019, the Matrix protocol is out of beta with the version 1.0 across all APIs (and Synapse, at the time the reference home server), and the Matrix foundation is officially launched.[33][34]

In October 2019, New Vector raised an additional USD $8.5 million to develop Matrix.[35]

In December 2019 German Ministry of Defense announced a pilot project called BwMessenger for secure instant messaging tool based on Matrix protocol, Synapse server and Riot application. This is modeled after French Tchap project. The long-term goal of the Federal Government is the secure use of messenger services that covers all ministries and subordinate authorities.[36]

In December 2019 Mozilla announced that it would begin to use Matrix as a replacement for IRC. In the announcement, they said that they would be completing the move in late January 2020. The Mozilla IRC server, irc.mozilla.org, is said to be removed "no later than March of next year [2020]".[37] In March 2020 the IRC server was turned off and users were directed to join chat.mozilla.org, Mozilla's Element instance.[38]

In May 2020 Matrix enabled end-to-end encryption by default for private conversations.[39]

In October 2020 Element acquired Gitter from GitLab.[40] This meant that all Gitter users would be transitioned over to Matrix.[41]

In March 2021, matrix.org announced that there are 28 million global visible accounts.[42]

Protocol

Matrix network

Matrix targets use cases like voice over IP, Internet of Things and instant messaging, including group communication, along with a longer-term goal to be a generic messaging and data synchronization system for the web. The protocol supports security and replication, maintaining full conversation history, with no single points of control or failure. Existing communication services can integrate with the Matrix ecosystem.[3]

Client software is available for open-federated Instant Messaging (IM), voice over IP (VoIP) and Internet of Things (IoT) communication.

The Matrix standard specifies RESTful HTTP APIs for securely transmitting and replicating JSON data between Matrix-capable clients, servers and services. Clients send data by PUTing it to a ‘room’ on their server, which then replicates the data over all the Matrix servers participating in this ‘room’. This data is signed using a git-style signature to mitigate tampering, and the federated traffic is encrypted with HTTPS and signed with each server’s private key to avoid spoofing. Replication follows eventual consistency semantics, allowing servers to function even if offline or after data-loss by re-synchronizing missing history from other participating servers.

The Olm library provides for optional end-to-end encryption on a room-by-room basis via a Double Ratchet Algorithm implementation.[1] It can ensure that conversation data at rest is only readable by the room participants. With it configured, data transmitted over Matrix is only visible as ciphertext to the Matrix servers, and can be decrypted only by authorized participants in the room. The Olm and Megolm (an expansion of Olm to better suit the need for bigger rooms) libraries have been subject of a cryptographic review by NCC Group, whose findings are publicly available,[43] and have been addressed by the Matrix team.[44] The review was sponsored by the Open Technology Fund.

Bridges

Matrix supports bridging messages from different chat applications into Matrix rooms. These bridges are programs that run on the server and communicate with the non-Matrix servers. Bridges can either be acting as puppets or relays, where in the former the individual users account is visibly posting the messages, and in the latter a bot posts the messages for non puppeteered user accounts.

Currently there are official bridges for:

Bridges for the following notable applications are maintained by the community:

Clients

Logos : Element, GNOME Fractal, Quaternion, Neochat, Nheko and Revolt

Element is the reference implementation of a client. Many other clients, bots, bridges, servers and other implementations of the Matrix protocol also exist.[55]

Servers

Synapse is the reference implementation of a Matrix home server, written in Python.[56] There is a "second generation Matrix home server"[57] called Dendrite being developed by the Matrix core team. Dendrite is written in Go and is currently in beta, as of 8 October 2020.[58]

The following community maintained server implementations also exist:

Community Maintained Server Implementations
Project Main Language
Construct[59] C++
Conduit[60] Rust
Mascarene[61] Scala

See also

References

  1. ^ a b Ermoshina, Ksenia; Musiani, Francesca; Halpin, Harry (September 2016). "End-to-End Encrypted Messaging Protocols: An Overview". In Bagnoli, Franco; et al. (eds.). Internet Science. INSCI 2016. Florence, Italy: Springer. pp. 244–254. doi:10.1007/978-3-319-45982-0_22. ISBN 978-3-319-45982-0.
  2. ^ https://www.kuketz-blog.de/messenger-matrix-das-xmpp-fuer-hobby-admins/
  3. ^ a b Nathan Willis (2015-02-11). "Matrix: a new specification for federated realtime chat". LWN.net. Retrieved 2015-06-28.
  4. ^ Adrian Bridgwater (2014-09-09). "Matrix.org Reloads Inside "Illusion of Control" Vortex". Dr. Dobb's Journal. Retrieved 2015-07-20.
  5. ^ "Unified Communications". amdocs. Archived from the original on 2014-10-03. Retrieved 2018-11-04.
  6. ^ "Who is Matrix.org?". matrix.org. 2019-02-20. Archived from the original on 2019-03-29. Retrieved 2018-10-20.[self-published source]
  7. ^ "Award Winners of the WebRTC 2014 Conference & Expo". Upperside Blog. 2014-12-23. Archived from the original on 2015-03-15. Retrieved 2015-06-28.
  8. ^ Phil Edholm (2015-05-18). "WebRTC World Miami Wrap Up and Review". WebRTC. Retrieved 2015-06-28.
  9. ^ Andrew Prokop (2015-02-23). "Solving the WebRTC Interoperability Problem - Post". No Jitter. Retrieved 2015-06-28.
  10. ^ Ian Scales (2015-05-11). "To interop or not to interop? Is Matrix.org the answer for silo'd comms services?". TelecomTV. Retrieved 2015-06-22.
  11. ^ Matt Weinberger (2014-09-16). "Matrix wants to smash the walled gardens of messaging". ITworld. Retrieved 2015-07-20.
  12. ^ "Linkedin entry for Vector Creations Limited". Retrieved 2018-10-22.[self-published source]
  13. ^ "Free company information from Companies House (UK Government)". Retrieved 2018-07-30.
  14. ^ "New Vector - We believe the future will be open and decentralized". New Vector. Retrieved 2018-10-20.[self-published source]
  15. ^ "A Call to Arms: Supporting Matrix!". matrix.org. 2017-07-07. Retrieved 2018-10-20.[self-published source]
  16. ^ "Hello world! | Matrix.org on Patreon". Patreon. Retrieved 2018-11-04.[self-published source]
  17. ^ Matrixdotorg (2017-07-21), Matrix Live - Episode 1: July 14th 2017, retrieved 2018-10-22[self-published source]
  18. ^ "This Week in Matrix". matrix.org. Retrieved 2018-10-22.[self-published source]
  19. ^ "Element Secure instant messenger | Riot.im download | End-to-end messages encryption and open network". element.io. Retrieved 2020-11-01.
  20. ^ "Awesome hosting for Matrix". www.modular.im. Retrieved 2018-10-20.[self-published source]
  21. ^ Armasu, Lucian (2018-06-06). "Purism's Privacy-Focused Librem 5 Smartphone's On Track For A Jan '19 Release". Tom's Hardware. Retrieved 2018-11-04.
  22. ^ "Librem 5 – A Security and Privacy Focused Phone". shop.puri.sm. Retrieved 2018-11-04.[self-published source]
  23. ^ https://blogs.kde.org/2017/09/05/konversation-2x-2018-new-user-interface-matrix-support-mobile-version[self-published source]
  24. ^ Rogers, Stewart (2018-01-29). "Status invests $5 million in Matrix to create a blockchain messaging superpower". VentureBeat. Retrieved 2018-10-20.
  25. ^ "Status Invests $5M In Riot.im". Status Blog. 2018-01-29. Archived from the original on 2018-01-30. Retrieved 2018-10-20.[self-published source]
  26. ^ Rosemain, Mathieu. "France builds WhatsApp rival due to surveillance risk". U.S. Retrieved 2018-11-04.
  27. ^ Kaminsky, Jean (2018-04-22). "L'Etat lance un "Telegram" à la française cet été, ouvert à tous". Solutions Numériques (in French). Retrieved 2019-12-28. Après 3 mois de développement pour un coût très limité [...]
  28. ^ Cimpanu, Catalin. "French government releases in-house IM app to replace WhatsApp and Telegram use". ZDNet. Retrieved 2019-12-28.
  29. ^ "THE MATRIX.ORG FOUNDATION – Overview (free company information from Companies House)". beta.companieshouse.gov.uk. Retrieved 2018-11-04.
  30. ^ "Introducing the Matrix.org Foundation (Part 1 of 2)". matrix.org. 2018-10-29. Retrieved 2018-11-04.[self-published source]
  31. ^ Michael Larabel (2019-02-20). "KDE To Support Matrix Decentralized Instant Messaging". Phoronix. Retrieved 2019-02-20.
  32. ^ "We have discovered and addressed a security breach". Matrix.org. Retrieved 2019-04-12.[self-published source]
  33. ^ https://matrix.org/blog/2019/06/11/introducing-matrix-1-0-and-the-matrix-org-foundation/
  34. ^ https://matrix.org/blog/2019/06/11/synapse-1-0-0-released/
  35. ^ "New Vector scores $8.5M to plug more users into its open, decentralized messaging Matrix". TechCrunch. Retrieved 2019-12-18.
  36. ^ online, heise. "Open Source: Bundeswehr baut eigene verschlüsselte Messenger-App". heise online (in German). Retrieved 2019-12-28.
  37. ^ https://discourse.mozilla.org/t/synchronous-messaging-at-mozilla-the-decision/50620
  38. ^ "Moznet IRC is dead; long live Mozilla Matrix!". Matrix.org. Retrieved 2020-10-31.
  39. ^ https://matrix.org/blog/2020/05/06/cross-signing-and-end-to-end-encryption-by-default-is-here
  40. ^ "Gitter is joining Element". Element Blog. 2020-09-30. Retrieved 2020-11-01.
  41. ^ "Welcoming Gitter to Matrix!". Matrix.org. Retrieved 2020-11-01.
  42. ^ "FOSDEM 2021: Building massive virtual communities in Matrix". Retrieved 31 March 2021.
  43. ^ Alex Balducci; Jake Meredith (18 November 2016). "Matrix Olm Cryptographic Review". www.nccgroup.trust. Retrieved 2018-10-20.
  44. ^ "Matrix's 'Olm' End-to-end Encryption security assessment released – and implemented cross-platform on Riot at last!". matrix.org. 2016-11-21. Retrieved 2018-10-20.[self-published source]
  45. ^ "matrix-org/matrix-appservice-gitter". GitHub. 2018-09-27. Retrieved 2018-10-20.[self-published source]
  46. ^ "matrix-org/matrix-appservice-irc". GitHub. Retrieved 2018-10-20.[self-published source]
  47. ^ "matrix-org/matrix-appservice-slack". GitHub. Retrieved 2018-10-20.[self-published source]
  48. ^ GitHub - matrix-org/matrix-appservice-purple: General purpose bridging using libpurple ., matrix.org, 2018-12-29, retrieved 2018-12-31[self-published source]
  49. ^ "Half-Shot/matrix-appservice-discord". GitHub. Retrieved 2018-10-20.[self-published source]
  50. ^ "tulir/mautrix-facebook". GitHub. Retrieved 2020-04-27.[self-published source]
  51. ^ A Matrix-Signal puppeting bridge, Tulir Asokan, 2021-02-06, retrieved 2021-02-06[self-published source]
  52. ^ skype-bridge, matrix.org, 2020-05-16, retrieved 2020-05-16[self-published source]
  53. ^ "tulir/mautrix-telegram". GitHub. Retrieved 2018-10-20.[self-published source]
  54. ^ "tulir/mautrix-whatsapp". GitHub. Retrieved 2018-10-20.[self-published source]
  55. ^ "Try Matrix Now!". Matrix.org. Retrieved 13 August 2017.[self-published source]
  56. ^ "matrix-org/synapse". GitHub. Retrieved 2020-04-27.[self-published source]
  57. ^ "matrix-org/dendrite". GitHub. Retrieved 2020-04-27.[self-published source]
  58. ^ "Dendrite is entering Beta!". Matrix.org. Retrieved 2020-10-27.
  59. ^ "matrix-construct/construct". GitHub. Retrieved 2020-04-27.[self-published source]
  60. ^ "Famedly / Conduit". GitLab. Retrieved 2020-11-01.
  61. ^ "mascarene/mascarene". Gitlab. Retrieved 2020-04-27.[self-published source]