AV1
Internet media type | video/AV1, video/webm; codecs="av01.*" |
---|---|
Developed by | Alliance for Open Media |
Initial release | 28 March 2018 |
Latest release | 1.0.0 Errata 1[1] 8 January 2019 |
Type of format | Video coding format |
Contained by | |
Extended from | |
Extended to | AVIF |
Standard | AOM AV1 |
Free format? | Yes |
Website | aomedia |
AOMedia Video 1 (AV1) is an open, royalty-free video coding format initially designed for video transmissions over the Internet. It was developed as a successor to VP9 by the Alliance for Open Media (AOMedia),[2] a consortium founded in 2015 that includes semiconductor firms, video on demand providers, video content producers, software development companies and web browser vendors. The AV1 bitstream specification includes a reference video codec.[1] In 2018 Facebook conducted testing that approximates real world conditions, the AV1 reference encoder achieved 34%, 46.2% and 50.3% higher data compression than libvpx-vp9, x264 high profile, and x264 main profile respectively.
Like VP9, but unlike H.264/AVC and HEVC, AV1 has a royalty-free licensing model that does not hinder adoption in open-source projects.[3][4][5][6][2][7]
AV1 Image File Format (AVIF) is an image file format that uses AV1 compression algorithms.
History
The Alliance's motivations for creating AV1 included the high cost and uncertainty involved with the patent licensing of HEVC, the MPEG-designed codec expected to succeed AVC.[8][6] Additionally, the Alliance's seven founding members – Amazon, Cisco, Google, Intel, Microsoft, Mozilla and Netflix – announced that the initial focus of the video format would be delivery of high-quality web video.[9] The official announcement of AV1 came with the press release on the formation of the Alliance for Open Media on 1 September 2015. Only 42 days before, on 21 July 2015, HEVC Advance's initial licensing offer was announced to be an increase over the royalty fees of its predecessor, AVC.[10] In addition to the increased cost, the complexity of the licensing process increased with HEVC. Unlike previous MPEG standards where the technology in the standard could be licensed from a single entity, MPEG-LA, when the HEVC standard was finished, two patent pools had been formed with a third pool was on the horizon. In addition, various patent holders were refusing to license patents via either pool, increasing uncertainty about HEVC's licensing. According to Microsoft's Ian LeGrow, an open-source, royalty-free technology was seen as the easiest way to eliminate this uncertainty around licensing.[8]
The negative effect of patent licensing on free and open-source software has also been cited as a reason for the creation of AV1.[6] For example, building an H.264 implementation into Firefox would prevent it from being distributed free of charge since licensing fees would have to be paid to MPEG-LA.[11] Free Software Foundation Europe has argued that FRAND patent licensing practices make the free software implementation of standards impossible due to various incompatibilities with free software licenses.[7]
Many of the components of the AV1 project were sourced from previous research efforts by Alliance members. Individual contributors started experimental technology platforms years before: Xiph's/Mozilla's Daala already published code in 2010, Google's experimental VP9 evolution project VP10 was announced on 12 September 2014,[12] and Cisco's Thor was published on 11 August 2015. Building on the code base of VP9, AV1 incorporates additional techniques, several of which were developed in these experimental formats.[13] The first version 0.1.0 of the AV1 reference codec was published on 7 April 2016.
Although a soft feature freeze came into effect at the end of October 2017, development continued on several significant features. One of these in-progress features, the bitstream format, was projected to be frozen in January 2018 but was delayed due to unresolved critical bugs as well as further changes to transformations, syntax, the prediction of motion vectors, and the completion of legal analysis.[citation needed] The Alliance announced the release of the AV1 bitstream specification on 28 March 2018, along with a reference, software-based encoder and decoder.[14] On 25 June 2018, a validated version 1.0.0 of the specification was released.[15] On 8 January 2019 a validated version 1.0.0 with Errata 1 of the specification was released.
Martin Smole from AOM member Bitmovin said that the computational efficiency of the reference encoder was the greatest remaining challenge after the bitstream format freeze had been completed.[16] While still working on the format, the encoder was not targeted for production use and speed optimizations were not prioritized. Consequently, the early version of AV1 was orders of magnitude slower than existing HEVC encoders. Much of the development effort was consequently shifted towards maturing the reference encoder. In March 2019, it was reported that the speed of the reference encoder had improved greatly and within the same order of magnitude as encoders for other common formats.[17]
Purpose
AV1 aims to be a video format for the web that is both state of the art and royalty free.[2] The mission of the Alliance for Open Media is the same as that of the WebM project.
A recurring concern in standards development, not least of royalty-free multimedia formats, is the danger of accidentally infringing on patents that their creators and users didn't know about. The concern has been raised regarding AV1,[18] and previously VP8,[19] VP9,[20] Theora[21] and IVC.[22] The problem is not unique to royalty-free formats, but it uniquely threatens their status as royalty-free.
Patent licensing | AV1, VP9, Theora | HEVC, AVC | GIF, MP3, MPEG-1, MPEG-2, MPEG-4 Part 2 |
---|---|---|---|
By known patent holders | Royalty-free | Royalty bearing | Patents expired |
By unknown patent holders | Impossible to ascertain until the format is old enough that any patents would have expired |
To fulfill the goal of being royalty free, the development process requires that no feature can be adopted before it has been confirmed independently by two separate parties to not infringe on patents of competing companies. In cases where an alternative to a patent-protected technique is not available, owners of relevant patents have been invited to join the Alliance (even if they were already members of another patent pool). For example, Alliance members Apple, Cisco, Google, and Microsoft are also licensors in MPEG-LA's patent pool for H.264.[18] As an additional protection for the royalty-free status of AV1, the Alliance has a legal defense fund to aid smaller Alliance members or AV1 licensees in the event they are sued for alleged patent infringement.[18][5][23]
Under patent rules adopted from the World Wide Web Consortium (W3C), technology contributors license their AV1-connected patents to anyone, anywhere, anytime based on reciprocity (i.e. as long as the user does not engage in patent litigation).[24] As a defensive condition, anyone engaging in patent litigation loses the right to the patents of all patent holders.[citation needed][25]
This treatment of intellectual property rights (IPR), and its absolute priority during development, is contrary to extant MPEG formats like AVC and HEVC. These were developed under an IPR uninvolvement policy by their standardization organisations, as stipulated in the ITU-T's definition of an open standard. However, MPEG's chairman has argued this practice has to change,[26] which it is:[citation needed] EVC is also set to have a royalty-free subset,[27][28] and will have switchable features in its bitstream to defend against future IPR threats.[citation needed]
The creation of royalty-free web standards has been a long-stated pursuit for the industry. In 2007, the proposal for HTML5 video specified Theora as mandatory to implement. The reason was that public content should be encoded in freely implementable formats, if only as a "baseline format", and that changing such a baseline format later would be hard because of network effects.[29] The Alliance for Open Media is a continuation of Google's efforts with the WebM project, which renewed the royalty-free competition after Theora had been surpassed by AVC. For companies such as Mozilla that distribute free software, AVC can be difficult to support as a per-copy royalty easily is unsustainable given the lack of revenue stream to support these payments in free software (see FRAND § Excluding costless distribution).[3] Similarly, HEVC has not successfully convinced all licensors to allow an exception for freely distributed software (see HEVC § Provision for costless software).
The performance goals include "a step up from VP9 and HEVC" in efficiency for a low increase in complexity. NETVC's efficiency goal is 25% improvement over HEVC.[30] The primary complexity concern is for software decoding, since hardware support will take time to reach users. However, for WebRTC, live encoding performance is also relevant, which is Cisco's agenda: Cisco is a manufacturer of videoconferencing equipment, and their Thor contributions aim at "reasonable compression at only moderate complexity".[31]
Feature wise, AV1 is specifically designed for real-time applications (especially WebRTC) and higher resolutions (wider color gamuts, higher frame rates, UHD) than typical usage scenarios of the current generation (H.264) of video formats, where it is expected to achieve its biggest efficiency gains. It is therefore planned to support the color space from ITU-R Recommendation BT.2020 and up to 12 bits of precision per color component.[32] AV1 is primarily intended for lossy encoding, although lossless compression is supported as well.[33]
Technology
AV1 is a traditional block-based frequency transform format featuring new techniques. Based on Google's VP9,[34] AV1 incorporates additional techniques that mainly give encoders more coding options to enable better adaptation to different types of input.
Developer(s) | Alliance for Open Media |
---|---|
Stable release | 3.1.0[35]
/ 3 May 2021 |
Written in | C, assembly |
License | BSD 2-Clause License (free software) |
Website | aomedia.googlesource.com/aom |
The Alliance published a reference implementation written in C and assembly language (aomenc
, aomdec
) as free software under the terms of the BSD 2-Clause License.[36] Development happens in public and is open for contributions, regardless of AOM membership.
The development process was such that coding tools were added to the reference code base as experiments, controlled by flags that enable or disable them at build time, for review by other group members as well as specialized teams that helped with and ensured hardware friendliness and compliance with intellectual property rights (TAPAS). When the feature gained some support in the community, the experiment was enabled by default, and ultimately had its flag removed when all of the reviews were passed.[37] Experiment names were lowercased in the configure script and uppercased in conditional compilation flags.[citation needed]
To better and more reliably support HDR and color spaces, corresponding metadata can now be integrated into the video bitstream instead of being signaled in the container.
Partitioning
Frame content is separated into adjacent same-sized blocks referred to as superblocks. Similar to the concept of a macroblock, superblocks are square-shaped and can either be of size 128×128 or 64×64 pixels. Superblocks can be divided in smaller blocks according to different partitioning patterns. The four-way split pattern is the only pattern whose partitions can be recursively subdivided. This allows superblocks to be divided into partitions as small as 4×4 pixels.
"T-shaped" partitioning patterns are introduced, a feature developed for VP10, as well as horizontal or vertical splits into four stripes of 4:1 and 1:4 aspect ratio. The available partitioning patterns vary according to the block size, both 128×128 and 8×8 blocks can't use 4:1 and 1:4 splits. Moreover, 8×8 blocks can't use "T" shaped splits.
Two separate predictions can now be used on spatially different parts of a block using a smooth, oblique transition line (wedge-partitioned prediction).[citation needed] This enables more accurate separation of objects without the traditional staircase lines along the boundaries of square blocks.
More encoder parallelism is possible thanks to configurable prediction dependency between tile rows (ext_tile
).[38]
Prediction
AV1 performs internal processing in higher precision (10 or 12 bits per sample), which leads to compression improvement due to smaller rounding errors in reference imagery.
Predictions can be combined in more advanced ways (than a uniform average) in a block (compound prediction), including smooth and sharp transition gradients in different directions (wedge-partitioned prediction) as well as implicit masks that are based on the difference between the two predictors. This allows combination of either two inter predictions or an inter and an intra prediction to be used in the same block.[39][citation needed]
A frame can reference 6 instead of 3 of the 8 available frame buffers for temporal (inter) prediction while providing more flexibility on bi-prediction[40] (ext_refs
[citation needed]).
The Warped Motion (warped_motion
)[38] and Global Motion (global_motion
[citation needed]) tools in AV1 aim to reduce redundant information in motion vectors by recognizing patterns arising from camera motion.[38] They implement ideas that were tried to be exploited in preceding formats like e.g. MPEG-4 ASP, albeit with a novel approach that works in three dimensions. There can be a set of warping parameters for a whole frame offered in the bitstream, or blocks can use a set of implicit local parameters that get computed based on surrounding blocks.
Switch frames (S-frame) are a new inter-frame type that can be predicted using already decoded reference frames from a higher-resolution version of the same video to allow switching to a lower resolution without the need for a full keyframe at the beginning of a video segment in the adaptive bitrate streaming use case.[41]
Intra Prediction
Intra prediction consists of predicting the pixels of a given blocks only using information available in the current frame. Most often, intra predictions are built from the neighboring pixels above and to the left of the predicted block. The DC predictor builds a prediction by averaging the pixels above and to the left of block.
Directional predictors extrapolate these neighboring pixels according to a specified angle. In AV1, 8 main directional modes can be chosen. These modes start at an angle of 45 degrees and increase by a step size of 22.5 degrees up until 203 degrees. Furthermore, for each directional mode, six offsets of 3 degree can be signaled for bigger blocks, three above the main angle and three below it, resulting in a total of 56 angles (ext_intra
).
The "TrueMotion" predictor got replaced with a Paeth predictor which looks at the difference from the known pixel in the above left corner to the pixel directly above and directly left of the new one and then chooses the one that lies in direction of the smaller gradient as predictor. A palette predictor is available for blocks with very few (up to 8, dominant) colors like in some computer screen content. Correlations between the luminosity and the color information can now be exploited with a predictor for chroma blocks that is based on samples from the luma plane (cfl
).[38] In order to reduce visible boundaries along borders of inter-predicted blocks, a technique called overlapped block motion compensation (OBMC) can be used. This involves extending a block's size so that it overlaps with neighboring blocks by 2 to 32 pixels, and blending the overlapping parts together.[42]
Data transformation
To transform the error remaining after prediction to the frequency domain, AV1 encoders can use square, 2:1/1:2, and 4:1/1:4 rectangular DCTs (rect_tx
),[40] as well as an asymmetric DST[43][44][45] for blocks where the top and/or left edge is expected to have lower error thanks to prediction from nearby pixels, or choose to do no transform (identity transform).
It can combine two one-dimensional transforms in order to use different transforms for the horizontal and the vertical dimension (ext_tx
).[38][40]
Quantization
AV1 has new optimized quantization matrices (aom_qm
).[citation needed] The eight sets of quantization parameters that can be selected and signaled for each frame now have individual parameters for the two chroma planes and can use spatial prediction. On every new superblock, the quantization parameters can be adjusted by signaling an offset.
Filters
For the in-loop filtering step, the integration of Thor's constrained low-pass filter and Daala's directional deringing filter has been fruitful: The combined Constrained Directional Enhancement Filter (cdef
[citation needed]) exceeds the results of using the original filters separately or together.[citation needed]
It is an edge-directed conditional replacement filter that smooths blocks with configurable (signaled) strength roughly along the direction of the dominant edge to eliminate ringing artifacts.
There is also the loop restoration filter (loop_restoration
) based on the Wiener filter and self-guided restoration filters to remove blur artifacts due to block processing.[38]
Film grain synthesis (film_grain
) improves coding of noisy signals using a parametric video coding approach.
Due to the randomness inherent to film grain noise, this signal component is traditionally either very expensive to code or prone to get damaged or lost, possibly leaving serious coding artifacts as residue. This tool circumvents these problems using analysis and synthesis, replacing parts of the signal with a visually similar synthetic texture, based solely on subjective visual impression instead of objective similarity. It removes the grain component from the signal, analyzes its non-random characteristics, and instead transmits only descriptive parameters to the decoder, which adds back a synthetic, pseudorandom noise signal that's shaped after the original component. It is the visual equivalent of the Perceptual Noise Substitution technique used in AC3, AAC, Vorbis, and Opus audio codecs.
Entropy coding
Daala's entropy coder (daala_ec
[citation needed]), a non-binary arithmetic coder, was selected for replacing VP9's binary entropy coder. The use of non-binary arithmetic coding helps evade patents, but also adds bit-level parallelism to an otherwise serial process, reducing clock rate demands on hardware implementations.[citation needed] This is to say that the effectiveness of modern binary arithmetic coding like CABAC is being approached using a greater alphabet than binary, hence greater speed, as in Huffman code (but not as simple and fast as Huffman code).
AV1 also gained the ability to adapt the symbol probabilities in the arithmetic coder per coded symbol instead of per frame (ec_adapt
).[38]
Scalable video coding
Of main importance to video conferencing, scalable video coding is a general technique, not unique to AV1, of restricting and structuring video frame dependencies so that one or more lower bitrate video streams are extractable from a higher bitrate stream with better quality. This differs from adaptive bitrate streaming in that some compression efficiency in each higher bitrate adaptation is given up for the benefit of that of the overall stream. The encoding process is also less redundant and demanding.
AV1 has provisions for temporal and spatial scalability.[46] This is to say that both framerate and resolution are usable ways to define a lower bitrate substream.
Quality and efficiency
A first comparison from the beginning of June 2016[47][by whom?] found AV1 roughly on par with HEVC, as did one using code from late January 2017.[48]
In April 2017, using the 8 enabled experimental features at the time (of 77 total), Bitmovin was able to demonstrate favorable objective metrics, as well as visual results, compared to HEVC on the Sintel and Tears of Steel short films.[49] A follow-up comparison by Jan Ozer of Streaming Media Magazine confirmed this, and concluded that "AV1 is at least as good as HEVC now".[50] Ozer noted that his and Bitmovin's results contradicted a comparison by Fraunhofer Institute for Telecommunications from late 2016[51] that had found AV1 65.7% less efficient than HEVC, underperforming even H.264/AVC which they concluded as being 10.5% more efficient, and justified this discrepancy by having used encoding parameters endorsed by each encoder vendor, as well as having more features in the newer AV1 encoder.[51] Decoding performance was at about half the speed of VP9 according to internal measurements from 2017.[41]
Tests from Netflix in 2017, based on measurements with PSNR and VMAF at 720p, showed that AV1 was about 25% more efficient than VP9 (libvpx).[52] Tests from Facebook conducted in 2018, based on PSNR, showed that the AV1 reference encoder was able to achieve 34%, 46.2% and 50.3% higher data compression than libvpx-vp9, x264 high profile, and x264 main profile respectively.[53][54]
Tests from Moscow State University in 2017 found that VP9 required 31% and HEVC 22% more bitrate than AV1 in order to achieve similar levels of quality.[55] The AV1 encoder was operating at a speed "2500–3500 times lower than competitors" due to the lack of optimization (which was not available at that time).[56]
Tests from University of Waterloo in 2020 found that when using a mean opinion score (MOS) for 2160p (4K) video AV1 had bitrate saving of 9.5% compared to HEVC and 16.4% compared to VP9. They also however concluded that at the time of the study at 2160p the AV1 video encodes on average took 590× longer compared to encoding with AVC; while HEVC took on average 4.2× longer and VP9 took on average 5.2× longer than AVC respectively.[57][58]
The latest encoder comparison by Streaming Media Magazine as of September 2020, which used moderate encoding speeds, VMAF, and a diverse set of short clips, indicated that the open-source libaom and SVT-AV1 (Scalable Video Technology for AV1) encoders took about twice as long time to encode as x265 in its "veryslow" preset while using 15-20% less bitrate, or about 45% less bitrate than x264 veryslow. The best-in-test AV1 encoder, Visionular's Aurora1, in its "slower" preset, was as fast as x265 veryslow while saving 50% bitrate over x264 veryslow.[59]
Profiles and levels
Profiles
AV1 defines three profiles for decoders which are Main, High, and Professional. The Main profile allows for a bit depth of 8- or 10-bits per sample with 4:0:0 (greyscale) and 4:2:0 (quarter) chroma sampling. The High profile further adds support for 4:4:4 chroma sampling (no subsampling). The Professional profile extends capabilities to full support for 4:0:0, 4:2:0, 4:2:2 (half) and 4:4:4 chroma sub-sampling with 8, 10 and 12 bit color depths.[14]
Main (0) | High (1) | Professional (2) | ||
---|---|---|---|---|
Bit depth | 8 or 10-bit | 8 or 10-bit | 8, 10 & 12 bit | |
Chroma subsampling | 4:0:0 | Yes | Yes | Yes |
4:2:0 | Yes | Yes | Yes | |
4:2:2 | No | No | Yes | |
4:4:4 | No | Yes | Yes |
Levels
AV1 defines levels for decoders with maximum variables for levels ranging from 2.0 to 6.3.[60] The levels that can be implemented depend on the hardware capability.
Example resolutions would be 426×240@30 fps for level 2.0, 854×480@30 fps for level 3.0, 1920×1080@30 fps for level 4.0, 3840×2160@60 fps for level 5.1, 3840×2160@120 fps for level 5.2, and 7680×4320@120 fps for level 6.2. Level 7 has not been defined yet.[61]
seq_level_idx | Level | MaxPicSize
(Samples) |
MaxHSize
(Samples) |
MaxVSize
(Samples) |
MaxDisplayRate
(Hz) |
MaxDecodeRate
(Hz) |
MaxHeader
Rate (Hz) |
MainMbps
(Mbit/s) |
HighMbps
(Mbit/s) |
Min Comp Basis | Max Tiles | Max Tile Cols | Example |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | 2.0 | 147456 | 2048 | 1152 | 4,423,680 | 5,529,600 | 150 | 1.5 | - | 2 | 8 | 4 | 426×240@30fps |
1 | 2.1 | 278784 | 2816 | 1584 | 8,363,520 | 10,454,400 | 150 | 3.0 | - | 2 | 8 | 4 | 640×360@30fps |
4 | 3.0 | 665856 | 4352 | 2448 | 19,975,680 | 24,969,600 | 150 | 6.0 | - | 2 | 16 | 6 | 854×480@30fps |
5 | 3.1 | 1065024 | 5504 | 3096 | 31,950,720 | 39,938,400 | 150 | 10.0 | - | 2 | 16 | 6 | 1280×720@30fps |
8 | 4.0 | 2359296 | 6144 | 3456 | 70,778,880 | 77,856,768 | 300 | 12.0 | 30.0 | 4 | 32 | 8 | 1920×1080@30fps |
9 | 4.1 | 2359296 | 6144 | 3456 | 141,557,760 | 155,713,536 | 300 | 20.0 | 50.0 | 4 | 32 | 8 | 1920×1080@60fps |
12 | 5.0 | 8912896 | 8192 | 4352 | 267,386,880 | 273,715,200 | 300 | 30.0 | 100.0 | 6 | 64 | 8 | 3840×2160@30fps |
13 | 5.1 | 8912896 | 8192 | 4352 | 534,773,760 | 547,430,400 | 300 | 40.0 | 160.0 | 8 | 64 | 8 | 3840×2160@60fps |
14 | 5.2 | 8912896 | 8192 | 4352 | 1,069,547,520 | 1,094,860,800 | 300 | 60.0 | 240.0 | 8 | 64 | 8 | 3840×2160@120fps |
15 | 5.3 | 8912896 | 8192 | 4352 | 1,069,547,520 | 1,176,502,272 | 300 | 60.0 | 240.0 | 8 | 64 | 8 | 3840×2160@120fps |
16 | 6.0 | 35651584 | 16384 | 8704 | 1,069,547,520 | 1,176,502,272 | 300 | 60.0 | 240.0 | 8 | 128 | 16 | 7680×4320@30fps |
17 | 6.1 | 35651584 | 16384 | 8704 | 2,139,095,040 | 2,189,721,600 | 300 | 100.0 | 480.0 | 8 | 128 | 16 | 7680×4320@60fps |
18 | 6.2 | 35651584 | 16384 | 8704 | 4,278,190,080 | 4,379,443,200 | 300 | 160.0 | 800.0 | 8 | 128 | 16 | 7680×4320@120fps |
19 | 6.3 | 35651584 | 16384 | 8704 | 4,278,190,080 | 4,706,009,088 | 300 | 160.0 | 800.0 | 8 | 128 | 16 | 7680×4320@120fps |
Supported container formats
- Standardized
- ISO Base Media File Format:[62] The ISOBMFF containerization spec by AOMedia was the first to be finalized and the first to gain adoption. This is the format used by YouTube.
- Matroska: Version 1 of the Matroska containerization spec[63] was published in late 2018.[64]
- Unfinished standards
- MPEG Transport Stream (MPEG TS)[65]
- Real-time Transport Protocol: A preliminary RTP packetization spec by AOMedia defines the transmission of AV1 OBUs directly as the RTP payload.[46] It defines an RTP header extension that carries information about video frames and their dependencies, which is of general usefulness to § scalable video coding. The carriage of raw video data also differs from for example MPEG TS over RTP in that other streams, such as audio, must be carried externally.
- Not standardized
- WebM: As a matter of formality, AV1 has not been sanctioned into the subset of Matroska known as WebM as of late 2019.[66]
- On2 IVF: This format was inherited from the first public release of VP8, where it served as a simple development container.[67] rav1e also supports this format.[68]
- Pre-standard WebM: Libaom featured early support for WebM, before Matroska containerization was specified, but has been changed to conform.[69]
Adoption
Content providers
In October 2016, Netflix stated they expected to be an early adopter of AV1.[70] On 5 February 2020, Netflix began using AV1 to stream select titles on Android, providing 20% improved compression efficiency over their VP9 streams.[71]
In 2018, YouTube began rolling out AV1, starting with its AV1 Beta Launch Playlist. According to the description, the videos are (to begin with) encoded at high bitrate to test decoding performance, and YouTube has "ambitious goals" for rolling out AV1. YouTube for Android TV supports playback of videos encoded in AV1 on capable platforms as of version 2.10.13, released in early 2020.[72]
In February 2019, Facebook, following their own positive test results, said they would gradually roll out AV1 as soon as browser support emerges, starting with their most popular videos.[53]
In June 2019, Vimeo's videos in the "Staff picks" channel were available in AV1.[73] Vimeo is using and contributing to Mozilla's Rav1e encoder and expects, with further encoder improvements, to eventually provide AV1 support for all videos uploaded to Vimeo as well as the company's "Live" offering.[73]
On 30 April 2020, iQIYI announced support for AV1 for users on PC web browsers and Android devices, according to the announcement, as the first Chinese video streaming site to adopt the AV1 format.[74]
Twitch plans to roll out AV1 for its most popular content in 2022 or 2023, with universal support projected to arrive in 2024 or 2025.[75]
Software implementations
- Libaom is the reference implementation. It includes an encoder (aomenc) and a decoder (aomdec). As the former research codec, it has the advantage of being made to justifiably demonstrate efficient use of every feature, but at the general cost of encoding speed. At feature freeze, the encoder had become problematically slow, but speed optimizations with negligible efficiency impact have continued to be made also after that.[76][17]
- rav1e is an encoder written in Rust and assembly.[68] rav1e takes the opposite developmental approach to Aomenc: start out as the simplest (therefore fastest) conforming encoder, and then improve efficiency over time while remaining fast.[76]
- SVT-AV1 Scalable Video Technology for AV1 includes an open-source encoder and decoder first released by Intel in February 2019 that is designed especially for usage on data center servers based on Intel Xeon processors. Netflix collaborates with Intel on SVT-AV1.[77][78]
- dav1d is a decoder written in C99 and assembly focused on speed and portability.[79] The first official version (0.1) was released in December 2018.[80] Version 0.2 was released in March 2019, with users able to "safely use the decoder on all platforms, with excellent performance", according to the developers.[81] Version 0.3 was announced in May 2019 with further optimizations demonstrating performance 2 to 5 times faster than aomdec.;[82] version 0.5 was released in October 2019.[83] Firefox 67 switched from Libaom to dav1d as a default decoder in May 2019.[84] In 2019, dav1d v0.5 was rated the best decoder in comparison to libgav1 and libaom.[85] dav1d 0.9.0 was released on May 17, 2021.[86]
- Cisco AV1 is a proprietary live encoder that Cisco developed for its Webex teleconference products. The encoder is optimized for latency[87] and the constraint of having a "usable CPU footprint", as with a "commodity laptop".[88] Cisco stressed that at their operating point – high speed, low latency – the large toolset of AV1 does not preclude a low encoding complexity.[87] Rather, the availability of tools for screen content and scalability in all profiles enabled them to find good compression-to-speed tradeoffs, better even than with HEVC.[88] Compared to their previously deployed H.264 encoder, a particular area of improvement was in high resolution screen sharing.[87]
- libgav1 is a decoder written in C++11 released by Google.
Several other parties have announced to be working on encoders, including EVE for AV1 (in beta testing),[89] NGCodec,[90] Socionext,[91] Aurora[92] and MilliCast.[93]
Software support
- Firefox (since version 67.0, May 2019; enabled by default on all desktop platforms - Windows, macOS and Linux for both 32-bit and 64-bit systems)[94]
- Google Chrome (decoder since version 70, October 2018;[95] encoder since 90, April 14, 2021)[96]
- Opera (since version 57, 28 November 2018)[97][98]
- Microsoft Edge (since Windows 10 October 2018 Update (1809) with AV1 Video Extension add-on)[99]
- Vivaldi (since October 2018)[100]
- VLC media player (since version 3.0)[101]
- GStreamer (since version 1.14)[102]
- FFmpeg (since version 4.0, 20 April 2018)[103]
- mpv (since version 0.29.0)[104]
- Xine-lib (since 1.2.10)
- MKVToolNix (adoption of final av1-in-mkv spec since version 28)
- MediaInfo (since version 18.03)[105]
- Bitmovin Encoding (since version 1.50.0, 4 July 2018)[106]
- Elecard StreamEye Studio (tools for video quality analysis)
- K-Lite Codec Pack (since version 14.4.5, 13 September 2018)[107]
- HandBrake (since version 1.3.0, 9 November 2019; decoding support)[108]
- PotPlayer (since version 1.7.14804, 16 October 2018)[109]
- Google Duo (since April 2020)[110]
- DaVinci Resolve (since version 17.2, May 2021; decoding support)
Operating system support
Microsoft Windows | macOS | BSD / Linux | Chrome OS | Android OS | iOS | |
---|---|---|---|---|---|---|
Codec support | Not enabled by default, requires add-on | No | Yes | Yes | Yes | No |
Container support | ISO base media file format (.mp4) WebM (.webm) Matroska (.mkv) |
No | ISO base media file format (.mp4) WebM (.webm) Matroska (.mkv) |
ISO base media file format (.mp4) WebM (.webm) Matroska (.mkv) |
No | |
Notes | - Support introduced in Windows 10 October 2018 Update (1809) with AV1 Video Extension add-on.[99] - Support for hardware acceleration added in Windows 10 November 2019 Update (1909).[111] - Supported in Universal Windows Platform apps like Microsoft Edge and Films & TV. |
Unsupported as of macOS Catalina. | Supports decoding, from Chrome OS 70 onward | Supported since Android 10.[112][113][114] | Unsupported as of iOS 14. |
Hardware
This section has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these messages)
|
Product | Function
(D = Decode, E = Encode) |
Profile | Throughput
(single core) |
Throughput
(max) |
Ref | |
---|---|---|---|---|---|---|
Allegro | AL-E195 | E | Main (0) and
Professional (1) |
[115] | ||
AL-E210 | E | Main (0) | 4K 30fps 10-bit | ? | [116][117] | |
AMD | RDNA 2 | D | Main (0) | 8K | [118][119][120] | |
Amlogic | S905X4 | D | 4K 120fps | [121] | ||
S908X | D | 8K 60fps | ||||
S805X2 | D | 1080p | ||||
Amphion | CS8142 | D | 4K 60fps | [122] | ||
Broadcom | BCM7218X | D | 4K | [123] | ||
Chips&Media | WAVE510A | D | Main (0) | 4K 60fps | 4K 120fps | [124] |
Dwango | E | 720p 30fps | [125] | |||
Intel | Tiger Lake Rocket Lake |
D | Main (0) | 8K 10-bit[126] | [127][128][119][129] | |
MediaTek | Dimensity 900 Dimensity 1000 Dimensity 1100 Dimensity 1200 |
D | 4K 60fps | 4K 60fps | [130][131][132] | |
MT9638 | D | 4K 60fps 10-bit | 4K 60fps 10-bit | [133] | ||
Nvidia | GeForce 30 | D | Main (0) | 8K 60fps 10-bit | [134][119][135] | |
Realtek | RTD1311 | D | 4K | [136] | ||
RTD2893 | D | 8K | [137][138] | |||
Rockchip | RK3588 | D | 4K 60fps 10-bit | [139] | ||
Samsung | Exynos 2100 | D | [140] |
Several Alliance members demonstrated AV1 enabled products at IBC 2018,[141][142] including Socionext's hardware accelerated encoder. According to Socionext, the encoding accelerator is FPGA based and can run on an Amazon EC2 F1 cloud instance, where it runs 10 times faster than existing software encoders.
According to Mukund Srinivasan, chief business officer of AOM member Ittiam, early hardware support will be dominated by software running on non-CPU hardware (such as GPGPU, DSP or shader programs, as is the case with some VP9 hardware implementations), as fixed-function hardware will take 12–18 months after bitstream freeze until chips are available, plus 6 months for products based on those chips to hit the market.[37] The bitstream was finally frozen on 28 March 2018, meaning chips could be available sometime between March and August 2019.[18] According to the above forecast, products based on chips could then be on the market at the end of 2019 or the beginning of 2020.
- On 7 January 2019, NGCodec announced AV1 support for NGCodec accelerated with Xilinx FPGAs.[90]
- On 18 April 2019, Allegro DVT announced its AL-E210 multi-format video encoder hardware IP, the first publicly announced hardware AV1 encoder.[143][116]
- On 23 April 2019, Rockchip announced their RK3588 SoC which features AV1 hardware decoding up to 4K 60fps at 10-bit color depth.[139]
- On 9 May 2019, Amphion announced a video decoder with AV1 support up to 4K 60fps[144] On 28 May 2019, Realtek announced the RTD2893, its first integrated circuit with AV1 decoding, up to 8K.[137][138]
- On 17 June 2019, Realtek announced the RTD1311 SoC for set-top boxes with an integrated AV1 decoder.[136]
- On 20 October 2019, a roadmap from Amlogic shown 3 set-top box SoCs that are able to decode AV1 content, the S805X2, S905X4 and S908X.[145] The S905X4 was used in the SDMC DV8919 by December.[146]
- On 21 October 2019, Chips&Media announced the WAVE510A VPU supporting decoding AV1 at up to 4Kp120.[147]
- On 26 November 2019, MediaTek announced world's first smartphone SoC with an integrated AV1 decoder.[131] The Dimensity 1000 is able to decode AV1 content up to 4K 60fps.
- On 3 January 2020, LG Electronics announced that its 2020 8K TVs, which are based on the α9 Gen 3 processor, support AV1.[148][149]
- At CES 2020, Samsung announced that its 2020 8K QLED TVs, featuring Samsung's "Quantum Processor 8K SoC," are capable of decoding AV1.[150]
- On 13 August 2020, Intel announced that their Intel Xe-LP GPU in Tiger Lake will be their first product to include AV1 fixed-function hardware decoding.[129][128]
- On 1 September 2020, Nvidia announced that their Nvidia GeForce RTX 30 Series GPUs will support AV1 fixed-function hardware decoding.[134]
- On 2 September 2020, Intel officially launched Tiger Lake 11th Gen CPUs with AV1 fixed-function hardware decoding.[151]
- On 15 September 2020, AMD merged patches into the amdgpu drivers for Linux which adds support for AV1 decoding support on RDNA2 GPUs.[118][152][153]
- On 28 September 2020, Roku refreshed the Roku Ultra including AV1 support.[154]
- On 30 September 2020, Intel released version 20.3.0 for the Intel Media Driver which added support for AV1 decoding on Linux.[126][127][155]
- On 10 October 2020, Microsoft confirmed support for AV1 hardware decoding on Xe-LP(Gen12), Ampere and RDNA2 with a blog post.[119]
- On 16 March 2021, Intel officially launched Rocket Lake 11th Gen CPUs with AV1 fixed-function hardware decoding.[156]
Patent claims
Sisvel, a Luxembourg-based company, has formed a patent pool, and are selling a patent license for AV1. The pool was announced in early 2019,[157] but a list of claimed patents was first published on 10 March 2020.[158] This list contains over 1050 patents.[158] The substance of the patent claims remains to be challenged.[159]
Sisvel's prices are 0.32 € for display devices and 0.11 € for non-display devices using AV1. Sisvel has stated that they won't seek content royalties, but their license makes no exemption for software.[158][159]
As of March 2020[update], the Alliance for Open Media has not responded to the list of patent claims. Their statement after Sisvel's initial announcement reiterated the commitment to their royalty-free patent license and made mention of the "AOMedia patent defense program to help protect AV1 ecosystem participants in the event of patent claims", but did not mention the Sisvel claim by name.[160]
Google is aware of the patent pool, but does not plan to alter their current or upcoming usage plans of AV1. [161]
AV1 Image File Format (AVIF)
AV1 Image File Format (AVIF) (/əˈviːf/[citation needed]) is an image file format specification for storing images or image sequences compressed with AV1 in the HEIF file format.[162] It competes with HEIC which uses the same container format, built upon ISOBMFF, but HEVC for compression. Version 1.0.0 of the AVIF specification was finalized in February 2019.
AVIF supports features like:
- High dynamic range[162]
- 8, 10, 12 bit color depth[163]
- Lossless compression and lossy compression
- Monochrome (alpha/depth) or multi-components
- Any color-space including: wide color gamut, ISO/IEC CICP and ICC profiles
- 4:2:0, 4:2:2, 4:4:4 chroma subsampling
- Film grain [164]
AVIF support
On 14 December 2018 Netflix published the first .avif sample images,[165] and support was added in VLC. Microsoft announced support with the Windows 10 "19H1" preview release, including support in File Explorer, Paint and multiple APIs, together with sample images.[166] Paint.net added support for opening AVIF files in September 2019,[167] and the ability to save AVIF format images in an August 2020 update.[168] The Colorist format conversion and Darktable RAW image data have each released support for and provide reference implementations of libavif, and a GIMP plugin implementation has been developed supporting both 3.x and 2.10.x plugin APIs. Native AVIF import and export was added to GIMP in October 2020.[169] AVIF read support is present in qView image viewer starting with v4.0.
On 14 February 2020, Netflix published a blog article with objective measurements on AVIF's image quality & compression efficiency in comparison to JPEG.[170] Cloudflare announced AVIF support in a blog post on 3 October 2020.[171]
AVIF support in web browsers is in development.[172] In August 2020, Google Chrome version 85 was released with full AVIF support.[173] Mozilla is working on support for the image format in Firefox; it planned to enable AVIF support by default in Firefox 86, but pulled the change a day before release.[174][175] The current release target is Firefox 90.[176] Google Chrome 89 for Android adds AVIF support.[177] Webkit added AVIF support on March 5th 2021.[178]
Android 12 will add support for AVIF, although it will not be the default image format for the camera app.[179]
References
- ^ a b "AV1 Bitstream & Decoding Process Specification" (PDF). The Alliance for Open Media.
- ^ a b c Zimmerman, Steven (15 May 2017). "Google's Royalty-Free Answer to HEVC: A Look at AV1 and the Future of Video Codecs". XDA Developers. Archived from the original on 14 June 2017. Retrieved 10 June 2017.
- ^ a b "An Invisible Tax on the Web: Video Codecs". 11 July 2018. Retrieved 4 January 2019.
Mozilla uses Cisco's OpenH264 in Firefox. If not for Cisco's generosity, Mozilla would be paying estimated licensing fees of $9.75 million a year.
- ^ "Mozilla Explains Why it Doesn't License h264". 24 January 2010. Retrieved 7 September 2020.
- ^ a b Yoshida, Junko (28 March 2018). "Streaming Group to Pit AV1 Against H.265". EE Times. AspenCore, Inc. Retrieved 4 April 2019.
- ^ a b c Bright, Peter (1 September 2015). "Microsoft, Google, Amazon, others, aim for royalty-free video codecs". Ars Technica. Condé Nast. Retrieved 5 April 2019.
- ^ a b "Why is FRAND bad for Free Software?". 20 June 2016. Retrieved 8 April 2019.
As Free Software gives each user the freedom to redistribute the software itself, keeping track and collecting royalties based on distributed copies is also, in practice, impossible.
- ^ a b Shankland, Stephen (1 September 2015). "Tech giants join forces to hasten high-quality online video". CNET. CBS Interactive Inc. Retrieved 15 April 2019.
- ^ Rosenberg, Jonathan (28 March 2018). "Introducing the Industry's Next Video Codec: AV1". Cisco Blogs. Cisco Systems. Retrieved 15 April 2019.
- ^ "HEVC's Journey in 2015: Going Downhill and Gaining Speed". 1 December 2015. Retrieved 16 July 2019.
- ^ "OpenH264 Now in Firefox". 14 October 2014. Retrieved 8 April 2019.
Because H.264 implementations are subject to a royalty bearing patent license and Mozilla is an open source project, we are unable to ship H.264 in Firefox directly. We want anyone to be able to distribute Firefox without paying the MPEG LA.
- ^ Stephen Shankland (12 September 2014). "Google's Web-video ambitions bump into hard reality". CNET. Retrieved 13 September 2014.
- ^ Romain Bouqueau (12 June 2016). "A view on VP9 and AV1 part 1: specifications". GPAC Project on Advanced Content. Retrieved 1 March 2017.
- ^ a b Shilov, Anton (30 March 2018). "Alliance for Open Media Releases Royalty-Free AV1 1.0 Codec Spec". AnandTech. Archived from the original on 26 February 2019. Retrieved 2 April 2018.
- ^ Larabel, Michael (25 June 2018). "AOMedia AV1 Codec v1.0.0 Appears Ready For Release". Phoronix. Retrieved 27 June 2018.
- ^ Hunter, Philip (15 February 2018). "Race on to bring AV1 open source codec to market, as code freezes". Videonet. Mediatel Limited-GB. Retrieved 19 March 2018.
- ^ a b Ozer, Jan (4 March 2019). "Good News: AV1 Encoding Times Drop to Near-Reasonable Levels". Retrieved 4 March 2019.
- ^ a b c d Jan Ozer (28 March 2018). "AV1 Is Finally Here, but Intellectual Property Questions Remain". Streaming Media Magazine. Retrieved 21 April 2018.
- ^ Metz, Cade (21 May 2010). "Google open video codec may face patent clash". The Register. Retrieved 16 February 2020.
- ^ Jan Ozer (June 2016). "VP9 Finally Comes of Age, But Is it Right for Everyone?". Retrieved 21 April 2018.
- ^ Silvia Pfeiffer (December 2009). "Patents and their effect on Standards: Open video codecs for HTML5". Retrieved 21 April 2018.
- ^ Leonardo Chiariglione (28 January 2018). "A crisis, the causes and a solution". Retrieved 21 April 2018.
two tracks in MPEG: one track producing royalty free standards (Option 1, in ISO language) and the other the traditional Fair Reasonable and Non Discriminatory (FRAND) standards (Option 2, in ISO language). (…) The Internet Video Coding (IVC) standard was a successful implementation of the idea (…). Unfortunately 3 companies made blank Option 2 statements (of the kind "I may have patents and I am willing to license them at FRAND terms"), a possibility that ISO allows. MPEG had no means to remove the claimed infringing technologies, if any, and IVC is practically dead.
- ^ Baumgartner, Jeff (11 April 2018). "NAB 2018: Hardware Support a Big Step Ahead for AV1". Multichannel. Publishing Limited Quay House. Retrieved 4 April 2019.
- ^ "Web giants gang up to take on MPEG LA, HEVC Advance with royalty-free streaming codec". www.theregister.com. Retrieved 15 October 2020.
- ^ "Alliance for Open Media Patent License 1.0". Alliance for Open Media.
- ^ Leonardo Chiariglione (28 January 2018). "A crisis, the causes and a solution". Retrieved 21 April 2018.
How could MPEG achieve this? Thanks to its "business model" that can simply be described as: produce standards having the best performance as a goal, irrespective of the IPR involved.
- ^ Timmerer, Christian (14 February 2019). "MPEG 125 Meeting Report". Bitmovin. Retrieved 6 April 2019.
- ^ "Requirements for a New Video Coding Standard". 12 October 2018. Retrieved 6 April 2019.
- ^ Wium Lie, Håkon (29 March 2007). "Proposal for the HTML 5 video element (Google TechTalks)". Google Video, later YouTube. Retrieved 3 January 2019.
Flash is today the baseline format on the web. The problem with Flash is that it's not an open standard. It's a proprietary format, it hasn't been documented, and it probably requires the payment of licenses if you are going to (…) write software for it (…) The web community has always been based on open standards. This has been what the web was founded on, where HTML started. That's why we developed the PNG image format – we wanted a freely implementable open standard to hold the content we are putting out there. Our content is too valuable to put into some locked format. This goes back all the way to SGML, in which the mantra was "own your data". (…) If we look at open standards for video today (…), there is one which I believe is the right one, and that's called Ogg Theora.
- ^ Sebastian Grüner (19 July 2016). "Der nächste Videocodec soll 25 Prozent besser sein als H.265" (in German). golem.de. Retrieved 1 March 2017.
- ^ Midtskogen, Steinar; Fuldseth, Arild; Bjøntegaard, Gisle; Davies, Thomas (13 September 2017). "Integrating Thor tools into the emerging AV1 codec" (PDF). Retrieved 2 October 2017.
What can Thor add to VP9/AV1? Since Thor aims for reasonable compression at only moderate complexity, we considered features of Thor that could increase the compression efficiency of VP9 and/or reduce the computational complexity.
- ^ Ozer, Jan (3 June 2016). "What is AV1?". Streaming Media Magazine. Information Today, Inc. Archived from the original on 26 November 2016. Retrieved 26 November 2016.
... Once available, YouTube expects to transition to AV1 as quickly as possible, particularly for video configurations such as UHD, HDR, and high frame rate videos ... Based upon its experience with implementing VP9, YouTube estimates that they could start shipping AV1 streams within six months after the bitstream is finalized. ...
- ^ "libaom v1.3.0 changelog". AOM Github Repository.
- ^ Ozer, Jan (26 May 2016). "What Is VP9?". Streaming Media. Retrieved 25 October 2020.
- ^ "refs/tags/v3.1.0 - aom - Git at Google". aomedia.googlesource.com. Retrieved 3 May 2021.
- ^ "LICENSE - aom - Git at Google". Aomedia.googlesource.com. Retrieved 26 September 2018.
- ^ a b Ozer, Jan (30 August 2017). "AV1: A status update". Streaming Media Magazine. Retrieved 14 September 2017.
- ^ a b c d e f g "Analysis of the emerging AOMedia AV1 video coding format for OTT use-cases" (PDF). Archived from the original (PDF) on 20 September 2017. Retrieved 19 September 2017.
- ^ Mukherjee, Debargha; Su, Hui; Bankoski, Jim; Converse, Alex; Han, Jingning; Liu, Zoe; Xu (Google Inc.), Yaowu (2015), Tescher, Andrew G (ed.), "An overview of new video coding tools under consideration for VP10 – the successor to VP9", SPIE Optical Engineering+ Applications, Applications of Digital Image Processing XXXVIII, 9599, International Society for Optics and Photonics: 95991E, doi:10.1117/12.2191104, S2CID 61317162
{{citation}}
:|last7=
has generic name (help) - ^ a b c Ian Trow (16 September 2018). Tech Talks: Codec wars (Recorded talk). IBC 2018 Conference. 28 minutes in. Retrieved 18 September 2018.
- ^ a b Jan Ozer (11 October 2017). "Demuxed: A Video Engineer's Nirvana". Streaming Media Magazine. Retrieved 10 February 2019.
- ^ Feldman, Christian (7 May 2019). VES104. AV1/VVC Update (Talk). Streaming Media Magazine (published 6 January 2020). Event occurs at 9 minutes 33 seconds. Retrieved 8 January 2020.
- ^ Han, Jingning; Saxena, Ankur; Melkote, Vinay; Rose, Kenneth (29 September 2011). "Jointly Optimized Spatial Prediction and Block Transform for Video and Image Coding" (PDF). IEEE Transactions on Image Processing. 21 (4): 1874–1884. CiteSeerX 10.1.1.367.5662. doi:10.1109/tip.2011.2169976. PMID 21965209. S2CID 9507669. Archived from the original (PDF) on 13 July 2012. Retrieved 12 February 2019.
- ^ "Mozilla shares how AV1, the new open source royalty-free video codec, works". 12 November 2018. Retrieved 21 December 2018.
- ^ "Into the Depths:The Technical Details Behind AV1" (PDF). 31 July 2018. Retrieved 21 December 2018.
- ^ a b The Alliance for Open Media AV1 Real-Time Communications Subgroup (29 March 2021). "RTP Payload Format For AV1 (v1.0)". Retrieved 17 May 2021.
{{cite web}}
: CS1 maint: numeric names: authors list (link) - ^ Grüner, Sebastian (9 June 2016). "Freie Videocodecs teilweise besser als H.265". golem.de (in German). Retrieved 1 March 2017.
- ^ "Results of Elecard's latest benchmarks of AV1 compared to HEVC". 24 April 2017. Retrieved 14 June 2017.
The most intriguing result obtained after analysis of the data lies in the fact that the developed codec AV1 is currently equal in its performance with HEVC. The given streams are encoded with AV1 update of 2017.01.31
- ^ "AV1 Demo by Mozilla and Bitmovin". demo.bitmovin.com. Retrieved 19 July 2020.
- ^ Ozer, Jan. "HEVC: Rating the contenders" (PDF). Streaming Learning Center. Retrieved 22 May 2017.
- ^ a b Grois, D.; Nguyen, T.; Marpe, D. (2016). Coding efficiency comparison of AV1/VP9, H.265/MPEG-HEVC, and H.264/MPEG-AVC encoders (PDF). IEEE Picture Coding Symposium (PCS).
- ^ "Netflix on AV1". Streaming Learning Center. 30 November 2017. Retrieved 8 December 2017.
- ^ a b Baumgartner, Jeff (8 February 2019). "Facebook: Tests Show AV1 Streaming Performance Is Exceeding Expectations". Multichannel. Retrieved 10 February 2019.
- ^ "AV1 beats x264 and libvpx-vp9 in practical use case". Facebook Engineering. 10 April 2018. Retrieved 16 July 2020.
- ^ "MSU Codec Comparison 2017" (PDF). 17 January 2018. Retrieved 9 February 2018.
- ^ Ozer, Jan (30 January 2018). "AV1 Beats VP9 and HEVC on Quality, if You've Got Time, says Moscow State". Streaming Media Magazine. Retrieved 9 February 2018.
- ^ "AVC, HEVC, VP9, AVS2 or AV1? — A Comparative Study of State-of-the-art Video Encoders on 4K Videos" (PDF). Retrieved 16 September 2020.
- ^ "resultscores". Retrieved 16 September 2020.
- ^ Ozer, Jan (18 September 2020). "AV1 Has Arrived: Comparing Codecs from AOMedia, Visionular, and Intel/Netflix". Retrieved 7 November 2020.
While 2018 was the year AV1 became known, 2020 will be the year that AV1 became interesting, primarily because of three developments. First, in early 2020, AV1-enabled smart TVs hit the market, right on the 2-year schedule announced back in 2018 by the Alliance for Open Media (AOMedia). Second, over the past two years, encoding times for the AOMedia AV1 codec have dropped from about 2500x real time to about 2x slower than HEVC. Finally, the emergence of third-party AV1 codecs have increased both the quality and encoding speed of the AV1 codec.
- ^ "Annex A: Profiles and Levels". Alliance for Open Media. Retrieved 25 March 2021.
- ^ "GitHub: AV1 Profiles and Levels".
- ^ "AV1 Codec ISO Media File Format Binding". cdn.rawgit.com. Retrieved 14 September 2018.
- ^ "AOM AV1 codec mapping in Matroska/WebM". 3 December 2018. Retrieved 19 December 2018.
- ^ "Matroska AV1 support". 12 September 2018. Retrieved 19 December 2018.
- ^ "ts-carriage.md · master · VideoLAN / AV1 mapping specs". GitLab. Retrieved 19 May 2019.
- ^ "WebM Container Guidelines". 28 November 2017. Retrieved 19 December 2018.
- ^ "Simple Encoder". 18 May 2010. Retrieved 17 January 2019.
IVF files will not generally be used by your application.
- ^ a b "The fastest and safest AV1 encoder". Retrieved 9 April 2018.
- ^ "WebM output in libaom". 1 November 2018. Retrieved 19 December 2018.
- ^ Ronca, David (12 October 2016). "Royalty-Free Video Encoding Netflix Meet-up". YouTube. Netflix. Retrieved 5 February 2020.
In addition, we're engaged with the AOM as far as providing test vectors, providing requirements, we'll be looking forward to testing AV1 in our workflow against a large catalog and providing results there. And also we would expect to be an early adopter of AV1.
- ^ Abner, Li (5 February 2020). "Netflix starts streaming AV1 on Android to save cellular data". 9to5Google. Retrieved 5 February 2020.
- ^ "YouTube begins streaming in AV1 on Android TV - FlatpanelsHD". 6 May 2020. Retrieved 23 May 2020.
- ^ a b "Vimeo Streams in Support for AV1". 13 June 2019. Retrieved 15 June 2019.
- ^ "iQIYI Becomes the First Chinese Video Streaming Site to Support AV1 Video Codec". CRWE World.
- ^ Ozer, Jan; Shen, Yueshi (2 May 2019). "NAB 2019: Twitch Talks VP9 and AV1 Roadmap". YouTube. Retrieved 30 May 2019.
but we're hoping, towards 2024-2025 the AV1 ecosystem's ready, we wanna switch to AV1 a 100%. … this is our projection right now. But on the other hand, as I said, our AV1 release will be, for the head content will be a lot sooner. We are hoping 2022-2023 is we are going to release AV1 for the head content.
- ^ a b "Linux Conference Australia 2019: The AV1 Video Codec". 24 January 2019. Retrieved 5 February 2019.
We have been focusing on freezing the bitstream and getting the quality, not necessarily making things fast. This is a graph of the [encoding] speed of AV1 over its development process. You can se that as we near the end of that process, we started making things faster again, and it's now two orders of magnitude faster than it was at its slowest point. So that's going to improve. And this is a corresponding graph of the quality. (…) So you can see that even as it has continued to get much faster, the quality hasn't really gone down. (…) We wanted to approach this from the other end, so we started an encoder of our own, called rav1e, and the idea is that we would start out always being fast, and then try to make it better over time.
- ^ Armasu, Lucian (4 February 2019). "Intel Releases Open Source Encoder for Next-Gen AV1 Codec". Tom's Hardware. Retrieved 13 February 2019.
- ^ Andrey Norkin; Joel Sole; Kyle Swanson; Mariana Afonso; Anush Moorthy; Anne Aaron (22 April 2019). "Introducing SVT-AV1: a scalable open-source AV1 framework". Medium. Netflix Technology Blog. Retrieved 7 August 2019.
- ^ "Introducing dav1d: a new AV1 decoder". 1 October 2018. Retrieved 6 January 2019.
- ^ Kempf, Jean-Baptiste (11 December 2018). "First release of dav1d, the AV1 decoder". personal website of Jean-Baptiste Kempf. Retrieved 3 February 2019.
- ^ Kempf, Jean-Baptiste (13 March 2019). "dav1d shifts up a gear : 0.2 is out!".
- ^ Kempf, Jean-Baptiste (3 May 2019). "dav1d 0.3.0 release: even faster!".
- ^ Kempf, Jean-Baptiste. "dav1d 0.5.0 release: fastest!". www.jbkempf.com.
- ^ "Firefox 67.0, See All New Features, Updates and Fixes". Mozilla. Retrieved 22 May 2019.
- ^ https://medium.com/@ewoutterhoeven/av1-is-ready-for-prime-time-part-2-decoding-performance-d3428221313
- ^ https://code.videolan.org/videolan/dav1d/-/releases/0.9.0
- ^ a b c Davies, Thomas (26 June 2019). "Big Apple Video 2019 - AV1 in video collaboration". Retrieved 30 June 2019.
- ^ a b Davies, Thomas (26 June 2019). "Cisco Leap Frogs H.264 Video Collaboration with Real-Time AV1 Codec". Retrieved 30 June 2019.
- ^ "Two Orioles". Two Orioles.
- ^ a b Gunasekara, Oliver (7 January 2019). "NGCodec Announces AV1 Support and a 2X Performance Improvement in Broadcast Quality Live Video Encoding".
- ^ "Socionext Implements AV1 Encoder on FPGA over Cloud Service". 6 June 2018.
- ^ "Visionular". www.visionular.com. Retrieved 11 August 2019.
- ^ Millicast (9 July 2019). "Millicast demonstrates real-time video broadcasting using AV1 at CommCon 2019". Medium. Retrieved 11 August 2019.
- ^ Egge, Nathan (23 May 2019). "Firefox brings you smooth video playback with the world's fastest AV1 decoder". Mozilla Hacks. Retrieved 30 May 2019.
- ^ "Chrome 70 Arrives With Option To Disable Linked Sign-Ins, PWAs On Windows, and AV1 Decoder". Slashdot. 16 October 2018. Retrieved 13 February 2019.
- ^ Li, Abner (15 April 2021). "Chrome 90 rolling out: AV1 encoder optimized for video calls, easily hide Reading List". 9to5Google. Retrieved 21 April 2021.
- ^ "How to Play AV1 Videos on YouTube in Chrome 70, Firefox, Vivaldi, Opera". Techdows. 19 October 2018. Retrieved 26 February 2019.
- ^ "Opera 57 with smarter news and Netflix recommendations". Opera Desktop. 28 November 2018. Retrieved 13 December 2018.
- ^ a b "Microsoft Launches Free AV1 Video Codec For Windows 10". Slashdot. 10 November 2018. Retrieved 13 February 2019.
- ^ "Vivaldi.com « Blog « Desktop Snapshots". Vivaldi.com. Retrieved 11 May 2021.
- ^ Tung, Liam (12 February 2018). "VideoLAN: VLC 3.0's huge update brings Chromecast support, 360-degree video". ZDNet. Retrieved 13 February 2019.
- ^ Larabel, Michael (20 March 2018). "GStreamer 1.14.0 Released With WebRTC Support, AV1 Video & Better Rust Bindings". Phoronix. Retrieved 13 February 2019.
- ^ "Time to Start Testing: FFmpeg Turns 4.0 and Adds AV1 Support". Streaming Media Magazine. 27 September 2018. Retrieved 13 February 2019.
- ^ "mpv-player/mpv". GitHub. Retrieved 4 March 2020.
- ^ Serea, Razvan (20 March 2018). "MediaInfo 18.03". Neowin. Retrieved 3 May 2018.
- ^ "Bitmovin Docs - Encoding Encoder Releases". Retrieved 23 May 2020.
- ^ "Changelog for K-Lite Codec Pack Full". Retrieved 23 May 2020.
- ^ "HandBrake 1.3.0 Released". HandBrake: News. 9 November 2019. Retrieved 23 May 2020.
- ^ "PotPlayer multimedia viewer and player for Windows". 11 June 2020. Retrieved 11 June 2020.
- ^ Matthews, David (23 April 2020). "Google Duo gets improved low-bandwidth video calls, new features". TechSpot. TechSpot, Inc. Retrieved 16 August 2020.
- ^ AV1 Hardware Accelerated Video support rolling out on Windows 10 - Windows 10 Forums
- ^ "Introducing Android Q Beta". Android Developers Blog. Retrieved 15 March 2019.
- ^ "Android 10 for Developers: New audio and video codecs". Android Developers. Retrieved 8 September 2019.
- ^ "Android 10 Release Notes – Android Open Source Project". 4 May 2020. Retrieved 23 May 2020.
- ^ "IP Encoder Multiformats HD | IP Video HD 422 Low Latency". Allegro DVT - Leading Video Compression Expertise. Retrieved 23 November 2020.
- ^ a b "AL-E210". Allegro. Retrieved 10 May 2019.
- ^ "IP Encoder AV1 4K | IP Video Multiformats AV1 422 Low Latency Scalability 8K". Allegro DVT - Leading Video Compression Expertise. Retrieved 23 November 2020.
- ^ a b Deucher, Alex (2020). "[PATCH 2/4] drm/amdgpu: add VCN 3.0 AV1 registers". Retrieved 16 September 2020.
- ^ a b c d "AV1 Hardware Accelerated Video on Windows 10". TECHCOMMUNITY.MICROSOFT.COM. 9 October 2020. Retrieved 11 October 2020.
- ^ "AMD GPU Decoder Device Information". bluesky-soft.com. Retrieved 5 April 2021.
- ^ Aufranc, Jean-Luc (20 October 2019). "Amlogic S805X2, S905X4, and S908X AV1 Full HD/4K/8K Media Processors to Launch in 2020". CNX Software – Embedded Systems News. Retrieved 24 October 2019.
- ^ "CS8142 Preliminary Product Brief" (PDF).
- ^ "16-nm STB SoC with AV1 Support and Integrated Wi-Fi 6". www.broadcom.com. Retrieved 1 October 2019.
- ^ "WAVE510A (AV1 Fixed function HW decoder IP for 4Kp60 4:2:0 10 bit)". en.chipsnmedia.com. Retrieved 28 October 2019.
- ^ "AV1リアルタイムハードウェアエンコーダを開発しました - dwango on GitHub". dwango.github.io (in Japanese). Retrieved 17 May 2019.
- ^ a b "intel/media-driver". GitHub. Retrieved 30 September 2020.
- ^ a b "Intel Gen12/Xe Graphics Have AV1 Accelerated Decode - Linux Support Lands - Phoronix". www.phoronix.com. Retrieved 10 July 2020.
- ^ a b Smith, Ryan. "The Intel Xe-LP GPU Architecture Deep Dive: Building Up The Next Generation". www.anandtech.com.
- ^ a b "Architecture Day 2020". Intel Newsroom.
- ^ https://corp.mediatek.com/news-events/press-releases/mediatek-brings-prem-ium-features-to-high-tier-5g-smartphones-with-new-6nm-dimensity-900-5g-chipset
- ^ a b Frumusanu, Andrei. "MediaTek Announces Dimensity 1000 SoC: Back To The High-End With 5G". www.anandtech.com. Retrieved 26 November 2019.
- ^ https://corp.mediatek.com/news-events/press-releases/mediatek-launches-6nm-dimensity-1200-flagship-5g-soc-with-unrivaled-ai-and-multimedia-for-powerful-5g-experiences
- ^ "MT9638". 3 March 2021. Retrieved 4 March 2021.
- ^ a b "GeForce RTX 30 Series GPUs: Ushering In A New Era of Video Content With AV1 Decode". NVIDIA. Retrieved 1 September 2020.
- ^ "V1.0NVIDIA AMPERE GA102 GPU ARCHITECTURE" (PDF). Nvidia. Retrieved 24 November 2020.
- ^ a b "Realtek Launches Worldwide First 4K UHD Set-top Box SoC (RTD1311), Integrating AV1 Video Decoder and Multiple CAS Functions - REALTEK". www.realtek.com. Retrieved 17 June 2019.
- ^ a b "Realtek 8K Video Decoder and Processing IC (RTD2893) Wins Best Choice of the Year at COMPUTEX TAIPEI 2019 - REALTEK". www.realtek.com. Retrieved 17 June 2019.
- ^ a b Shilov, Anton (19 June 2019). "Realtek Demonstrates RTD2893: A Platform for 8K Ultra HD TVs". AnandTech. Purch. Retrieved 19 June 2019.
- ^ a b "Rockchip unveils RK3588 capabilities". 24 April 2019. Retrieved 27 July 2020.
- ^ Frumusanu, Andrei (12 January 2021). "Samsung Announces Exynos 2100 SoC". AnandTech. Retrieved 12 January 2021.
- ^ Jarrett2018-04-20T08:46:00+01:00, George. "NAB 2018: "Incredible interest" shown in AV1". IBC. Retrieved 4 October 2020.
{{cite web}}
: CS1 maint: numeric names: authors list (link) - ^ "AOMedia Members Demo AV1 at IBC2018". Retrieved 4 October 2020.
- ^ "Allegro DVT Introduces the Industry First Real-Time AV1 Video Encoder Hardware IP for 4K/UHD Video Encoding Applications". Allegro. 18 April 2019. Retrieved 10 May 2019.
- ^ "News: Amphion Semiconductor introduces 4K/UHD capable AV1 video decoder hardware IP extension to its Malone video decoder family". 9 May 2019. Retrieved 11 August 2019.
- ^ Aufranc, Jean-Luc (20 October 2019). "Amlogic S805X2, S905X4, and S908X AV1 Full HD/4K/8K Media Processors to Launch in 2020". CNX Software - Embedded Systems News. Retrieved 4 January 2020.
- ^ Aufranc, Jean-Luc (22 December 2019). "SDMC DV8919 Amlogic S905X4 Android TV 10 TV Box Supports AV1 Decoding". CNX Software - Embedded Systems News. Retrieved 4 January 2020.
- ^ Shilov, Anton. "Chips&Media Launches Wave510A Hardware AV1 Decoder IP". www.anandtech.com. Retrieved 28 October 2019.
- ^ "LG TO UNVEIL 2020 REAL 8K TV LINEUP FEATURING NEXT-GEN AI PROCESSOR AT CES 2020". LG Newsroom. 3 January 2020. Retrieved 4 January 2020.
- ^ Porter, Jon (3 January 2020). "LG unveils eight 'Real 8K' OLED and LCD TVs ahead of CES". The Verge. Retrieved 4 January 2020.
- ^ Shilov, Anton. "CES 2020: Samsung's 8K QLED TVs Use AI Quantum 8K SoC, Add Support For AV1 Video". www.anandtech.com.
- ^ "Intel Launches World's Best Processor for Thin-and-Light Laptops: 11th Gen Intel Core". Intel Newsroom.
- ^ "AMD Navi 2X GPUs (RDNA2) to support AV1 decoding". VideoCardz.com. Retrieved 16 September 2020.
- ^ "AMD Radeon Navi 2 / VCN 3.0 Supports AV1 Video Decoding - Phoronix". www.phoronix.com. Retrieved 16 September 2020.
- ^ Welch, Chris (28 September 2020). "The new Roku Ultra has Dolby Vision and improved Wi-Fi performance". The Verge. Retrieved 28 September 2020.
- ^ "Intel Media SDK 20.3 Released With AV1 Decode, Rocket Lake + DG1/SG1 Support - Phoronix". www.phoronix.com. Retrieved 11 October 2020.
- ^ "11th Gen Intel Core: Unmatched Overclocking, Game Performance". Intel Newsroom.
- ^ Cluff, Phil (28 March 2019). "Did Sisvel just catch AOM with their patents down?". Mux.com. Retrieved 4 April 2019.
- ^ a b c Shankland, Stephen (10 March 2020). "Streaming video could be saddled with a new patent licensing cost". CNET. Retrieved 15 March 2020.
Sisvel begins selling licenses for more than 1,050 patents for AV1, a video technology that's supposed to be free.
- ^ a b Ozer, Jan (28 March 2019). "Sisvel Announces Patent Pools for VP9 and AV1". Stream Learning Center. Retrieved 4 April 2019.
- ^ "The Alliance for Open Media Statement". The Alliance for Open Media. Retrieved 12 April 2019.
- ^ "Frequently Asked Questions". The WebM Project. Retrieved 15 April 2021.
- ^ a b "AV1 Image File Format (AVIF)". aomediacodec.github.io. Retrieved 25 November 2018.
- ^ Concolato, Cyril (14 October 2019). "AV1 Image File Format (AVIF)" (PDF). AOMedia.
- ^ "Film Grain Synthesis for AV1 Video Codec" (PDF). Retrieved 14 December 2020.
- ^ "Netflix AV1 Encodes Readme". Retrieved 23 May 2020.
- ^ AV1 Still Image File Format Specification: proposed ISO-BMFF/HEIF derivative - AOMediaCodec/av1-avif, AOMediaCodec, 11 June 2019, retrieved 12 June 2019
- ^ "paint.net 4.2.2 is now available!". paint.net blog. 18 September 2019. Retrieved 12 October 2019.
- ^ "paint.net 4.2.14 alpha build 7542". 25 August 2020. Retrieved 26 August 2020.
- ^ "GIMP 2.10.22 Released". www.gimp.org. 7 October 2020. Retrieved 14 October 2020.
- ^ https://netflixtechblog.com/avif-for-next-generation-image-coding-b1d75675fe4
- ^ "AVIF image format supported by Cloudflare Image Resizing". The Cloudflare Blog. 3 October 2020.
- ^ "Can I Use: AVIF image format". Retrieved 26 August 2020.
- ^ Abrams, Lawrence (25 August 2020). "Chrome 85 released with security fixes, app shortcuts, AVIF support". Bleeping Computer. Retrieved 26 August 2020.
- ^ https://bugzilla.mozilla.org/show_bug.cgi?id=1682995#c32
- ^ Cimpanu, Catalin (9 July 2020). "Chrome and Firefox are getting support for the new AVIF image format - After Netflix, Windows 10, VLC, and a few image editors, the new AVIF image format is coming to web browsers". ZDNet. Retrieved 26 August 2020.
- ^ "1682995 - Enable AVIF support by default". bugzilla.mozilla.org. Retrieved 25 March 2021.
- ^ https://blog.chromium.org/2021/01/chrome-89-beta-advanced-hardware.html
- ^ https://bugs.webkit.org/show_bug.cgi?id=207750
- ^ Bohn, Dieter (18 February 2021). "Android 12 developer preview is available now with many under-the-hood updates". The Verge. Retrieved 18 February 2021.