Introduction: How Codecs Power the Streaming Era
Video now represents more than 80% of all internet traffic, and behind every streamed movie, live sports event, or online meeting lies a video codec compressing vast amounts of data into manageable streams. Without them, the modern video ecosystem from YouTube and Netflix to Zoom and OTT platforms would simply not be possible.
What is less visible is that video codecs are among the most heavily patented technologies in consumer electronics. Every compression tool, algorithm, and prediction model used in these technologies is typically patented, which means technological innovation in this field is inseparable from IP strategy and licensing practice. Video codec IP is not a footnote to the engineering. In several cases it has decided which codec won.
Thousands of patents contribute to the construction of a single codec, creating what IP professionals call patent thickets: dense, overlapping webs of claims that must be carefully navigated to avoid infringement. These patents are held by competing companies, research institutions, and technology consortiums, turning codecs into strategic assets used for licensing revenue, cross-licensing agreements, and competitive positioning. As a result, codec adoption is influenced not only by technical merit but also by licensing cost, the availability of royalty-free alternatives, and the legal risks associated with implementation.
Key Takeaways
- Codec adoption is decided as much by licensing clarity as by compression efficiency. H.264 won on predictability; HEVC stalled despite being technically superior.
- A patent pool simplifies licensing only when most essential patent holders join it. HEVC fragmented across MPEG LA, HEVC Advance, Velos Media, and independent licensors, and implementers backed away.
- Royalty-free positioning drove AV1’s adoption, though Sisvel’s AV1 pool shows that no complex codec is provably free of patent risk.
- Hardware exposure is the sharpest commercial risk: a device supporting HEVC may owe royalties on every unit sold, whether or not the consumer ever plays HEVC content.
- AI video codecs are likely to generate an entirely new SEP layer, raising unresolved questions about how FRAND applies to model architectures and training methods.
Why Video Codecs Generate Thousands of Patents
At its core, video compression works by identifying and removing redundancies in visual data: duplication within a single frame, and repeated information across frames. Techniques like motion vectors, block prediction, transform coding, and quantization allow codecs to shrink gigabytes of raw footage into bitstreams small enough for real-time streaming. For a full technical walkthrough of how video codecs work, including picture partitioning, prediction, transforms, quantization, and entropy encoding, see “How Video Codecs Work”.
The reason this matters for IP is density. Each of those components may involve dozens of patented innovations: specific block partitioning methods, advanced interpolation techniques, or entropy coding schemes like CABAC. There is no single inventive step to license. There are hundreds, contributed by different parties, layered on top of one another. Every new codec generation requires substantial R&D and inevitably produces a higher density of patent filings than the one before it.
Because major video codecs are developed through collaborative standardization processes led by ISO/IEC JTC1 (MPEG) and ITU-T VCEG, the resulting standards incorporate technologies contributed by numerous participants. No single entity owns the entire codec. Instead, different companies hold patents covering specific tools and features defined in the standard, forming portfolios of Standard Essential Patents (SEPs). These SEPs are typically subject to FRAND commitments, but they still sit at the centre of licensing frameworks, because implementers generally require access to them to comply with the standard at all.
The Video Codec Patent Landscape: Who Owns What
Ownership across the codec space is concentrated among a small group of companies, and the concentration looks different depending on which standard you examine.
Across the broader codec patent landscape, Samsung Electronics leads with 21.19% of filings, followed by Huawei at 13.74% and Qualcomm at 12.11%. LG Electronics (11.49%) and Sony (9.46%) hold substantial positions, reflecting the presence of consumer electronics and multimedia manufacturers. ByteDance (9.15%) and Beijing ByteDance Network Technology (5.63%) together demonstrate the growing participation of Chinese technology firms, while Canon (6.42%), Tencent America (5.58%), and NEC (5.22%) account for smaller but meaningful shares.
Geographically, filings concentrate in the major technology markets and manufacturing hubs. China leads by a wide margin in patent family counts, followed by the United States and the European Patent Office. South Korea and Japan also show substantial activity, with Germany, India, the United Kingdom, and France forming a mid-tier group. Taiwan, Brazil, Canada, Australia, and others contribute lower but still meaningful volumes.
Investment in the underlying technology has grown over two decades, with a decline around 2009 to 2011 reflecting broader economic conditions, a rebound from 2012 onward, and a sharp acceleration around 2020 to 2021 driven by digital transformation and increased reliance on streaming infrastructure. Levels have moderated slightly since that peak but remain high through 2023 and 2024.
H.264/AVC: The Codec That Built the Modern Streaming Era
H.264, introduced in 2003, became the backbone of online video due to its strong balance of compression efficiency, widespread hardware support, and a relatively predictable licensing model. It powers a wide range of applications, from Blu-ray discs and broadcast television to early online streaming platforms and video conferencing services. A key factor in its success was the availability of a centralized licensing framework, primarily administered by MPEG LA, which provided a structured and transparent approach for licensing many of the essential patents.
While not all patents were necessarily included within a single pool, the existence of a dominant licensing platform gave companies greater visibility into royalty obligations and reduced transaction complexity. This clarity enabled broad global adoption and helped establish H.264 as one of the most widely deployed video codecs.
Despite being royalty-bearing, H.264 remained widely adopted because its licensing environment was relatively stable compared to later codec generations. The ability to license a significant portion of relevant patents through a central pool helped reduce legal uncertainty for implementers. H.264 is therefore often cited as an example of how streamlined IP management can support large-scale adoption alongside technical excellence.
Within AVC specifically, ownership is diversified. Sony (14.86%), Samsung Electronics (13.56%), and Qualcomm (13.12%) hold major positions, with Huawei (9.16%) and Panasonic (8.19%) reflecting long-standing involvement in video compression research. Canon (7.75%), Nokia Technologies (6.29%), LG Electronics (6.02%), and Technicolor (5.91%) account for much of the remainder.
HEVC Licensing: Technical Brilliance, Fragmented Patent Pools
HEVC (H.265) was designed to replace H.264 by delivering roughly 50% better compression efficiency, enabling high-quality 4K streaming and UHD broadcasting. While it achieved its technical goals, its IP landscape became notoriously convoluted. Instead of a single licensing pool, HEVC patents were divided among MPEG LA, HEVC Advance, Velos Media, and independent licensors. Each group demanded its own licensing fees and terms, and none were harmonized. This fragmentation created uncertainty for manufacturers, who feared accumulating royalty burdens or inadvertent infringement.
The result was a dramatic slowdown in HEVC adoption, especially across the web ecosystem. Browser vendors like Google and Mozilla refused to support HEVC due to unpredictable licensing costs. Meanwhile, YouTube transitioned to VP9 and later AV1 specifically to avoid HEVC’s royalties. This episode demonstrates how even the most advanced technology can fail to dominate if its IP framework discourages implementation. Many industry experts now cite HEVC licensing as a cautionary tale about the dangers of fragmented patent pools.
HEVC patent ownership is also far more concentrated than AVC’s. Qualcomm dominates with a 35.94% share, followed by Canon (11.79%), Huawei (11.27%), and Tencent America (10.81%). Nokia Technologies (7.19%) and ByteDance (5.18%) hold moderate positions, while Sony (4.83%), Ericsson (4.49%), Beijing ByteDance Network Technology (4.26%), and LG Electronics (4.26%) round out the top ten. The combination of concentrated ownership and fragmented licensing structures is precisely what made HEVC difficult to clear.
VP9: Google's Royalty-Free Answer to HEVC
Google developed VP9 as an alternative to HEVC, partly in response to the latter’s licensing complexity. VP9 offers competitive compression efficiency while being available on a royalty-free basis, making it particularly attractive for large-scale web platforms. This was especially important for YouTube, which streams massive volumes of video and benefits from reduced bandwidth requirements. By adopting VP9, Google improved compression efficiency relative to earlier codecs while avoiding the complexities associated with HEVC licensing. Other streaming platforms, such as Netflix, also adopted VP9 on devices with compatible hardware, and the codec gained broad browser support, including Chrome, Firefox, and Edge.
VP9’s rise highlighted the importance of a royalty-free video codec in web-based ecosystems. Although VP9 does not consistently outperform HEVC in compression efficiency, its licensing clarity reduced uncertainty for implementers. Google’s decision to promote VP9 demonstrated that technical performance alone does not guarantee adoption; licensing simplicity is an equally critical factor. VP9 also played a foundational role in the development of next-generation royalty-free codecs, including AV1.
The VP9 patent family landscape looks notably different from the proprietary codecs, and reflects implementation rather than the codec specification itself. Intel and Tencent America lead in patent family counts, followed by Rockchip Electronics, NVIDIA, and Samsung Electronics, underlining how much VP9 activity sits with semiconductor and hardware vendors implementing chip-level optimizations. Google Technology Holdings appears among the top assignees alongside Tencent Technology Shenzhen, Adeia Guides, and Meta Platforms, with ARM rounding out the list. The distribution is broader and flatter than for older proprietary codecs, consistent with VP9’s positioning as a web-friendly open technology.
AV1 and the Open Media Movement: Royalty-Free or Royalty-Questioned?
AV1, developed by the Alliance for Open Media, represents one of the most ambitious efforts to create a next-generation video codec intended to be royalty-free. Backed by major technology companies such as Google, Amazon, Netflix, Apple, and Microsoft, AV1 was designed to deliver improved compression efficiency compared to HEVC while aiming to reduce the licensing uncertainty associated with earlier codec generations. The codec incorporates advanced techniques, including directional prediction, flexible transform partitioning, and adaptive quantization, enabling meaningful bandwidth savings across a range of applications. Its adoption has expanded rapidly with support across major browsers, Android devices, and smart TVs.
However, the perception of AV1 as entirely royalty-free has been challenged. Sisvel has introduced an AV1 patent pool asserting that certain patents may be essential to the codec. While these claims are disputed by AOMedia and its members, they have triggered broader industry discussions about whether complex video compression standards can be entirely free of patent risk. The dense patent landscape surrounding video codecs makes it difficult to guarantee complete freedom from potential infringement. Despite this, most industry players continue to adopt AV1, supported by its strong ecosystem backing and open-source implementation, although long-term IP certainty remains an area of ongoing scrutiny.
VVC, EVC, and LCEVC: The Future of Codecs and Their IP Models
VVC (H.266) offers substantial compression gains, typically achieving around 30 to 50% bitrate savings compared to HEVC, making it well-suited for high-resolution applications such as 4K, 8K, and immersive media. However, concerns remain regarding potential fragmentation of patent pools, which could impact adoption despite VVC’s technical advantages.
Meanwhile, EVC (MPEG-5 Part 1) aims to balance performance with more predictable licensing by introducing a royalty-free baseline profile alongside a royalty-bearing main profile with published licensing terms. This hybrid approach is intended to provide greater transparency and reduce uncertainty for implementers.
LCEVC (MPEG-5 Part 2) takes a different approach by enhancing existing codecs such as H.264, HEVC, and AV1 through an additional enhancement layer. This allows performance improvements without requiring entirely new hardware decoders, making it attractive for platforms seeking incremental upgrades. Compared to traditional codec deployments, its licensing approach is more streamlined, supporting easier commercial integration.
Together, these emerging codecs illustrate that modern compression innovation must be aligned with effective IP strategy from the outset to achieve widespread industry adoption.
Standard Essential Patents (SEPs) and the Role of FRAND Licensing
Standard Essential Patents play a central role in codec licensing. When patented technologies are incorporated into a standardized codec, patent holders typically commit to licensing those technologies on FRAND (Fair, Reasonable, and Non-Discriminatory) terms through the relevant standards bodies. However, FRAND is inherently subject to interpretation. What one party considers reasonable may be viewed as excessive by another. As a result, disputes over FRAND obligations frequently lead to litigation, particularly between major SEP holders and device manufacturers. These disputes can influence not only royalty outcomes but also the pace of technology deployment.
FRAND-related disputes are especially prominent in video compression due to the industry’s reliance on global standards and the need for interoperability across devices and platforms. Streaming services, television manufacturers, smartphone vendors, and set-top box providers must obtain appropriate licenses to implement standardized codecs and mitigate litigation risk. As codecs become more complex, the number of patents declared or potentially essential tends to increase, raising both legal and financial stakes.
How a Patent Pool Works, and Why Fragmentation Breaks It
A patent pool is designed to simplify licensing by aggregating essential patents under a common framework, so an implementer can clear a standard through one negotiation rather than dozens. In practice, this model works most effectively when a large share of major SEP holders participates. H.264/AVC benefited from a relatively centralized licensing structure, primarily through the MPEG LA pool, which reduced licensing complexity for implementers.
In contrast, HEVC encountered adoption challenges partly because patent holders were distributed across multiple licensing pools and independent licensing programs. This fragmentation increased uncertainty and financial complexity for implementers despite HEVC’s strong compression performance.
Fragmentation also complicates risk assessment for companies evaluating codec adoption. When multiple pools and independent licensors exist, implementers may need to negotiate several separate licenses or face potential infringement claims from patent holders outside a given pool. The problem is not simply that costs are higher. It is that costs cannot be bounded in advance. As a result, some companies have increasingly favoured royalty-free or open-source codecs to reduce licensing uncertainty, even where compression efficiency may be lower in certain scenarios.
Litigation Trends in the Codec Industry
Codec-related patents represent one of the more actively litigated areas within technology standards. Companies such as Nokia, Broadcom, InterDigital, and Huawei frequently participate in SEP licensing and enforcement activities involving hardware manufacturers and platform providers. HEVC-related licensing disputes and enforcement actions increased significantly following the codec’s commercialization, as multiple licensing pools and patent holders sought to secure licensing agreements. Even AV1, despite being positioned as a royalty-free codec, may become an area of increased patent assertion activity as adoption expands and additional parties claim potentially essential patents. Litigation remains costly and time-consuming, but it continues to play a central role in codec IP strategy.
These legal disputes also shape broader industry behavior. Manufacturers may delay adopting newer codecs until licensing conditions and litigation risks become clearer, while streaming platforms may favor alternative codecs to reduce exposure to patent disputes. Court decisions in SEP and FRAND cases can further influence licensing negotiations, royalty expectations, and the practical interpretation of FRAND obligations across the industry.
How Codec IP Influences OTT Platforms and Video Streaming Services
Streaming platforms must balance video quality, bandwidth efficiency, device compatibility, and licensing considerations when selecting codecs. Netflix uses multiple codecs, including H.264/AVC, VP9, HEVC, and AV1, depending on device capabilities, network conditions, and deployment requirements. YouTube largely avoided broad HEVC deployment due in part to licensing complexity and instead heavily promoted VP9 and later AV1 across its ecosystem. Amazon Prime Video, also associated with the AOMedia ecosystem, has increasingly adopted AV1 to improve bandwidth efficiency across large-scale streaming workloads. Meanwhile, Apple adopted HEVC extensively within its vertically integrated hardware and software ecosystem, allowing it to manage deployment and licensing more predictably.
At streaming scale, even modest improvements in compression efficiency can translate into substantial bandwidth and infrastructure savings. However, licensing costs can have a similarly significant impact, as unpredictable royalty structures may alter a platform’s long-term codec strategy. As a result, streaming platforms evaluate codecs not only using technical quality metrics such as VMAF, but also through broader assessments of licensing exposure and long-term IP risk.
Device Manufacturers, Silicon Vendors, and IP Risk Management
Hardware manufacturers face significant exposure to codec licensing because decoding and encoding capabilities are often integrated directly into silicon. A smartphone or smart TV supporting codecs such as HEVC may incur royalty obligations on each device sold, even if HEVC content is not actively used by the consumer. This creates a strong incentive for manufacturers to prioritize codecs with relatively clear and stable licensing environments. Integrating codecs such as AV1 into hardware therefore requires evaluating not only technical performance, but also the long-term risk of future patent assertions.
Semiconductor vendors such as Qualcomm, MediaTek, and NVIDIA must account for long chipset development cycles when planning codec support. Once dedicated hardware decoder blocks are integrated into silicon, they cannot easily be modified after fabrication. As a result, chipmakers often need to forecast licensing and litigation risks years in advance, relying on both engineering and legal teams to assess the stability of patent pools and the broader IP landscape.
The Economics of a Codec License
Codec-related patents have generated substantial licensing revenue for major technology companies. Organizations with strong SEP portfolios often use licensing both as a direct revenue stream and as leverage in broader cross-licensing negotiations. The dense patent landscape surrounding modern codecs can make independent implementation and commercialization more challenging, reinforcing the influence of established industry players. As a result, smaller companies and startups frequently favour royalty-free codecs to reduce exposure to the complexities of SEP licensing. With each new codec generation introducing additional technical complexity, the density of relevant patents is expected to continue increasing, making IP strategy an increasingly important competitive factor.
The economics of a codec license influence the entire digital media ecosystem. Camera manufacturers, software vendors, semiconductor companies, device manufacturers, and OTT platforms must all consider royalty costs, licensing obligations, and litigation risks when selecting or deploying codecs. In many cases, these economic and legal considerations shape industry decisions as strongly as the underlying technical performance of the codec itself.
AI Video Codecs and the Coming Wave of New IP
The next era of video compression is increasingly influenced by machine learning. Neural codecs use deep learning techniques to improve compression performance, particularly at lower bitrates where traditional block-based codecs often face limitations. Research organizations and technology companies such as Google DeepMind and Meta are actively developing neural video compression systems that could redefine future efficiency benchmarks. These approaches involve potentially patentable innovations across neural architectures, inference pipelines, model optimization techniques, and training methodologies, contributing to a rapidly growing IP landscape around AI-based compression.
If an AI video codec eventually becomes standardized, it may introduce entirely new categories of Standard Essential Patents. This raises questions the current framework has no settled answer for: how FRAND obligations would apply to machine-learning-based compression, whether new patent pools could form around neural architectures, and how licensing models would handle technologies where the trained model, rather than the algorithm, carries the value. The answers may shape the next generation of video technology as decisively as H.264 and HEVC shaped the last.
Are Truly Royalty-Free Codecs Possible?
AV1 renewed industry interest in the royalty-free video codec, but practical experience suggests that highly complex compression technologies rarely avoid all potential patent assertion risk. Because modern video compression builds upon decades of research and innovation, developing a codec entirely free from potential infringement concerns remains extremely challenging. Rather than eliminating licensing altogether, the industry may increasingly move toward licensing models that emphasize transparency and predictability. Hybrid approaches such as EVC, with its baseline and main profiles, or LCEVC, with its layered enhancement architecture, may offer a more sustainable balance between technical advancement and IP clarity.
In practice, the industry may benefit more from transparent licensing frameworks and early disclosure of royalty terms than from attempts to eliminate licensing entirely. Device manufacturers and streaming platforms generally prefer predictable licensing obligations over uncertain legal exposure. The industry’s experience with HEVC suggests that licensing unpredictability, rather than royalty cost alone, is what becomes a barrier to adoption.
Why Lumenci for Video Codec IP and SEP Analysis
Codec disputes turn on whether a specific implementation actually practises a declared-essential claim. That is a technical question before it is a legal one.
- SEP essentiality analysis: our teams map declared-essential codec patents against the standard text and against real implementations, rather than accepting declaration at face value.
- Claim mapping for codec claims: compression claims are dense and heavily conditional, and our claim charting practice is built for exactly that kind of specification-to-implementation work.
Explore Lumenci’s Claim Charting Service
- Source code and bitstream review: when a dispute turns on what an encoder or decoder actually does, our experts analyze the implementation directly.
Explore Lumenci’s Source Code Review Service
- Portfolio and landscape analysis: we map filing activity across codec generations so clients understand where their portfolio sits before entering a pool negotiation or a licensing discussion.
Talk to a Lumenci analyst about your codec or SEP portfolio.
Conclusion: Where Technology and Intellectual Property Meet
Video codecs exist at a unique intersection of engineering innovation and intellectual property strategy. While compression efficiency and technical performance drive codec development, the long-term success of a codec often depends equally on its licensing structure, SEP governance, and the effectiveness of patent pool coordination. H.264/AVC achieved widespread adoption partly because of its relatively predictable licensing environment, whereas HEVC encountered adoption challenges associated with licensing fragmentation. AV1 gained momentum in part due to its royalty-free positioning, even as questions continue regarding long-term patent exposure. As neural and AI-driven codecs emerge, the surrounding IP landscape is likely to become even more complex.
The future of video compression will therefore be shaped not only by advances in algorithmic design, but also by the evolution of licensing models and IP governance frameworks. For the IP industry, codecs represent one of the most strategically important technology battlegrounds, an area where patents, licensing, litigation, and business strategy directly influence global standards adoption. As streaming demand continues to grow and new applications such as VR, AR, and cloud gaming expand, the alignment between technological innovation and intellectual property management will remain critical in shaping the next generation of video codecs.
Table of Contents
Frequently Asked Questions
What is a video codec?
A video codec is the software or hardware that compresses video for storage and transmission, then decompresses it for playback. For a full technical explanation of what video codecs are and how video compression works, see “How Video Codecs Work” (lumenci.com/blogs/how-video-codecs-works).
Why are video codecs covered by so many patents?
Codecs are built through collaborative standardization, so dozens of companies contribute individual tools to a single standard. Each block partitioning method, prediction technique, and entropy coding scheme can carry its own patents, producing thousands of claims across one codec.
What is a patent pool in video codec licensing?
A patent pool aggregates essential patents from multiple holders so an implementer can license the standard through one agreement instead of many. It works well when most major holders join, as with H.264, and poorly when they do not, as with HEVC.
Why did HEVC licensing become so complicated?
HEVC patents ended up spread across MPEG LA, HEVC Advance, Velos Media, and independent licensors, each with separate and unharmonized terms. Implementers could not calculate total royalty exposure in advance, so many avoided the codec entirely.
Is AV1 really a royalty-free video codec?
AV1 was designed and positioned as royalty-free by the Alliance for Open Media, but Sisvel has since launched a patent pool asserting that certain patents are essential to it. AOMedia disputes this, and adoption has continued regardless.
Do streaming platforms pay codec licensing fees?
It depends on the codec and the deployment. Royalty-bearing codecs like H.264 and HEVC carry licensing obligations, which is a significant reason YouTube pushed VP9 and AV1 instead. Royalty-free codecs remove that cost but not all patent risk.
Will AI video codecs create new standard essential patents?
Very likely, if neural compression is standardized. That would raise unresolved questions about how FRAND applies when the patented contribution is a model architecture or training method rather than a conventional algorithm.
