FPGAs for Broadcasting and Pro AV Solutions
Design future-proof solutions for video production and broadcast applications with FPGAs. As artificial intelligence transforms many industries, explore how FPGAs are used for AI inferencing and other functions for audio and video.
Transforming Broadcast and Pro AV
FPGAs play a transformative role in the broadcasting and professional audio/visual (Pro AV) industry by addressing the increasing demand for high-quality content, low-latency transmission, and flexibility in system design.
AI Integration and Edge Computing
FPGAs in edge AI enable broadcasters and pro AV professionals to achieve intelligent, high-performance workflows that are efficient, scalable, and adaptable to the industry's rapidly evolving demands. FPGAs with AI enable a new wave of innovation in broadcast and Pro AV with example functions such as real-time video analytics, real-time closed captioning, and AI-enhanced graphics overlays.
Benefits of FPGAs
Low-Latency Transmission
Latency is critical in live broadcasting and professional AV setups. FPGAs provide deterministic and ultra-low latency performance for live streaming and content delivery.
Scalability and Futureproofing
FPGAs’ reconfigurable architecture allows broadcasters and AV professionals to update their systems to support new codecs, resolutions, and features without replacing hardware, ensuring investment longevity.
Real-Time Video Processing
FPGAs enable real-time processing of high-definition (HD), 4K, 8K, and 16K video streams, which is essential for broadcasting and live events.
Video Over IP and 5G Broadcasting
FPGAs support IP-based video transmission standards (SMPTE ST 2110) and enable seamless integration into modern IP workflow.
Dan Feldstein, Chief Executive Officer, Crestron
"We turned to FPGAs as an ideal solution to provide hardware-like speed with software-like flexibility. We chose Altera [then Intel PSG] as a partner because we felt they had the best product, best support, and intellectual property that would allow us to jumpstart our development process. We estimate that we could get to market 40% faster because of this partnership. [Crestron’s] AV over IP solutions are also built around FPGA technology. They provide zero latency, visually lossless, high-definition video, audio control and USB distribution from an unlimited number of sources to an unlimited number of destinations. And since we built these technologies around FPGAs, our products have evolved over time and now incorporate features and function, the quality that didn't even exist when we designed the hardware."
Hiroya Yamamoto, Project General Manager, Ikegami
"Quartus® [Prime Software] has worked seamlessly on IKEGAMI’s Agilex™ 5 FPGA development project for our video solution, which requires extremely high data throughput and low power. Thanks to Quartus’ impressively fast compile time, we tried multiple design iterations in a day. Excellent diagnostic tools like Signal Tap enabled us to complete proof-of-concept, displaying camera footage on the monitor, within 20 hours after power-on. We are excited that Agilex™ 5 and Quartus are opening a new world for mid-range FPGAs.”
Broadcast
The broadcast market includes essential content processing and manipulation technologies such as switching, mixing, color correction, replay operation, special effects, and AV over IP. These operations must be performed in real-time with nearly zero latency, demanding significant computational horsepower at high resolutions.
A video switcher is a hardware device used to switch or choose between different audio or video sources. Although its main functionality is to select between audio or video sources, video switchers are sometimes used to mix video and add footage or special effects to a secondary source. Video switchers are mostly used in live events and video production environments like production trucks and television studios.
Key applications:
- Studio production
- Live events
- Outside broadcast
FPGA IP functionality in soft logic:
- Video connectivity interfaces (SDI, HDMI, and Ethernet)
- Generic Video Processing, such as scaling, mixing, switching, keying etc.
Learn more:
High-quality professional video cameras are used in TV studios and film production. FPGAs are ideal for combining the camera interface, image processing, and connectivity in a single device to film and distribute live video (or store it).
Key applications:
- Studio production
- Cinema production
- Live events
FPGA IP functionality in soft logic:
- Video connectivity interfaces (SDI, HDMI and Ethernet, LVDS, SLVS-EC, other sensor standards)
- Image Signal Processing (ISP)
- Generic Video Processing, such as scaling, mixing, switching, keying etc.
- Low compression ratio video compression and decoding such as ProRes or JPEG-XS
Learn more:
- Video and Vision Processing Suite Intel® FPGA IP User Guide
- High-performance Image Signal Processing and Camera Sensor Pipeline Design on FPGAs
- Genlock Controller Intel® FPGA IP
- Intel® FPGA Streaming Video Protocol Specification
- HDMI Intel® FPGA IP User GuideSDI II Intel® FPGA IP User Guide
- SDI II Intel® FPGA IP User Guide

Live IP video production has introduced new network designs and topologies to meet the mission-critical requirements of live media transport over a network. These new requirements are pushing the limits of the current paradigm for COTS hardware architecture with increased demands for media processing, which necessitates the use of specific hardware accelerators.
FPGAs are ideal for creating a customized number of audio/video ports and connecting to Commercial off-the-shelf (COTS) Edge Compute equipment as PCIe add-in cards.
Key applications:
- Studio Broadcast
- Live Production
- Film production
FPGA IP functionality in soft logic:
- Video connectivity interfaces (SDI, HDMI, and Ethernet)
- Generic Video Processing such as scaling, mixing, switching, etc.
- Low latency video compression and decoding such as JPEG-XS
Learn more:
SMPTE ST 2110 is a suite of open standards that carries video, audio, and ancillary data as separate streams over an IP network and is already being widely adopted in broadcast and is now the de facto standard for AV over IP.
ST 2110 replaces legacy SDI (Serial Digital Interface) systems by providing one common data center infrastructure, where essences are routed using COTS IP switches instead of expensive SDI routers.
Key applications:
- Broadcast equipment
- Medical
- Virtualized video production
FPGA IP functionality in soft logic:
- Video connectivity interfaces (SDI, HDMI, and Ethernet)
- Generic Video Processing such as scaling, mixing, keying etc.
- Low compression ratio, low latency video compression and decoding such as JPEG-XS, and other proprietary standards.
Learn more:
Pro AV
The ProAV market includes several end applications, including AV Networking, Video conferencing, and Projection. These appliances tend to have shorter life spans of 5-7 years, with new equipment developed in 1 to 1.5 years from inception to market.
A class of cameras suitable for use in conference room applications or automated environments where an operator is not required. FPGAs are ideal for combining the camera interface, image processing, and connectivity in a single device to film and distribute live video (or store it).
Key applications:
- Conference room
- Houses of worship
- TV shows
- Live events
FPGA IP functionality in soft logic:
- Video connectivity interfaces (SDI, HDMI and Ethernet, LVDS, SLVS-EC, other sensor standards)
- Camera Image Signal Processing (ISP)
- Generic Video Processing such as scaling, mixing, HDR, etc.
- Low compression ratio video compression and decoding such as ProRes or JPEG-XS
Learn more:
- Video and Vision Processing Suite Intel® FPGA IP User Guide
- High-performance Image Signal Processing and Camera Sensor Pipeline Design on FPGAs
- Genlock Controller Intel® FPGA IP
- Intel® FPGA Streaming Video Protocol Specification
- HDMI Intel® FPGA IP User GuideSDI II Intel® FPGA IP User Guide
- SDI II Intel® FPGA IP User Guide
- Nextera - Adeas ST 2110 Core
- Nextera - Adeas IPMX Core
- NDI
AV-over-IP equipment uses a standards-based or proprietary-based packetization system for transmission on IP networks. The standards-based system has the advantage of interoperability between products from different vendors.
The use of AVoIP is now being used to replace the traditional Pro AV connections such as HDMI, DisplayPort, and SDI with the added benefit of allowing for longer cable runs and easy signal routing.
Key applications:
- KVM
- Professional production
- Houses of worship
- Digital signage
FPGA IP functionality in soft logic:
- Video connectivity interfaces (SDI, HDMI and Ethernet)
- Generic Video Processing such as scaling, mixing, switching, etc.
- Low compression ratio, low latency video compression and decoding such as JPEG-XS, ProRes, VC-2, MPEG, and other proprietary standards
Learn more:
Video projectors are used for many applications such as conference room presentations, classroom training, home cinema, movie theaters, and live events.
Video projectors use a very bright ultra-high-performance lamp to provide the illumination required to project the image. Modern projectors use FPGA processing for video processing, lens correction, geometric transforms, and other tasks.
Key applications:
- Conference room
- Live events
- Movie theatre
FPGA IP functionality in soft logic:
- Video connectivity interfaces (DSC, DisplayPort, Vx1, SDI, HDMI and Ethernet, LVDS, SLVS-EC)
- Generic Video Processing such as scaling, mixing, switching, etc.
- Low compression ratio, low latency video compression and decoding such as JPEG-XS, ProRes, VC-2, MPEG & other proprietary standards
Learn more:
Equipment used to treat, transmit, and receive video and KVM over long distances using ethernet cabling in private or public networks. End usages include professional shows, enterprise video networks, hospitality video networks, houses of worship, signage, and retail video networking.
Key applications:
- Conference room
- Digital signage
- Houses of worship
FPGA IP functionality in soft logic:
- Video connectivity interfaces (SDI, HDMI, DP, Ethernet, LVDS, SLVS-EC, other sensor standards, MIPI, Vx1)
- Generic Video Processing such as scaling, mixing, switching, etc.
Learn more:
- HDMI FPGA IP Core
- DisplayPort FPGA IP Core
- MIPI (partners) or MIPI (Altera Agilex™ 5 FPGAs and SoCs)
- SDI II FPGA IP Core
- IPMX Core
- NDI
Browse Altera and Partner Solutions
Take advantage of ready-to-deploy solutions from Altera and our partners to accelerate your projects.