Intel Media Framework Upstream Patches 2022Q4 - Queue Release

author-image

By

FFmpeg

FFmpeg-vaapi and FFmpeg-QSV 2022Q4 upstream patches commits tested:

 

Gstreamer

Gst-vaapi and Gst-msdk(in gst-plugins-bad) 2022Q4 upstream patches commits tested:

 

  • gstreamer: 6687e7ed179bf7bc1d270534a098e343f8eb01fdRelease

Supported Intel Platforms

  • ATS-M
  • DG2
  • RPL-S (Raptor Lake-S/P)
  • ADL (Alder Lake-S/P/N)
  • SG1/DG1
  • RKL (Rocket Lake)
  • TGL (Tiger Lake)
  • ICL (Ice Lake)
  • JSL (Jasper Lake)/EHL (Elkhart Lake)
  • KBLx (KBL/Kaby Lake; CFL/Coffe Lake; WHL/Whiskey Lake; CML/Comet Lake; AML/Amber Lake)

Appendix

Supported Features Among Intel platforms

For features supported among on each Intel platform, please refer links shown as below:

 

 

VPP features:  https://github.com/intel/media-driver/#video-processing-features

Contactors

Please contact focus.luo@intel.com or ullysses.a.eoff@intel.com or haihao.xiang@intel.com or guangxin.xu@intel.com if you have any questions.

New Detail

2022Q4:

ffmpeg and Gstreamer added new RPL-P platform support

ffmpeg and Gstreamer added new ADL-N platform support

FFmpeg:
 

  • ffmpeg-qsv added av1 encode adaptive_i/b support
  • ffmpeg-qsv added hevc encode support HDR info support
  • ffmpeg-qsv added hevc encode 12bit (p012, y212, xv36) support
  • ffmpeg-qsv decoder support to ouput hdr info
  • ffmpeg-qsv change gop option to ”open“ by default
  • ffmpeg-qsv added vpp_qsv scale mode can be applied to color conversion
  • ffmpeg-qsv added vpp_qsv support p010 system memory input
  • ffmpeg-vaapi refined overlay vaapi filter and added more options like framesync
  • ffmpeg-vaapi added hevc encode 12bit (p012, y212, xv36) support
     

Gstreamer:
 

  • Add d3d11 video memory support for encoder and vpp
  • Fix decoder pts issue
  • Fix vpp upper framerate conversion issue
     

2022Q3:

FFmpeg and Gstreamer added new RPL-S platform support

FFmpeg:
 

  • ffmpeg-vaapi added av1 encode support
  • ffmpeg-vaapi can select related hw codec to do decode automatically, a example cmd line for decode "ffmpeg -hwccel vaapi -i av1.mp4 -f null -"
  • ffmpeg-qsv h265 encode added adaptive_i/b support
  • ffmpeg-qsv vpp scaling add model select through oneVPL which supports EU, VDBOX or VEBOX. User can use option of "scale_mode" to select which hardware model
  • ffmpeg dnn: OpenVINO full GPU detect and classify support
  • ffmpeg dnn: enabled libtorch as one of FFmpeg DNN backend
     

​Gstreamer:
 

  • gst-msdk improve memory abstraction for encoder and vpp, which enables the direct share of VA surface between gst-msdk enc/vpp and gst-va element
  • gst-msdk fix msdkav1enc's failure with some resolutions

 

2022Q2:

FFmpeg:
 

  • ffmpeg-vaapi added VDSFC Scaling support
  • ffmpeg-vaapi added max_frame_size for encode
  • ffmpeg-vaapi added GPB frame support for encode
  • ffmpeg-qsv added adaptive_i and adaptive_b support for hevc encode
  • ffmpeg-qsv added min/max qp control for I/P/B frames
  • ffmpeg-qsv added ROI support for h264/h265 encode
  • ffmpeg-qsv supported yuyv422/y210 format direct input mode for encode
  • ffmpeg added gaussian filter through Vulkan
  • ffmpeg added stitching filter through libxcam library
  • ffmpeg video analysis added BasicVSR super resolution support
  • ffmpeg video analysis added FRVSR super resolution
     

Gstreamer:
 

  • gst-msdk added av1 encode support;
  • gst-msdk added VUYA interleaved color format in dmabuf mode
  • gst-msdk added intra refresh for avc/hevc encode

 

2022Q1:

FFmpeg: 
 

  • ffmpeg_qsv added av1 encode support
  • supported av1 decode frame split bsf feature in ffmpeg core
  • fixed a hevc 10bit run2run issue on some legacy platforms for ffmpeg_qsv
  • added a powerful and customizable gblur Vulkan filter for ffmpeg
     

Gstreamer:
 

  • gst-msdk avc/hevc decoder added SFC support for csc and scaling
  • gst-msdk encoders enabled VA surface input path
  • gst-vaapi improved av1 parse and fixed some av1 decode failed cases (such as film grain)
  • fixed some h264 decode failed cases for gst-msdk, which needs check for width and height in mfxVideoParam

 

2021Q4:

FFmpeg new features:
 

  • buffer sharing between media and vulkan  
  • support 0YUV, YUY2, Y210, Y410, P012, Y212, Y412 on Windows when using d3d11 device 
  • hevc main10 sp encoding
     

Gstreamer new features:
 

  • Gstmsdk vpp supports csc to 12bit format 
  • Gstmsdk hevc encoder supports to encode HDR SEIs