一级黄色片免费播放|中国黄色视频播放片|日本三级a|可以直接考播黄片影视免费一级毛片

高級搜索

留言板

尊敬的讀者、作者、審稿人, 關(guān)于本刊的投稿、審稿、編輯和出版的任何問題, 您可以本頁添加留言。我們將盡快給您答復(fù)。謝謝您的支持!

姓名
郵箱
手機號碼
標題
留言內(nèi)容
驗證碼

面向三維高效視頻編碼的深度圖錯誤隱藏

周洋 吳佳憶 陸宇 殷海兵

周洋, 吳佳憶, 陸宇, 殷海兵. 面向三維高效視頻編碼的深度圖錯誤隱藏[J]. 電子與信息學(xué)報, 2019, 41(11): 2760-2767. doi: 10.11999/JEIT180926
引用本文: 周洋, 吳佳憶, 陸宇, 殷海兵. 面向三維高效視頻編碼的深度圖錯誤隱藏[J]. 電子與信息學(xué)報, 2019, 41(11): 2760-2767. doi: 10.11999/JEIT180926
Yang ZHOU, Jiayi WU, Yu LU, Haibing YIN. Depth Map Error Concealment for 3D High Efficiency Video Coding[J]. Journal of Electronics & Information Technology, 2019, 41(11): 2760-2767. doi: 10.11999/JEIT180926
Citation: Yang ZHOU, Jiayi WU, Yu LU, Haibing YIN. Depth Map Error Concealment for 3D High Efficiency Video Coding[J]. Journal of Electronics & Information Technology, 2019, 41(11): 2760-2767. doi: 10.11999/JEIT180926

面向三維高效視頻編碼的深度圖錯誤隱藏

doi: 10.11999/JEIT180926
基金項目: 浙江省自然科學(xué)基金(LY17F020027),國家自然科學(xué)基金(61401132, 61572449)
詳細信息
    作者簡介:

    周洋:男,1979年生,副教授,碩士生導(dǎo)師,研究方向為視頻分析和三維視頻編解碼

    吳佳憶:男,1994年生,碩士生,研究方向為視頻差錯控制技術(shù)

    陸宇:男,1977年生,講師,研究方向為視頻壓縮技術(shù)

    殷海兵:男,1974年生,教授,研究方向為視頻編碼與壓縮芯片設(shè)計

    通訊作者:

    周洋 zhouyang_hz@126.com

  • 中圖分類號: TP391

Depth Map Error Concealment for 3D High Efficiency Video Coding

Funds: Zhejiang Province Natural Science Fundation (LY17F020027), The National Natural Science Foundation of China (61401132, 61572449)
  • 摘要: 基于多視點視頻序列視點內(nèi)、視點間存在的相關(guān)性,并結(jié)合視點間運動矢量共享技術(shù),該文提出一種面向3維高效視頻編碼中深度序列傳輸丟包的錯誤隱藏算法。首先,根據(jù)3D高效視頻編碼(3D-HEVC)的分層B幀預(yù)測(HBP)結(jié)構(gòu)和深度圖紋理特征,將深度圖丟失塊分成運動塊和靜止塊;然后,對于受損運動塊,使用結(jié)合紋理結(jié)構(gòu)的外邊界匹配準則來選擇相對最優(yōu)的運動/視差矢量進行基于位移矢量補償?shù)腻e誤掩蓋,而對受損靜止塊采用參考幀直接拷貝進行快速錯誤隱藏;最后,使用參考幀拆分重組來獲取新的運動/視差補償塊對修復(fù)質(zhì)量較差的重建塊進行質(zhì)量提升。實驗結(jié)果表明:相較于近年提出的對比算法,該文算法隱藏后的深度幀平均峰值信噪比(PSNR)能提升0.25~2.03 dB,結(jié)構(gòu)相似度測量值(SSIM)能提升0.001~0.006,且修復(fù)區(qū)域的主觀視覺質(zhì)量與原始深度圖更接近。
  • 圖  1  算法總體流程圖

    圖  2  丟失塊周圍鄰塊位移矢量的選擇

    圖  3  PSNR逐幀測試結(jié)果曲線圖

    圖  4  Poznanstreet第3視點第3幀錯誤隱藏結(jié)果

    圖  5  Kendo第3視點第3幀主觀測試結(jié)果

    表  1  組合參考塊對應(yīng)表

    參考列表參考幀號L0L1
    R00R01R0KR10R11R1K
    L0R00P0B00B01B0iB0K
    R01P1B10B11B1iB1K
    PiBi0Bi1BiiBiK
    R0KPKBK0BK1BKiBKK
    L1R10B00B10Bi0BK0PK+1
    R11B01B11Bi1BK1PK+2
    B0iB1iBiiBKiPK+i
    R1KB0KB1KBiKBKKP2K
    下載: 導(dǎo)出CSV

    表  2  QP=30, 25時各測試序列重建圖像平均PSNR計算結(jié)果(dB)

    QP序列原始錯誤率50%錯誤率25%錯誤率10%
    文獻[6]文獻[7]MVC本文算法文獻[6]文獻[7]MVC本文算法文獻[6]文獻[7]MVC本文算法
    30Kendo42.76136.40636.12235.89437.10337.89637.35936.78638.31039.44938.92538.02539.833
    Bookarrival39.92336.93235.91135.65637.52537.86537.17136.52638.28638.33837.69937.38938.747
    Poznanstreet44.02839.59338.83436.66240.86441.15541.02840.79941.89041.45041.21940.98342.171
    Balloon40.57438.71338.51237.69139.26939.51439.45638.34739.83939.70639.63838.48539.958
    25Kendo45.87436.73636.54836.09637.49939.22738.05837.28739.65541.36839.68839.13341.501
    Bookarrival41.62537.98136.73336.35438.27038.41137.48836.94739.92139.72839.19638.46340.187
    Poznanstreet46.12239.95538.92837.06641.56141.72341.17840.80242.31942.11341.79741.20742.622
    Balloon44.02240.82939.43439.15641.24741.89941.27740.89442.14942.23442.15841.08442.612
    下載: 導(dǎo)出CSV

    表  3  QP=30, 25時各測試序列重建圖像平均SSIM計算結(jié)果

    QP序列原始錯誤率50%錯誤率25%錯誤率10%
    文獻[6]文獻[7]MVC本文算法文獻[6]文獻[7]MVC本文算法文獻[6]文獻[7]MVC本文算法
    30Kendo0.98670.97080.96880.96470.97210.97800.97760.97330.97850.98190.98160.97660.9822
    Bookarrival0.95650.94820.94570.94220.94950.95030.94810.94520.95100.95250.95180.94770.9534
    Poznanstreet0.97950.97320.97200.97140.97590.97460.97400.97380.97670.97510.97500.97440.9769
    Balloon0.97670.97380.97330.97200.97430.97450.97420.97360.97510.97470.97460.97430.9757
    25Kendo0.98740.97220.96960.96600.97510.97890.97830.97650.97960.98280.98240.97950.9832
    Bookarrival0.97010.95770.95470.95390.95980.96340.96270.96130.96410.96430.96420.96330.9655
    Poznanstreet0.98780.98180.98030.97960.98240.98250.98210.98160.98480.98430.98410.98240.9849
    Balloon0.98550.98100.98030.97960.98210.98340.98330.98280.98390.98410.98360.98350.9844
    下載: 導(dǎo)出CSV

    表  4  各測試序列解碼運行時間(s)

    序列原解碼文獻[6]文獻[7]MVC本文
    Kendo188.71231.45198.83192.07194.19
    Balloon172.35216.14178.13173.82174.69
    Bookarrival175.86219.35183.19177.18179.13
    Poznanstreet483.67558.15498.68484.68486.07
    下載: 導(dǎo)出CSV
  • LI Yufeng and CHEN Ruining. Motion vector recovery for video error concealment based on plane fitting[J]. Computer Engineering &Applications, 2018, 54(2): 182–187. doi: 10.3778/j.issn.1002-8331.1608-0085
    XU Dawen and WANG Rangding. Two-dimensional reversible data hiding-based approach for intra-frame error concealment in H.264/AVC[J]. Journal of Visual Communication& Image Representation, 2016, 47(2): 369–379. doi: 10.1016/j.jvcir.2013.12.008
    ZABIHI S M, GHANEI Y H, and MEHRSHAD N. Adaptive temporal error concealment method based on the MB behavior estimation in the video[C]. The 7th International Conference on Computer and Knowledge Engineering. Mashhad, Iran, 2017: 193–198.
    EL-SHAFAI W, EL-RABAIE S, EL-HALAWANY M M, et al. Recursive Bayesian filtering-based error concealment scheme for 3D video communication over severely lossy wireless channels[J]. Circuits Systems & Signal Processing, 2018(20): 1–32. doi: 10.1007/s00034-018-0786-8
    周洋, 蔣剛毅, 郁梅, 等. 面向HBP編碼格式的立體視頻B幀整幀丟失分層錯誤隱藏算法[J]. 電子與信息學(xué)報, 2014, 36(2): 377–383. doi: 10.3724/SP.J.1146.2013.00528

    ZHOU Yang, JIANG Gangyi, YU Mei, et al. A hierarchical error concealment algorithm for entire B-frame loss in stereoscopic video coding with hierarchical B pictures[J]. Journal of Electronics &Information Technology, 2014, 36(2): 377–383. doi: 10.3724/SP.J.1146.2013.00528
    SONG K, CHUNG T, OH Y, et al. Error concealment of multi-view video sequences using inter-view and intra-view correlations[J]. Journal of Visual Communication & Image Representation, 2009, 20(4): 281–292. doi: 10.1016/j.jvcir.2009.02.002
    PENG Yantsung and COSMAN P C. Weighted boundary matching error concealment for HEVC using block partition decisions[C]. The 48th Asilomar Conference on Signals, Systems & Computers, Grove, USA, 2014: 921–925. doi: 10.1109/ACSSC.2014.7094587.
    KHATTAK S, MAUGEY T, HAMZAOUI R, et al. Temporal and inter-view consistent error concealment technique for multiview plus depth video[J]. IEEE Transactions on Circuits & Systems for Video Technology, 2016, 26(5): 829–840. doi: 10.1109/TCSVT.2015.2418631
    LIU Shujie, CHEN Ying, WANG Yekui, et al. Frame loss error concealment for multiview video coding[C]. IEEE International Symposium on Circuits and Systems (ISCAS 2008), Washington, USA, 2008: 3470–3473.
    ZHOU Yuan, XIANG Wei, and WANG Gengkun. Frame loss concealment for multiview video transmission over wireless multimedia sensor networks[J]. IEEE Sensors Journal, 2015, 15(3): 1892–1901. doi: 10.1109/JSEN.2014.2366511
    HUANG Pincheng, LIN Jieru, LI Gwolong, et al. Improved depth-assisted error concealment algorithm for 3D video transmission[J]. IEEE Transactions on Multimedia, 2017, 19(11): 2625–2632. doi: 10.1109/TMM.2017.2694218
    TAI Shenchuan, WANG Chuenching, HONG Chienshiang, et al. An efficient full frame algorithm for object-based error concealment in 3D depth-based video[J]. Multimedia Tools & Applications, 2016, 75(16): 9927–9947. doi: 10.1007/s11042-015-2899-4
    時琳, 劉榮科, 李君燁. 基于深度信息的立體視頻錯誤隱藏方法[J]. 電子與信息學(xué)報, 2012, 34(7): 1678–1684. doi: 10.3724/SP.J.1146.2011.01107

    SHI Ling, LIU Rongke, and LI Junye. Error concealment based on depth information for stereoscopic video coding[J]. Journal of Electronics &Information Technology, 2012, 34(7): 1678–1684. doi: 10.3724/SP.J.1146.2011.01107
    YANG Meng, LAN Xuguang, ZHENG Nanning, et al. Depth-assisted temporal error concealment for intra frame slices in 3-D video[J]. IEEE Transactions on Broadcasting, 2014, 60(2): 385–393. doi: 10.1109/TBC.2014.2321676
    YAN Bo and ZHOU Jie. Efficient frame concealment for depth image-based 3-D video transmission[J]. IEEE Transactions on Multimedia, 2012, 14(3): 936–941. doi: 10.1109/TMM.2012.2184743
    MERKLE P, MULLER K, MARPE D, et al. Depth intra coding for 3D video based on geometric primitives[J]. IEEE Transactions on Circuits & Systems for Video Technology, 2016, 26(3): 570–582. doi: 10.1109/TCSVT.2015.2407791
    HEWAGE C T E R, WORRALL S, DOGAN S, et al. Frame concealment algorithm for stereoscopic video using motion vector sharing[C]. 2008 IEEE International Conference on Multimedia and Expo, Hannover, Germany, 2008: 485–488. doi: 10.1109/ICME.2008.4607477.
    ASSUNCAO P, MARCELINO S, SOARES S, et al. Spatial error concealment for intra-coded depth maps in multiview video-plus-depth[J]. Multimedia Tools &Applications, 2017, 76(12): 13835–13858. doi: 10.1007/s11042-016-3766-7
    HTM Reference Software 14.0. http://hevc.kw.bbc.co.uk/git/w/jctvc-3de.git, 2016.
    WANG Zhou, BOVIK A C, SHEIKH H R, et al. Image quality assessment: From error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 2004, 13(4): 600–612. doi: 10.3969/j.issn.1006-8961.2006.12.00.003
  • 加載中
圖(5) / 表(4)
計量
  • 文章訪問數(shù):  2206
  • HTML全文瀏覽量:  1025
  • PDF下載量:  43
  • 被引次數(shù): 0
出版歷程
  • 收稿日期:  2018-09-30
  • 修回日期:  2019-04-05
  • 網(wǎng)絡(luò)出版日期:  2019-05-21
  • 刊出日期:  2019-11-01

目錄

    /

    返回文章
    返回