一種多子塊協(xié)同的自適應(yīng)快速數(shù)字穩(wěn)像方法
doi: 10.11999/JEIT150875
-
1.
(北京航空航天大學(xué)計算機學(xué)院 北京 100191) ②(防空兵學(xué)院 鄭州 450052)
基金項目:
國家自然科學(xué)基金(61370124)，國家863計劃項目(2014AA015104)，國家留學(xué)基金(20130307020)
A Fast and Adaptive Digital Image Stabilization Method Based on Multi-block Collaboration
-
1.
(School of Computer Science and Engineering, Beihang University, Beijing 100191, China)
Funds:
The National Natural Science Foundation of China (61370124), The National 863 Program of China (2014AA 015104), Scholarship Foundation of China (20130307020)
-
摘要: 針對現(xiàn)有數(shù)字穩(wěn)像系統(tǒng)穩(wěn)像精度低、難以實時處理的問題，該文提出一種快速魯棒的數(shù)字視頻穩(wěn)像方法。采用亞像素相位相關(guān)對圖像子塊進行局部匹配，根據(jù)局部運動的一致性，利用多子塊協(xié)同獲取全局運動矢量，在減少計算量的同時保證了穩(wěn)像精度與范圍；進而提出主動運動平穩(wěn)性和一致性兩種度量，利用其反饋調(diào)整卡爾曼濾波參數(shù)，實現(xiàn)主動運動和抖動的準(zhǔn)確分離；最后根據(jù)幀間抖動特點選擇鄰近適合圖像進行存儲，在節(jié)省存儲資源的同時達到較好的補償效果。實驗結(jié)果表明，該文提出的穩(wěn)像方法具有較高的穩(wěn)像精度以及較強的抗干擾能力，可用于實時電子穩(wěn)像產(chǎn)品。
-
關(guān)鍵詞:
- 數(shù)字穩(wěn)像 /
- 多子塊協(xié)同 /
- 亞像素 /
- 平穩(wěn)性 /
- 一致性
Abstract: The classical digital image stabilization system usually suffers from the problems of low precision and hardly real time processing. This paper presents a fast and robust digital image stabilization method. The sub-pixel phase correlation is used for local registration, and the global motion is collaboratively obtained according to the consistency of local motions, which can decrease the calculation while maintain the precision and tolerable stabilization range. The stationary and consistency assessments of intentional movement are proposed, which are used as feedbacks to adjust the parameter online for Kalman filter. Finally, according to the shaking character of frames, the adjacent frames are stored selectively to save storage resources and better compensation effect is achieved. Experiments show that the proposed method is accurate and robust, and can be used for real-time digital image stabilization products.-
Key words:
- Digital image stabilization /
- Multi-block collaboration /
- Sub-pixel /
- Stabilization /
- Consistency
-
朱娟娟. 電子穩(wěn)像理論及其應(yīng)用研究[D]. [博士論文], 西安電子科技大學(xué), 2009. ZHU Juanjuan. Research on theory and application of electronic image stabilization[D]. [Ph. D. dissertation], Xidian University, 2009. ZHANG Haolong, WU Qiang, LIU Tianqi, et al. Design and implementation of electronic image stabilization system based on dual-core DSP[C]. International Conference on Intelligent Information Hiding and Multimedia Signal Processing, Beijing, 2013: 117-120. doi: 10.1109/IIH-MSP. 2013.38. 時永剛, 周渝斌, 趙躍進. 實時電子數(shù)字穩(wěn)像系統(tǒng)并行處理的快速實現(xiàn)[J]. 電子與信息學(xué)報, 2006, 28(7): 1175-1179. SHI Yonggang, ZHOU Yubin, and ZHAO Yuejin. Fast parallel implementation of real-time electronic digital image stabilization system[J]. Journal of Electronics Information Technology, 2006, 28(7): 1175-1179. HAQUE M N, BISWAS M, PICKERING M R, et al. A low-complexity image registration algorithm for global motion estimation[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012, 22(3): 426-433. doi: 10.1109/TCSVT.2011.2163983. 吳浩, 鄧宏彬. 一種基于分塊灰度投影運動估計的視頻穩(wěn)像方法[J]. 兵工學(xué)報，2013, 34(4): 406-411. doi: 10.3969/j.issn. 1000-1093.2013.04.004. WU Hao and DENG Hongbin. A video stabilization method based on sub-block gray projection[J]. Acta Armamentaii, 2013, 34(4): 406-411. doi: 10.3969/j.issn.1000-1093.2013. 04.004. 余家林, 孫季豐, 宋治國. 基于優(yōu)選特征軌跡的全分辨率視頻穩(wěn)定[J]. 電子信息學(xué)報, 2015, 37(5): 1141-1148. doi: 10.11999/JEIT141019. YU Jialin, SUN Jifeng, and SONG Zhiguo. Full-frame video stabilization based on preferred feature trajectories[J]. Journal of Electronics Information Technology, 2015, 37(5): 1141-1148. doi: 10.11999/JEIT141019. KIM S W, YIN S, YUN K, et al. Spatio-temporal weighting in local patches for direct estimation of camera motion in video stabilization[J]. Elsevier Computer Vision and Image Understanding, 2014, 118: 71-83. doi: 10.1016/j.cviu. 2013.09.005. 于白, 胡葉鳳, 鄭錦, 等. 基于下采樣和亞像素相位相關(guān)的全局運動估計[C]. 第十三屆全國圖形圖像學(xué)術(shù)會議, 南京, 2006: 450-453. YU Bai, HU Yefeng, ZHENG Jin, et al. Global motion estimation based on sub-sampling and sub-pixel phase correlation[C]. The National Conference on Image and Graphics, Nanjing, 2006: 450-453. ALFONSO A, FLAVIO V G, EDGAR R A S, et al. Phase correlation with subpixel accuracy: a comparative study in 1D and 2D[J]. Elsevier Computer Vision and Image Understanding, 2015, 137: 76-87. doi: 10.1016/j.cviu. 2015.03.011. ERTURK S. Digital image stabilization with subimage phase correlation based global motion estimation[J]. IEEE Transactions on Consumer Electronics, 2003, 49(4): 13201325. doi: 10.1109/TCE.2003.1261235. LI Lengyi, MA Xiaohong, and ZHAO Zheng. Real-time video stabilization based on fast block matching and improved Kalman filter[C]. IEEE International Conference on Intelligent Control and Information Processing (ICICIP), Dalian, 2014: 394-397. doi: 10.1109/ICICIP.2014.7010285. 羅雨, 王永慶, 羅海坤, 等. 基于擴展卡爾曼濾波器的矢量跟蹤算法研究[J]. 電子與信息學(xué)報, 2013, 35(6): 1400-1405. doi: 10.3724/SP.J.1146.2012.00828. LUO Yu, WANG Yongqing, LUO Haikun, et al. Study on vector tracking loop based on extended Kalman filter[J]. Journal of Electronics Information Technology, 2013, 35(6): 1400-1405. doi: 10.3724/SP.J.1146.2012.00828. 董晶, 楊夏, 于起峰. 基于單應(yīng)軌跡的視頻實時穩(wěn)像算法[J]. 國防科技大學(xué)學(xué)報, 2014, 36(2): 99-104. doi: 10.11887/j.cn. 201402017. DONG Jing, YANG Xia, and YU Qifeng. A real-time video stabilization algorithm based on homography trajectory[J]. Journal of National University of Defense Technology, 2014, 36(2): 99-104. doi: 10.11887/j.cn.201402017. YEON G R and MYUNG J C. Robust online digital image stabilization based on point-feature trajectory without accumulative global motion estimation[J]. IEEE Signal Processing Letters, 2012, 19(4): 223-226. doi: 10.1109/ LSP.2012.2188286. MAI Ying, ZHAO Hongying, and GUO Shiyi. The analysis of image stabilization technology based on small-UAV airborne video[C]. IEEE International Conference on Computer Science and Electronics Engineering, Hangzhou, 2012: 586-589. doi: 10.1109/ICCSEE.2012.77. MATSUSHITA Y, OFEK E, WEINA G, et al. Full-frame video stabilization with motion inpainting[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006, 28(7): 1150-1163. doi: 10.1109/TPAMI.2006.141. TANG Chongwu, YANG Xiaokang, CHEN Li, et al. A fast video stabilization algorithm based on block matching and edge completion[C]. IEEE International Workshop on Multimedia Signal Processing (MMSP), Hangzhou, 2011: 1-5. doi: 10.1109/MMSP.2011.6093781. -
計量
- 文章訪問數(shù): 1288
- HTML全文瀏覽量: 76
- PDF下載量: 413
- 被引次數(shù): 0
下載:
