基于優(yōu)選特征軌跡的全分辨率視頻穩(wěn)定
doi: 10.11999/JEIT141019
基金項(xiàng)目:
國(guó)家自然科學(xué)基金青年科學(xué)基金(61202292)和廣東省自然科學(xué)基金(9151064101000037)資助課題
Full-frame Video Stabilization Based on Preferred Feature Trajectories
-
摘要: 該文提出一種基于優(yōu)選特征軌跡的視頻穩(wěn)定算法。首先,采用改進(jìn)的Harris角點(diǎn)檢測(cè)算子提取特征點(diǎn),通過K-Means聚類算法剔除前景特征點(diǎn)。然后,利用幀間特征點(diǎn)的空間運(yùn)動(dòng)一致性減少錯(cuò)誤匹配和時(shí)間運(yùn)動(dòng)相似性實(shí)現(xiàn)長(zhǎng)時(shí)間跟蹤,從而獲取有效特征軌跡。最后,建立同時(shí)包含特征軌跡平滑度與視頻質(zhì)量退化程度的目標(biāo)函數(shù)計(jì)算視頻序列的幾何變換集以平滑特征軌跡獲取穩(wěn)定視頻。針對(duì)圖像扭曲產(chǎn)生的空白區(qū),由當(dāng)前幀定義區(qū)與參考幀的光流作引導(dǎo)來腐蝕,并通過圖像拼接填充仍屬于空白區(qū)的像素。經(jīng)仿真驗(yàn)證,該文方法穩(wěn)定的視頻,空白區(qū)面積僅為Matsushita方法的33%左右,對(duì)動(dòng)態(tài)復(fù)雜場(chǎng)景和多個(gè)大運(yùn)動(dòng)前景均具有較高的有效性并可生成內(nèi)容完整的視頻,既提高了視頻的視覺效果,又減輕了費(fèi)時(shí)的邊界修復(fù)任務(wù)。
-
關(guān)鍵詞:
- 圖像處理 /
- 視頻穩(wěn)定 /
- 特征點(diǎn)軌跡 /
- 圖像扭曲 /
- 光流 /
- 運(yùn)動(dòng)修復(fù)
Abstract: A novel video stabilization algorithm based on preferred feature trajectories is presented. Firstly, Harris feature points are extracted from frames, and foreground feature points are eliminated via K-Means clustering algorithm. Then, the effective feature trajectories are obtained via spatial motion consistency to reduce false matches and temporal motion similarity for long-time tracking. Finally, an objective function is established, which contains both smoothness of feature trajectories and degradation of video qualities to find a set of transformations to smooth out the feature trajectories and obtain stabilized video. As for the blank areas of image warping, optical flow between the defined area of current frame and the reference frame is used as a guide to erode them, mosaicing based on the reference frame is used to get a full-frame video. The simulation experiments show that the blank area of the stabilized video with the proposed method is only about 33% of that with Matsushita method, it is effective to dynamic complex scenes and multiple large moving objects, and can obtain content complete video, the proposed method can not only improve the visual effect of video, but also reduce the motion inpainting.-
Key words:
- Image processing /
- Video stabilization /
- Point-feature trajectories /
- Image warping /
- Optical flow /
- Motion inpainting
-
計(jì)量
- 文章訪問數(shù): 1466
- HTML全文瀏覽量: 212
- PDF下載量: 628
- 被引次數(shù): 0