基于视频序列的图像配准算法研究与应用

工学硕士学位论文

基于视频序列的图像配准算法研究与应用

王帅

哈尔滨工业大学

2007年7月

国内图书分类号：TP391.4

国际图书分类号：681.39

工学硕士学位论文

基于视频序列的图像配准算法研究与应用

硕士研究生：王帅

导师：承恒达 教授

申请学位：工学硕士

学科、专业：计算机科学与技术

所在单位：计算机科学与技术学院

答辩日期：2007年7月

授予学位单位：哈尔滨工业大学

Classified Index: TP391.4

U.D.C: 681.39

Dissertation for the Master Degree in Engineering

RESEARCH AND APPLICATION

OF IMAGE REGISTRATION BASED

ON VIDEO SEQUENCE

Candidate：Wang Shuai

Supervisor：Prof. Cheng Hengda

Academic Degree Applied for：Master of Engineering

Specialty：Computer Science and Technology Affiliation：School of Computer Science and

Technology Date of Defence：July, 2007

Degree-Conferring-Institution：Harbin Institute of Technology

哈尔滨工业大学工学硕士学位论文

摘要

随着数字技术的不断发展，视频图像的分析与处理越来越受到人们的关注。数字化图像序列可以通过摄像机等光学设备获得，是真实世界在不同时间向成像平面的一系列投影。图像帧之间具有较大的相关性和信息冗余，找到并描述图像序列间的内在联系成为研究的关键所在。图像配准技术可以有效地解决这类问题。

图像配准问题是图像处理里的一个基本问题，是将不同时间、不同传感器、不同视角及不同拍摄条件下获取的图像对齐或匹配，消除存在的几何畸变。图像配准在计算机视觉、模式识别、医学图像处理和遥感信息处理方面有着广泛的应用。

本文提出了基于自适应聚类的特征匹配方法，满足大量图像配准的需求，提高匹配的速度，该方法基于正确匹配点对间形成矢量的一致性，对匹配点对进行自适应聚类，实验证明该方法在保证正确匹配不丢失的同时，可有效剔除绝大多数错误匹配，为进一步进行RANSAC匹配提供方便，且有效地提高了整个匹配过程的速度。

本文提出一种简单有效的图像合成方法。该方法针对摄像机固定位置，水平旋转拍摄的视频序列的特点，选取图像序列中部分帧，通过H矩阵确定重叠区域，再利用线性插值进行图像融合。实验证明在转角小于180 时，合成效果较好。

本文成功运用图像配准技术完成运动员滑行数据的测量，利用图像配准技术估计图像间摄像机运动，进而消除摄像机运动的影响，得到运动员的真实运动数据。根据这一原理，首先对冰场进行合理化建模，并确定相应的视频拍摄方案，设计了运动员冰场定位算法，利用帧间的H矩阵估计摄像机旋转角度，进而估计运动员的旋转角度完成滑行数据的测量。

关键词图像配准；特征点匹配；自适应聚类

- -I

哈尔滨工业大学工学硕士学位论文

- -

II Abstract

With the rapid advances in digital technology, the analysis and processing of video sequence has gained increasing attention in recent years. Digital image sequence can be obtained by optics device, such as camera, which is a series of projection from the real world to imaging plane at different times. Image frames have great correlation and information redundancy. The key of research is to find and describe the relationship between images. Image registration techniques can effectively solve such problem.

Image registration is a basic problem in image processing. It matches two or more images, at different times, from different sensors or from different view points, in order to remove of the potential geometrical distortion existed. Image registration is extensively applied to computer vision, pattern recognition, medical image processing and remote sensing information processing.

This paper presents a new method of image registration based on adaptive clustering, which satisfy vast image registration and work fast. The algorithm clusters the matching points adaptive, based on the vector consistency between correct matching points. The experimental results show that the adaptive clustering algorithm can work reliably, filter candidate matches well, prepare for RANSAC matching and increase the speed of match processing.

This paper presents a simple and effective method of image composition. For the image sequences which are obtained by fixed, horizontal panning camera, The method chooses some key frames from image sequences first, then find the overlap areas by homograghy matrix, composite the image by linear interpolation. If panning angle of camera is less than 180 , the method work well.

This paper measures the data of athlete successfully using image registration technology. We estimate the camera motion parameters, in order to remove of the influence of camera motion, then we can obtain real data of athlete. According to this principle, we establish a reasonable model for ice stadium, and give a corresponding method of camera shoot, design athlete location algorithm, estimate the camera panning angle by homograghy matrix of adjacent images,