Calibration Aspects of Multiple Line-scan Vision System Application for Planar Objects Inspection
A. Hossu, D. Hossu
{"title":"Calibration Aspects of Multiple Line-scan Vision System Application for Planar Objects Inspection","authors":"A. Hossu, D. Hossu","doi":"10.5220/0001480300360040","DOIUrl":null,"url":null,"abstract":"The System Set-up Time it is one of the characteristics of an Industrial Vision System, besides the accuracy performances and response time. Minimizing the set-up time while keeping the performances in accuracy and in response time is one of the goals of any advanced Vision System. Starting from the purpose and the required performances of the proposed Industrial Vision System, in the paper is presented a calibration method developed for a multiple line-scan camera Vision System (in particular for a dual line-scan camera system). The calibration method presented is based on analyzing the image of a calibration tool exposed to the Vision System. There are presented the type of dimensional distortions identified from the experimental results. The second part of the paper presents the calibration method. The Industrial Vision System described in the paper is designed for silhouette inspection of planar objects located on a moving scene (transport conveyor), in a robotic handling application (it is a pure 2D Vision System, the volumetric characteristics of the analyzed objects being not relevant for the application). However the height of the object is varying in time (from one set of objects to another). Due to the fact the distance between the cameras and the objects is changing, the measuring results are affected. The proposed calibration method allows the Vision System to self adjust the calibration parameters for a known change in height of the objects, without affecting the accuracy system performances. In the final section of the paper are presented some practical aspects of the proposed calibration method, and the balance between the off-line and the online required computational efforts from the Vision System. 1 MULTI LINE-SCAN CAMERA VISION SYSTEMS CHARACTERISTICS The class of the Artificial Vision Systems dedicated for analyzing objects located on a moving scenes (conveyor) presents some specific characteristics relative to the Artificial Vision Systems dedicated for static scenes. These characteristics are identified also on the Image Calibration Process (Borangiu, et al., 1994)., (Haralick and Shapiro, 1992). Figure 1 presents the model of the image obtained from a dual line-scan camera Vision System. For this class of the Artificial Vision Systems we could identify as relevant for the calibration process the following characteristics: The system is using line-scan cameras for the image acquisition. The system is a dual-camera. The obtained image has significant distortions on (and only on) the image sensors direction. There is an overlapped image area between the two cameras. The end of the acquisition line of the 1 camera is overlapping the beginning of the acquisition line of the 2 camera. This overlapping area is significant in dimension and is a constant parameter resulted during the artificial vision system installation process. There is a lengthwise conveyor distance between the acquisition lines of the two cameras. This distance is also a constant parameter and its value is fixed during the system installation process. 36 Hossu A. and Hossu D. (2008). CALIBRATION ASPECTS OF MULTIPLE LINE-SCAN VISION SYSTEM APPLICATION FOR PLANAR OBJECTS INSPECTION. In Proceedings of the Fifth International Conference on Informatics in Control, Automation and Robotics RA, pages 36-40 DOI: 10.5220/0001480300360040 Copyright c © SciTePress 2 THE PATTERN BASED CALIBRATION TOOL For the calibration process we adopted the method of using a Pattern based Calibration Tool. This Pattern based Calibration Tool represent a set of blobs with a priori known dimensions and locations for the real world (millimeters and not image pixels) (Croicu, et al., 1998). The outcome of using this type of calibration technique was to obtain the following: Estimation with the highest accuracy of the scene model parameters on the distortions direction Estimation of the size of the overlapped image area for both cameras The parallelism of the two acquisition lines if obtain during the installation process, using the support of the Calibration Tool The accuracy of installing the cameras in such a way to obtain the perpendicularity of the acquisition lines on the moving direction of the scene (of the conveyor). Obtain a high accuracy on the distance lengthwise the conveyor of the acquisition lines. The shape and the dimensions of the pattern adopted for the Calibration Tool force this characteristic. 3 CALIBRATION TOOL DESCRIPTION In Figure 2 it is presented the pattern adopted for the Calibration Tool used for the dual line-scan camera Vision System (the dimensions are presented in millimeters) (Croicu, et al., 1998)., (Hossu, et al., 1998). The characteristics of the adopted Pattern: The pattern contains dark blebs (marks) placed on a bright background (with a high level of light intensity for the image) The pattern is symmetrical on the vertical direction (lengthwise the conveyor). The two cameras have the acquisition lines parallel one each other but located on different position on the conveyor (due to the lighting system adopted – built from two fluorescent tubes used for obtaining the image from the reflection on the object surface). 1st Camera will have the acquisition line located on the top edge of the lower section of the pattern, and the 2nd Camera will locate its acquisition line on the bottom edge of the upper section of the pattern. The pattern is partially homogenous on the horizontal axis (the direction crosswise the conveyor, the direction of the distortions) The pattern contains a characteristic of a small difference (1 mm.) between the even and the odd marks. This will force the installation process to be very accurate in obtaining the parallelism of the acquisition lines of the cameras and also the perpendicularity on the conveyor direction. Figure 1: The image obtained from a dual line-scan camera Vision System. CALIBRATION ASPECTS OF MULTIPLE LINE-SCAN VISION SYSTEM APPLICATION FOR PLANAR OBJECTS INSPECTION","PeriodicalId":302311,"journal":{"name":"ICINCO-RA","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ICINCO-RA","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.5220/0001480300360040","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
The System Set-up Time it is one of the characteristics of an Industrial Vision System, besides the accuracy performances and response time. Minimizing the set-up time while keeping the performances in accuracy and in response time is one of the goals of any advanced Vision System. Starting from the purpose and the required performances of the proposed Industrial Vision System, in the paper is presented a calibration method developed for a multiple line-scan camera Vision System (in particular for a dual line-scan camera system). The calibration method presented is based on analyzing the image of a calibration tool exposed to the Vision System. There are presented the type of dimensional distortions identified from the experimental results. The second part of the paper presents the calibration method. The Industrial Vision System described in the paper is designed for silhouette inspection of planar objects located on a moving scene (transport conveyor), in a robotic handling application (it is a pure 2D Vision System, the volumetric characteristics of the analyzed objects being not relevant for the application). However the height of the object is varying in time (from one set of objects to another). Due to the fact the distance between the cameras and the objects is changing, the measuring results are affected. The proposed calibration method allows the Vision System to self adjust the calibration parameters for a known change in height of the objects, without affecting the accuracy system performances. In the final section of the paper are presented some practical aspects of the proposed calibration method, and the balance between the off-line and the online required computational efforts from the Vision System. 1 MULTI LINE-SCAN CAMERA VISION SYSTEMS CHARACTERISTICS The class of the Artificial Vision Systems dedicated for analyzing objects located on a moving scenes (conveyor) presents some specific characteristics relative to the Artificial Vision Systems dedicated for static scenes. These characteristics are identified also on the Image Calibration Process (Borangiu, et al., 1994)., (Haralick and Shapiro, 1992). Figure 1 presents the model of the image obtained from a dual line-scan camera Vision System. For this class of the Artificial Vision Systems we could identify as relevant for the calibration process the following characteristics: The system is using line-scan cameras for the image acquisition. The system is a dual-camera. The obtained image has significant distortions on (and only on) the image sensors direction. There is an overlapped image area between the two cameras. The end of the acquisition line of the 1 camera is overlapping the beginning of the acquisition line of the 2 camera. This overlapping area is significant in dimension and is a constant parameter resulted during the artificial vision system installation process. There is a lengthwise conveyor distance between the acquisition lines of the two cameras. This distance is also a constant parameter and its value is fixed during the system installation process. 36 Hossu A. and Hossu D. (2008). CALIBRATION ASPECTS OF MULTIPLE LINE-SCAN VISION SYSTEM APPLICATION FOR PLANAR OBJECTS INSPECTION. In Proceedings of the Fifth International Conference on Informatics in Control, Automation and Robotics RA, pages 36-40 DOI: 10.5220/0001480300360040 Copyright c © SciTePress 2 THE PATTERN BASED CALIBRATION TOOL For the calibration process we adopted the method of using a Pattern based Calibration Tool. This Pattern based Calibration Tool represent a set of blobs with a priori known dimensions and locations for the real world (millimeters and not image pixels) (Croicu, et al., 1998). The outcome of using this type of calibration technique was to obtain the following: Estimation with the highest accuracy of the scene model parameters on the distortions direction Estimation of the size of the overlapped image area for both cameras The parallelism of the two acquisition lines if obtain during the installation process, using the support of the Calibration Tool The accuracy of installing the cameras in such a way to obtain the perpendicularity of the acquisition lines on the moving direction of the scene (of the conveyor). Obtain a high accuracy on the distance lengthwise the conveyor of the acquisition lines. The shape and the dimensions of the pattern adopted for the Calibration Tool force this characteristic. 3 CALIBRATION TOOL DESCRIPTION In Figure 2 it is presented the pattern adopted for the Calibration Tool used for the dual line-scan camera Vision System (the dimensions are presented in millimeters) (Croicu, et al., 1998)., (Hossu, et al., 1998). The characteristics of the adopted Pattern: The pattern contains dark blebs (marks) placed on a bright background (with a high level of light intensity for the image) The pattern is symmetrical on the vertical direction (lengthwise the conveyor). The two cameras have the acquisition lines parallel one each other but located on different position on the conveyor (due to the lighting system adopted – built from two fluorescent tubes used for obtaining the image from the reflection on the object surface). 1st Camera will have the acquisition line located on the top edge of the lower section of the pattern, and the 2nd Camera will locate its acquisition line on the bottom edge of the upper section of the pattern. The pattern is partially homogenous on the horizontal axis (the direction crosswise the conveyor, the direction of the distortions) The pattern contains a characteristic of a small difference (1 mm.) between the even and the odd marks. This will force the installation process to be very accurate in obtaining the parallelism of the acquisition lines of the cameras and also the perpendicularity on the conveyor direction. Figure 1: The image obtained from a dual line-scan camera Vision System. CALIBRATION ASPECTS OF MULTIPLE LINE-SCAN VISION SYSTEM APPLICATION FOR PLANAR OBJECTS INSPECTION
多线扫描视觉系统在平面物体检测中的应用
除了精度性能和响应时间外,系统设置时间也是工业视觉系统的特征之一。最大限度地减少设置时间,同时保持性能的准确性和响应时间是任何先进的视觉系统的目标之一。本文从工业视觉系统的目的和性能要求出发,提出了一种多线扫描相机视觉系统(特别是双线扫描相机系统)的标定方法。提出了一种基于视觉系统的标定工具图像分析的标定方法。给出了从实验结果中识别出的尺寸畸变类型。第二部分给出了标定方法。本文中描述的工业视觉系统是为机器人搬运应用中位于移动场景(运输输送机)上的平面物体的轮廓检测而设计的(它是一个纯2D视觉系统,所分析物体的体积特性与应用无关)。然而,物体的高度随时间变化(从一组物体到另一组物体)。由于相机与被测物体之间的距离是变化的,会对测量结果产生影响。所提出的校准方法允许视觉系统根据已知的物体高度变化自调整校准参数,而不会影响系统的精度性能。在本文的最后一部分,介绍了所提出的校准方法的一些实际方面,以及视觉系统在离线和在线之间的平衡所需的计算量。1多线扫描相机视觉系统的特点:专用于分析位于移动场景(输送机)上的物体的人工视觉系统,与专用于静态场景的人工视觉系统相比,具有一些特定的特点。这些特征在图像校准过程中也得到了识别(Borangiu等,1994)。, (Haralick and Shapiro, 1992)。图1给出了双线扫描相机视觉系统获得的图像模型。对于这类人工视觉系统,我们可以识别出与校准过程相关的以下特征:系统使用线扫描相机进行图像采集。该系统是一个双摄像头。所获得的图像在(且仅在)图像传感器方向上具有显著的畸变。两台相机之间有一个重叠的图像区域。1摄像机采集线的末端与2摄像机采集线的起点重叠。该重叠区域在尺寸上意义重大,是人工视觉系统安装过程中产生的一个恒定参数。两台摄像机的采集线之间有一段纵向输送距离。该距离也是一个常数参数,其值在系统安装过程中是固定的。[36]王志强,王志强。(2008)。多线扫描视觉系统在平面物体检测中的应用。第五届国际控制,自动化和机器人信息学会议论文集,36-40页DOI: 10.5220/0001480300360040版权所有©sciitepress 2基于模式的校准工具对于校准过程,我们采用了使用基于模式的校准工具的方法。这个基于模式的校准工具表示一组具有先验已知现实世界(毫米而不是图像像素)的尺寸和位置的斑点(Croicu等人,1998年)。使用这种校正技术的结果是:用最高精度估计场景模型参数在变形方向上的估计两个摄像机重叠图像区域的大小在安装过程中,利用校准工具的支持,获得两条采集线的平行度安装摄像机的精度,这样就可以获得采集线在场景(输送机)移动方向上的垂直度。在采集线的纵向输送距离上获得高精度。校正工具所采用的图案的形状和尺寸迫使这种特性。图2给出了用于双线扫描相机视觉系统的校准工具采用的模式(尺寸以毫米表示)(Croicu, et al., 1998)。(Hossu, et al., 1998)。所采用图案的特点:图案包含放置在明亮背景上的深色气泡(标记)(图像具有高水平的光强度),图案在垂直方向上对称(纵向输送机)。 两台摄像机的采集线彼此平行,但位于传送带上的不同位置(由于采用的照明系统-由两根荧光灯管组成,用于从物体表面的反射中获取图像)。第一台相机的采集线位于图案下半部分的上边缘,第二台相机的采集线位于图案上半部分的下边缘。图案在水平轴上部分均匀(横向输送机方向,扭曲方向),图案包含偶数和奇数标记之间的小差异(1毫米)的特征。这将迫使安装过程非常准确地获得相机采集线的平行度以及输送机方向上的垂直度。图1:从双线扫描相机视觉系统获得的图像。多线扫描视觉系统在平面物体检测中的应用
本文章由计算机程序翻译,如有差异,请以英文原文为准。