{"title":"A vision system for observing and extracting facial action parameters","authors":"Irfan Essa, A. Pentland","doi":"10.1109/CVPR.1994.323813","DOIUrl":"https://doi.org/10.1109/CVPR.1994.323813","url":null,"abstract":"We describe a computer vision system for observing the \"action units\" of a face using video sequences as input. The visual observation (sensing) is achieved by using an optimal estimation optical flow method coupled with a geometric and a physical (muscle) model describing the facial structure. This modeling results in a time-varying spatial patterning of facial shape and a parametric representation of the independent muscle action groups, responsible for the observed facial motions. These muscle action patterns may then be used for analysis, interpretation, and synthesis. Thus, by interpreting facial motions within a physics-based optimal estimation framework, a new control model of facial movement is developed. The newly extracted action units (which we name \"FACS+\") are both physics and geometry-based, and extend the well-known FACS parameters for facial expressions by adding temporal information and non-local spatial patterning of facial motion.<<ETX>>","PeriodicalId":160667,"journal":{"name":"1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition","volume":"56 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123775299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The resolvability ellipsoid for visual servoing","authors":"B. Nelson, P. Khosla","doi":"10.1109/CVPR.1994.323907","DOIUrl":"https://doi.org/10.1109/CVPR.1994.323907","url":null,"abstract":"This paper introduces a sensor placement measure called resolvability. The measure provides a technique for estimating the relative ability of various visual sensors, including monocular systems, stereo pairs, multi-baseline stereo systems, and 3D rangefinders, to accurately control visually manipulated objects. The resolvability ellipsoid illustrates the directional nature of resolvability, and can be used to direct camera motion and adjust camera intrinsic parameters in real-time so that the servoing accuracy of the visual servoing system improves with camera-lens motion. The Jacobian mapping from task space to sensor space is derived for a monocular system, a stereo pair with parallel optical axes, and a stereo pair with perpendicular optical axes. Resolvability ellipsoids based on these mappings for various sensor configurations are presented. Visual servoing experiments demonstrate that resolvability can be used to direct camera-lens motion in order to increase the ability of a visually servoed manipulator to precisely servo objects.<<ETX>>","PeriodicalId":160667,"journal":{"name":"1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition","volume":"79 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121496949","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Depth from focus with one image","authors":"B. Jähne, P. Geißler","doi":"10.1109/CVPR.1994.323885","DOIUrl":"https://doi.org/10.1109/CVPR.1994.323885","url":null,"abstract":"A novel depth-from-focus technique is introduced that needs only a single image. It is based on a precise knowledge of the 3-D point spread function and requires objects of uniform brightness and simple shapes. Using adequate low-level image processing techniques, the true area of the object and the distance from the focal plane is obtained from parameters such as the apparent (blurred) area of the object and the mean brightness in this area. The technique has been applied to measure the size distribution of bubbles submerged by breaking waves. A depth criterion is used to define a virtual measuring volume that is roughly proportional to the size of the bubbles.<<ETX>>","PeriodicalId":160667,"journal":{"name":"1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128108800","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The outlier process: unifying line processes and robust statistics","authors":"Michael J. Black, Anand Rangarajan","doi":"10.1109/CVPR.1994.323805","DOIUrl":"https://doi.org/10.1109/CVPR.1994.323805","url":null,"abstract":"This paper unifies \"line-process\" approaches for regularization with discontinuities and robust estimation techniques. We generalize the notion of a \"line process\" to that of an analog \"outlier process\" and show that a problem formulated in terms of outlier processes can be viewed in terms of robust statistics. We also characterize a class of robust statistical problems for which an equivalent outlier-process formulation exists and give a straightforward method for converting a robust estimation problem into an outlier-process formulation. This outlier-processes approach provides a general framework which subsumes the traditional line-process approaches as well as a wide class of robust estimation problems. Examples in image reconstruction and optical flow are used to illustrate the approach.<<ETX>>","PeriodicalId":160667,"journal":{"name":"1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition","volume":"28 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131915483","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
W. Grimson, Tomas Lozano-Perez, S. J. White, W. Wells, R. Kikinis, G. Ettinger
{"title":"An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization","authors":"W. Grimson, Tomas Lozano-Perez, S. J. White, W. Wells, R. Kikinis, G. Ettinger","doi":"10.1109/CVPR.1994.323862","DOIUrl":"https://doi.org/10.1109/CVPR.1994.323862","url":null,"abstract":"There is a need for frameless guidance systems to help neurosurgeons to plan the exact location of a craniotomy, to define the margins of tumors and to precisely identify locations of neighboring critical structures. We have developed an automatic technique for registering clinical data, such as segmented MRI or CT reconstructions, with the patient's head on the operating table. A second method calibrates the position of a video camera relative to the patient. The combination allows a visual mix of live video of the patient with the segmented 3D MRI or CT model, enabling enhanced reality techniques for planning and guiding neurosurgical procedures, and to interactively view extracranial or intracranial structures non-intrusively. Extensions of the method include image guided biopsies, focused therapeutic procedures and clinical studies involving change detection over time sequences of images.<<ETX>>","PeriodicalId":160667,"journal":{"name":"1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition","volume":"45 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134158695","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Hierarchical Gabor filters for object detection in infrared images","authors":"R. Braithwaite, B. Bhanu","doi":"10.1109/CVPR.1994.323789","DOIUrl":"https://doi.org/10.1109/CVPR.1994.323789","url":null,"abstract":"This paper presents a new representation called \"hierarchical Gabor filters\" and associated novel local measures which are used to detect potential objects of interest in images. The \"first stage\" of the approach uses a wavelet set of wide-bandwidth separable Gabor filters to extract local measures from an image. The \"second stage\" makes certain spatial groupings explicit by creating small-bandwidth, non-separable Gabor filters that are tuned to elongated contours or periodic patterns. The non-separable filter responses are obtained from a weighted combination of the separable basis filters, which preserves the computational efficiency of separable filters while providing the distinctiveness required to discriminate objects from clutter. This technique is demonstrated on images obtained from a forward looking infrared (FLIR) sensor.<<ETX>>","PeriodicalId":160667,"journal":{"name":"1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132141573","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Closed-form attitude determination under spectrally varying illumination","authors":"M. S. Drew, L. Kontsevich","doi":"10.1109/CVPR.1994.323939","DOIUrl":"https://doi.org/10.1109/CVPR.1994.323939","url":null,"abstract":"When a Lambertian surface is illuminated by several chromatic lights the surface normals may be recovered from a single color image. A robust regression is used to find the ellipsoid in color space on which at least half the pixels lie. Then the matrix giving the linear relationship between the color and the surface normal, for non-outlier points is found as a root of the ellipsoid quadratic form. But this root is recovered only up to an arbitrary rotation. An integrability condition can be used to determine the correct rotation. The rotation of recovered surface normals is needed to align partial derivatives p and q with the camera plane and thus establish the object's attitude. Here a new smoothness condition approximating the integrability condition is introduced that allows one to solve for the rotation matrix in closed form.<<ETX>>","PeriodicalId":160667,"journal":{"name":"1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition","volume":"43 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132441507","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Visually-guided navigation by comparing two-dimensional edge images","authors":"D. Huttenlocher, M. Leventon, W. Rucklidge","doi":"10.1109/CVPR.1994.323910","DOIUrl":"https://doi.org/10.1109/CVPR.1994.323910","url":null,"abstract":"We present a method for navigating a robot from an initial position to a specified landmark in its visual field, using a sequence of monocular images. The location of the landmark with respect to the robot is determined using the change in size and position of the landmark in the image as the robot moves. The landmark location is estimated after the first three images are taken, and this estimate is refined after each motion. One of the novel aspects of this method is that it uses no explicit three-dimensional information.<<ETX>>","PeriodicalId":160667,"journal":{"name":"1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132746048","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Surface description of complex objects from multiple range images","authors":"Yang Chen, G. Medioni","doi":"10.1109/CVPR.1994.323823","DOIUrl":"https://doi.org/10.1109/CVPR.1994.323823","url":null,"abstract":"Addresses the problem of constructing a complete surface model of an object using a set of registered range images. Our approach is based on a dynamic balloon model represented by using a triangulated mesh. The vertices in the mesh are linked to their neighboring vertices by springs to simulate the surface tension and to keep the shell smooth. Unlike other dynamic models proposed by previous researchers, our balloon model is driven purely by an applied inflation force towards the object surface from inside the object, until the mesh elements reach the object surface. The system includes an adaptive local triangle mesh subdivision scheme that results in an evenly distributed mesh. Since our approach is not based on global minimization, it can handle complex, non-star-shaped objects without relying on a carefully selected initial state or encountering a local minimum problem. It also allows us to adapt the mesh surface to changes in local surface shapes and to handle any holes that are present in the input data by adjusting certain system parameters adaptively and locally. We present results on some complex, non-star-shaped objects from real range images.<<ETX>>","PeriodicalId":160667,"journal":{"name":"1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125244688","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Deformable boundary finding influenced by region homogeneity","authors":"A. Chakraborty, L. Staib, J. Duncan","doi":"10.1109/CVPR.1994.323790","DOIUrl":"https://doi.org/10.1109/CVPR.1994.323790","url":null,"abstract":"Accurately segmenting and quantifying structures is a key issue in biomedical image analysis. The two conventional methods of image segmentation, region-based segmentation and boundary finding, often suffer from a variety of limitations. We propose a method which endeavors to integrate the two approaches in an effort to form a unified approach that is robust to noise and poor initialization. Our approach uses Green's theorem to derive the boundary of a homogeneous region-classified area in the image and integrates this with a grey-level-gradient-based boundary finder. This combines the perceptual notions of edge/shape information with gray level homogeneity.<<ETX>>","PeriodicalId":160667,"journal":{"name":"1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131203711","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}