{"title":"Audio-visual sensor fusion system for intelligent sound sensing","authors":"Kota Takahashi, Hiro Yamasaki","doi":"10.1109/MFI.1994.398413","DOIUrl":"https://doi.org/10.1109/MFI.1994.398413","url":null,"abstract":"An intelligent sensing system is proposed, which extracts a target sound signal autonomously from multi-microphone signals corrupted by interference ambient noise. Although many types of intelligent signal receivers with multiple sensors have been proposed recently, the use of audio-visual sensor fusion techniques is a special feature of the system described here. This sensor fusion system can be divided into two subsystems: an audio subsystem and a visual subsystem. The audio subsystem extracts a target signal with a digital filter composed of tapped delay lines and adjustable weights. These weights are renewed by a special adaptive algorithm, which is called the \"cue signal method\". For adaptation, the cue signal method needs only a narrow bandwidth signal which correlates with the power level of the target signal. This narrow bandwidth signal is called the \"cue signal\". The role of the visual subsystem is, therefore, to generate a cue signal. The authors have already proposed methods for generating a cue signal using video images. Sensor fusion of audio and visual information was accomplished by simple methods. In this paper, two new sensor fusion techniques are proposed. One is a method for generating a cue signal using not only video images but also microphone signals, and the other is a method for generating a cue signal using microphone signals, video images and internal knowledge. Both are a hierarchical sensor fusion of audio and visual information. In order to evaluate and demonstrate the sensor fusion algorithm, a real-time processing system including seventy DSPs was constructed. The architecture of this system is also described.<<ETX>>","PeriodicalId":133630,"journal":{"name":"Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126415102","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An application of data fusion to landcover classification of remote sensed imagery: a neural network approach","authors":"A. Chiuderi, S. Fini, V. Cappellini","doi":"10.1109/MFI.1994.398379","DOIUrl":"https://doi.org/10.1109/MFI.1994.398379","url":null,"abstract":"This paper focuses on the possibilities offered by neural networks applied to multisensor image data processing. The great number of existing and planned instruments for Earth observation (satellites, sensors) highlights the need of specific techniques for processing, and, in particular, for merging, the large amount of data that will be available in future years. Moreover emphasis is given to the importance of fusing data acquired by sensors operating in different regions of the electromagnetic spectrum. Neural networks (NNs) are employed to perform fusion of TM data with SAR data in order to obtain a landcover classification of an agricultural area in the surroundings of Florence (Italy). Two different architectures of NN are presented and employed, the counterpropagation network and the Kohonen map; the results obtained in both cases are reported and discussed.<<ETX>>","PeriodicalId":133630,"journal":{"name":"Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134009750","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Filter design methods of multiple model system","authors":"Yan Dong, Zhang Hongyue","doi":"10.1109/MFI.1994.398480","DOIUrl":"https://doi.org/10.1109/MFI.1994.398480","url":null,"abstract":"In this paper, two filter design methods of multiple model system are proposed. One is the identification of ARMA model, and the other is /spl chi//sup 2/ test. The identification of ARMA model means the steady state gain matrix of Kalman filter can be identified online via recursive extended least squares method, by comparison of steady-state Kalman filter gain with the Kalman filter gain obtained from possible model, the true gain matrix can be determined by the principle of minimal error norm. The /spl chi//sup 2/ test method means the true model can be determined by detection of the whiteness of innovations process. The two methods are applied to homing guidance system. The simulation results prove that both methods are effective.<<ETX>>","PeriodicalId":133630,"journal":{"name":"Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems","volume":"74 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134046365","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Improved tracking of maneuvering targets: the use of turn-rate distributions for acceleration modeling","authors":"J. P. Helferty","doi":"10.1109/MFI.1994.398410","DOIUrl":"https://doi.org/10.1109/MFI.1994.398410","url":null,"abstract":"Tactically maneuvering targets are difficult to track since acceleration cannot be observed directly and the accelerations are induced by human control or an autonomous guidance system; therefore they are not subject to deterministic models. A common tracking system is the two-state Kalman Filter with a Singer maneuver model where the second order statistics of acceleration is the same as a first order Markov process. The Singer model assumes a uniform probability distribution on the target's acceleration which is independent of the x and y direction. In practice, it is expected that targets have constant forward speed and an acceleration vector normal to the velocity vector, a condition not present in the Singer model. This paper extends the work of Singer by presenting a maneuver model which assumes constant forward speed and a probability distribution on the targets turn-rate. Details of the model are presented along with sample simulation results.<<ETX>>","PeriodicalId":133630,"journal":{"name":"Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems","volume":"72 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127865529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Accurate navigation via differential GPS and vehicle local sensors","authors":"K. Kobayashi, F. Munekata, K. Watanabe","doi":"10.1109/MFI.1994.398453","DOIUrl":"https://doi.org/10.1109/MFI.1994.398453","url":null,"abstract":"Accurate positioning of vehicles yields accurate navigation which helps traffic to move more smoothly. The differential global positioning system (DGPS) is one of the most practical navigation tools in a limited area. This paper describes how to combine and/or fuse the DGPS and vehicle sensors to improve position accuracy. The theoretical background for sensor fusion is the use of the Kalman filter. As an example of the proposed sensor fusion, we combine the optical gyro, wheel speed measurements that may include high frequency noises and the DGPS signal that frequently suffers from interference due to various circumstances. Validity of the method was examined by a real automobile in real circumstances.<<ETX>>","PeriodicalId":133630,"journal":{"name":"Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems","volume":"146 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124683574","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Environment recognition for a mobile robot using double ultrasonic sensors and a CCD camera","authors":"K. Song, Wen-Hui Tang","doi":"10.1109/MFI.1994.398384","DOIUrl":"https://doi.org/10.1109/MFI.1994.398384","url":null,"abstract":"To move efficiently in an unknown or uncertain environment, a mobile robot must take observation from various sensors to provide information for path planning and execution. A sufficient representation of the external world would also be very useful for self-localization. One of the merits of applying multiple sensors to a mobile robot is the enhancement of environment recognition. In this paper, sensory information combined from double ultrasonic sensors and a CCD camera is provided for this purpose. The authors used ultrasonic sensors for distance measurement and a vision system for object boundaries detection. The authors developed an algorithm to eliminate errors due to the beam opening angle of ultrasonic sensors based on a dual transducer design. An extended discrete Kalman filter was used to fuse raw sensory data and reduce the influence of specular reflection of ultrasonic type transducers. Therefore a more reliable representation was obtained for environment recognition. Computer simulation as well as practical experimental results show that this sensory system can provide useful and robust environment recognition for intelligent robotics.<<ETX>>","PeriodicalId":133630,"journal":{"name":"Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems","volume":"59 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132184327","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Data fusion using large multi-agent networks: an analysis of network structure and performance","authors":"A. Knoll, J. Meinkoehn","doi":"10.1109/MFI.1994.398466","DOIUrl":"https://doi.org/10.1109/MFI.1994.398466","url":null,"abstract":"Concerns the multi-agent paradigm for structuring the data fusion in large networks of information sources. The general goal is the maximisation of the quality of the result at minimum cost. To this end agents compete for scarce resources or they work in parallel. Both the general granularity of the agent society and the competence assigned to each individual agent determine the information flow. The multitude of parameters involved makes it difficult to optimally adapt the network structure to a given class of sensing tasks. We outline possible network structures and present an approach for analysing a number of important parameters characterising the network. The abstraction enables comparison of different structures. The methods for the analysis may be readily refined to evaluate a specific problem. A model of lateral coordination control in proposed as a result. It is based on the notion of negotiated cooperation between pairs of autonomous sensor agents. The cooperation phase is preceded by a bidding scheme to establish logical communication links. The cooperation is modelled on human social behaviour.<<ETX>>","PeriodicalId":133630,"journal":{"name":"Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122326164","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Determining geodesics of a discrete surface","authors":"R. Zantout, Y.F. Zheng","doi":"10.1109/MFI.1994.398405","DOIUrl":"https://doi.org/10.1109/MFI.1994.398405","url":null,"abstract":"Geodesics are surface curves that possess special properties. In many cases a geodesic on a surface can be considered as the shortest path between its endpoints. A geodesic depends only on the intrinsic properties of a surface. The above properties prompted many uses of geodesics in many different fields. Until now almost all of the methods to calculate geodesics on a surface relied on the fact that somehow an analytical representation of the surface exists. Due to the increase in the use of digital computers and range finding systems, more and more objects are being described as a set of digitized points. In this paper we describe methods that would produce approximations to the geodesics of a surface based solely on the digitized points.<<ETX>>","PeriodicalId":133630,"journal":{"name":"Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126871821","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"New hyper-distributed hyper-parallel AI approach based on chaotic bifurcations and synchronizations","authors":"D. Shuai, Y. Watanabe","doi":"10.1109/MFI.1994.398425","DOIUrl":"https://doi.org/10.1109/MFI.1994.398425","url":null,"abstract":"For problem solving in the artificial intelligence, this paper presents a new hyper-distributed hyper-parallel approach based on the bifurcations and synchronizations of the hierarchical distributed chaotic dynamic systems. By using Chua's circuits arrays, the realization of the hyper-distributed hyper-parallel heuristic algorithms for real-time search of any implicit AND/OR graph is discussed. The approach not only combines the advantages of both the traditional sequential symbolic logic and the conventional neural network approaches, but also overcomes their drawbacks in many respects.<<ETX>>","PeriodicalId":133630,"journal":{"name":"Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133769539","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Adaptive sensor integration for mobile robot navigation","authors":"Cheng-Chih Lin, R. Lal Tummala","doi":"10.1109/MFI.1994.398469","DOIUrl":"https://doi.org/10.1109/MFI.1994.398469","url":null,"abstract":"Adaptive sensor integration (ASI) to navigate mobile robot in partially known and changing environments is described in this paper. The relationship between the \"clutterness\" of the robot's environment at any given time, speed of the robot, and the configuration of sensors on board of the robot is explored. Quantitative relationships are obtained to maximize the safe speed of travel from the initial position to the goal position. Experimental results are provided to illustrate this method.<<ETX>>","PeriodicalId":133630,"journal":{"name":"Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123290055","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}