{"title":"Extracting stochastic machines from recurrent neural networks trained on complex symbolic sequences","authors":"P. Tiňo, V. Vojtek","doi":"10.1109/KES.1997.619435","DOIUrl":"https://doi.org/10.1109/KES.1997.619435","url":null,"abstract":"We train a recurrent neural network on a single, long, complex symbolic sequence with positive entropy. The training process is monitored through information theory based performance measures. We show that although the sequence is unpredictable, the network is able to code the sequence's topological and statistical structure in recurrent neuron activation scenarios. Such scenarios can be compactly represented through stochastic machines extracted from the trained network. Generative models, i.e. trained recurrent networks and extracted stochastic machines, are compared using entropy spectra of generated sequences. In addition, entropy spectra computed directly from the machines capture generalization abilities of extracted machines and are related to a machines' long term behavior.","PeriodicalId":166931,"journal":{"name":"Proceedings of 1st International Conference on Conventional and Knowledge Based Intelligent Electronic Systems. KES '97","volume":"164 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1997-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123104887","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Rule extraction from trained artificial neural network with functional dependency preprocessing","authors":"S. Geva, M. T. Wong, M. Orlowski","doi":"10.1109/KES.1997.619437","DOIUrl":"https://doi.org/10.1109/KES.1997.619437","url":null,"abstract":"The paper describes a technique to extract symbolic rules from a trained artificial neural network with functional dependency preprocessing. RULEX (R. Andrews and S. Geva, 1994; 1995), classified as a decompositional technique of rule extraction from trained neural network in a recent survey by R. Andrews et al. (1995), is used to extract symbolic rules from data that have been preprocessed by identification of functional dependency. The identification of functional dependency offers several advantages. It can lead to significant reductions in the computational load, to reduction in the number and complexity of derived rules and to the discovery of alternative solutions that would otherwise be ignored by some methods due to implicit or explicit procedural bias. Benchmark datasets from the UCI repository of machine learning databases are used in the testing. Experimental results indicate that by including functional dependency preprocessing performance of RULEX can be improved. Good rule quality is obtained by applying RULEX with functional dependency preprocessing when compared to symbolic rule extraction technique C4.5.","PeriodicalId":166931,"journal":{"name":"Proceedings of 1st International Conference on Conventional and Knowledge Based Intelligent Electronic Systems. KES '97","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1997-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124488477","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Generation of fuzzy k-partitions based on tolerance relations and maximal consistency","authors":"T. Murai, A. Kitada, Yoshiharu Sato","doi":"10.1109/KES.1997.619412","DOIUrl":"https://doi.org/10.1109/KES.1997.619412","url":null,"abstract":"A method of generating fuzzy k-partitions is proposed based on tolerance relations and maximal consistency. In particular, emphasis is put on the point that general cases of more than two clusters can be reduced to special cases of two clusters in both crisp and fuzzy partitions. Then a way of generating fuzzy subsets can be shown to be applied to the generation of fuzzy k-partitions.","PeriodicalId":166931,"journal":{"name":"Proceedings of 1st International Conference on Conventional and Knowledge Based Intelligent Electronic Systems. KES '97","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1997-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124548534","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
E. Lemoine, L. Maillet-Contoz, D. Merceron, J. Sallantin
{"title":"High speed intelligent machine through programmable hardware: application to genomic systems","authors":"E. Lemoine, L. Maillet-Contoz, D. Merceron, J. Sallantin","doi":"10.1109/KES.1997.619446","DOIUrl":"https://doi.org/10.1109/KES.1997.619446","url":null,"abstract":"The paper proposes a new technology for intelligent machines based on the concept of programmable hardware. To build an intelligent system, the designer has to adapt it to the problem. First we show that programmable hardware is an intermediate step for building configurations, in order to choose the best architecture. In this case, the tasks are performed in a time period that respects human cognitive capacities. Next is detailed a multi level model composed of the cognitive, software and hardware levels. An experimental platform has been built, based on programmable hardware, and used in a \"Grand Challenge\" problem: knowledge discovery in genetic sequence databases, to compare the relative efficiencies of programmable hardware and classical Von Neumann based architecture. Programmable hardware is shown to have a significantly faster response time, which is essential for modern day intelligent machine user interaction.","PeriodicalId":166931,"journal":{"name":"Proceedings of 1st International Conference on Conventional and Knowledge Based Intelligent Electronic Systems. KES '97","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1997-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133941337","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An automated matching technique for fingerprint identification","authors":"D. Mital, E. Teoh","doi":"10.1109/KES.1997.616876","DOIUrl":"https://doi.org/10.1109/KES.1997.616876","url":null,"abstract":"The purpose of this paper is to demonstrate how a structural matching approach can be used to perform effective rotational invariant fingerprint identification. In this approach, each of the extracted features is correlated with five of its nearest neighbouring features to form a local feature group for a first-stage matching. After that, the feature with the highest match is used as a central feature whereby all the other features are correlated to form a global feature group for a second-stage matching. The correlation between the features is in terms of distance and relative angle. This approach actually makes the matching method rotational invariant. A substantial amount of testing was carried out and it shows that this matching technique is capable of matching the four basic fingerprint patterns with an average matching time of 4 seconds on a 66 Mhz, 486 DX personal computer.","PeriodicalId":166931,"journal":{"name":"Proceedings of 1st International Conference on Conventional and Knowledge Based Intelligent Electronic Systems. KES '97","volume":"312 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1997-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132470294","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A fuzzy controller using floating membership functions for the braking of a long haul train","authors":"G. Horwood, D. Kearney, Z. Nedic","doi":"10.1109/KES.1997.619423","DOIUrl":"https://doi.org/10.1109/KES.1997.619423","url":null,"abstract":"Automatic train control in railway systems is gaining increasing importance with the continuous need to reduce excess fuel consumption and unnecessary time delays while still maintaining a safe and reliable rail service. The paper describes a fuzzy logic controller which forces a train to track a safe braking curve (ATP curve), thus ensuring the train avoids time consuming conservative braking, without compromising the train safety.","PeriodicalId":166931,"journal":{"name":"Proceedings of 1st International Conference on Conventional and Knowledge Based Intelligent Electronic Systems. KES '97","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1997-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129130083","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Industrial robotic systems with fuzzy logic controller and neural network","authors":"Sang-Bae Lee","doi":"10.1109/KES.1997.619443","DOIUrl":"https://doi.org/10.1109/KES.1997.619443","url":null,"abstract":"Generally, when we control the robot, we should calculate exact inverse kinematics. However, inverse kinematics calculation is complex and it takes much time for the manipulator to control in real time. Therefore, the calculation of inverse kinematics can result in a significant control delay in real time. We present a method in which inverse kinematics can be calculated through fuzzy logic mapping, based on an exact solution through fuzzy reasoning instead of inverse kinematics calculation. Also, the result provides sufficient precision and transient tracking error can be controlled based on a fuzzy adaptive scheme. We also demonstrate that neural networks can be used effectively for the control of a nonlinear dynamic system with uncertain or unknown dynamics models and applied to the control robot. The advantage of using the neural approach over the conventional inverse kinematics algorithms is that neural networks can avoid time consuming calculations. We represent a good control efficiency through simulation of a 2-DOF manipulator by fuzzy logic controller, and demonstrate the effectiveness of the proposed learning scheme using feedforward neural networks, too.","PeriodicalId":166931,"journal":{"name":"Proceedings of 1st International Conference on Conventional and Knowledge Based Intelligent Electronic Systems. KES '97","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1997-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123700847","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Fuzzy logic based reinforcement learning of admittance control for automated robotic manufacturing","authors":"S. Prabhu, D. Garg","doi":"10.1109/KES.1997.619426","DOIUrl":"https://doi.org/10.1109/KES.1997.619426","url":null,"abstract":"An approach to admittance control using fuzzy logic based reinforcement learning is proposed for the robotic automation of typical manufacturing operations. Use of fuzzy logic enables the knowledge of the manufacturing process operator to be incorporated into the controller design, which is then further refined using reinforcement learning techniques. Automated robotic deburring offers an attractive alternative to manual deburring in terms of reduced costs and improved quality of the finished parts, and hence it is used as an example of a typical manufacturing task. Simulation results are presented which demonstrate the effectiveness of the proposed controller in controlling the automated robotic deburring task.","PeriodicalId":166931,"journal":{"name":"Proceedings of 1st International Conference on Conventional and Knowledge Based Intelligent Electronic Systems. KES '97","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1997-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121896441","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A neuro-sliding control approach for a class of nonlinear systems","authors":"Hongliu Du, S. Nair","doi":"10.1109/KES.1997.619406","DOIUrl":"https://doi.org/10.1109/KES.1997.619406","url":null,"abstract":"This paper proposes a learning method for the compensation of uncertainties, for a class of nonlinear systems. A sliding model control strategy is used for the robust control design after a prior stable learning phase. Gaussian networks are used to identify the uncertainties during this learning phase. Learning and control bounds are guaranteed by properly constructing the training structure. The proposed technique has been validated using a hardware example case of an electromechanical system. Experiments have shown that the inclusion of the proposed learning technique in the robust control design results in improved system performance.","PeriodicalId":166931,"journal":{"name":"Proceedings of 1st International Conference on Conventional and Knowledge Based Intelligent Electronic Systems. KES '97","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1997-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117094973","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Fuzzy hierarchical car-model pattern recognition system using fixation feedback","authors":"Y. Arai, G. Sekiguchi, K. Hirota","doi":"10.1109/KES.1997.616879","DOIUrl":"https://doi.org/10.1109/KES.1997.616879","url":null,"abstract":"The \"fuzzy hierarchical pattern recognition using fixation feedback\" method is proposed and it is applied to recognize kinds, i.e., groups of trade names, of cars. In the experiments, image data of fourteen kinds of minicars taken from several directions are used. By comparing the results of the \"non fixation feedback\" method, it has been confirmed that the proposed method could increase efficiency without decreasing accuracy rates of recognition.","PeriodicalId":166931,"journal":{"name":"Proceedings of 1st International Conference on Conventional and Knowledge Based Intelligent Electronic Systems. KES '97","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1997-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126382803","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}