L. Cheng, Z. Hou, M. Tan, Xiuqing Wang, Zeng-Shun Zhao, Sanqing Hu
{"title":"A Recurrent Neural Network for Non-smooth Nonlinear Programming Problems","authors":"L. Cheng, Z. Hou, M. Tan, Xiuqing Wang, Zeng-Shun Zhao, Sanqing Hu","doi":"10.1109/IJCNN.2007.4371024","DOIUrl":"https://doi.org/10.1109/IJCNN.2007.4371024","url":null,"abstract":"A recurrent neural network is proposed for solving non-smooth nonlinear programming problems, which can be regarded as a generalization of the smooth nonlinear programming neural network used in (X.B. Gao, 2004). Based on the non-smooth analysis and the theory of differential inclusions, the proposed neural network is demonstrated to be globally convergent to the exact optimal solution of the original optimization problem. Compared with the existing neural networks, the proposed approach takes both equality and inequality constraints into account, and no penalty parameters have to be estimated beforehand. Therefore, it can solve a larger class of non-smooth programming problems. Finally, several illustrative examples are given to show the effectiveness of the proposed neural network.","PeriodicalId":350091,"journal":{"name":"2007 International Joint Conference on Neural Networks","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124526213","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Feature Extraction of Waveform Signals for Uncertain Dynamic Processes Using Neural Networks","authors":"Yaw-Jen Chang, C. Chang, Jui-Ju Tsai","doi":"10.1109/IJCNN.2007.4371338","DOIUrl":"https://doi.org/10.1109/IJCNN.2007.4371338","url":null,"abstract":"This paper presents a novel and simple feature extraction approach for drawing out the signal characteristics of uncertain dynamic processes by the feature neurons. Kohonen network is used to construct the feature neurons to represent its respective local features of a waveform signal. For a class of waveform signals, groups of feature neurons can be obtained. Incorporating with the ellipsoidal calculus, this approach can extract the process drifts and abnormal deviations in the process characteristics by limit checking. Moreover, it is robust even for the process with different process time durations. For the system with oscillatory transient response, this approach can be iteratively used to augment the amount of feature neurons to analyze the characteristics of any portion of the signal of interest in detail. With the merit of unsophisticatedness, this approach can be implemented for the determination of preventive maintenance and fault detection in the semiconductor manufacturing.","PeriodicalId":350091,"journal":{"name":"2007 International Joint Conference on Neural Networks","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124566587","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Neural Network Approach to Automatic Construction of Adaptive Meshes on Multiply-connected Domains","authors":"O. Nechaeva","doi":"10.1109/IJCNN.2007.4371250","DOIUrl":"https://doi.org/10.1109/IJCNN.2007.4371250","url":null,"abstract":"The neural network approach to automatic construction of adaptive meshes, which we have developed for simply-connected domains, is here extended to the case of multiply-connected domains, i.e. those with holes. This approach is based on Kohonen's self-organizing maps (SOM) and refers to a class of methods in which an adaptive mesh is a result of transformation of a fixed uniform mesh. Within the approach, a composite algorithm has been proposed in which the SOM algorithm is applied alternatively to boundary and interior mesh nodes. In the case of multiply-connected domains, this algorithm is applied to specify automatically the holes in a fixed mesh. Also, a modified composite algorithm is proposed that provides the consistency of SOM algorithms alternatively applied to both the outer and inner borders and to the interior of the domain. The mesh smoothing algorithm is proposed for multiply-connected domains. The quality of the resulting meshes is admissible according to generally accepted quality criteria.","PeriodicalId":350091,"journal":{"name":"2007 International Joint Conference on Neural Networks","volume":"128 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114539268","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Theories of Neural Networks Leading to Unsupervised Learning","authors":"H. Szu","doi":"10.1109/IJCNN.2007.4371458","DOIUrl":"https://doi.org/10.1109/IJCNN.2007.4371458","url":null,"abstract":"In this paper, we derive an exact single-pixel BSS solution for two components. Furthermore, we prove the solution for n components to be unique and stable by means of the augmented Lagrange or Karush, Kuhn and Tucker methodology [S 07]. Our constant-temperature free energy can estimate the neuronal population of brain's grey matter which is responsible for the consciousness activities identified by Crick & Koch as the Claustrum accomplishing binding among firing rates (similar to C-node tuning in the beginning of an orchestra performance). Furthermore, the retinal neuronal response Mexican hat functions could be explained by finite resource sharing for replenishment.","PeriodicalId":350091,"journal":{"name":"2007 International Joint Conference on Neural Networks","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117037871","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Real Time Credit Card Fraud Detection using Computational Intelligence","authors":"Jon T. S. Quah, M. Sriganesh","doi":"10.1109/IJCNN.2007.4371071","DOIUrl":"https://doi.org/10.1109/IJCNN.2007.4371071","url":null,"abstract":"Online banking and e-commerce have been experiencing rapid growth over the past few years and show tremendous promise of growth even in the future. This has made it easier for fraudsters to indulge in new and abstruse ways of committing credit card fraud over the Internet. This paper focuses on real-time fraud detection and presents a new and innovative approach in understanding spending patterns to decipher potential fraud cases. It makes use of Self Organization Map to decipher, filter and analyze customer behavior for detection of fraud.","PeriodicalId":350091,"journal":{"name":"2007 International Joint Conference on Neural Networks","volume":"116 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117150717","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Optimal Control of a Photovoltaic Solar Energy System with Adaptive Critics","authors":"R. L. Welch, G. Venayagamoorthy","doi":"10.1109/IJCNN.2007.4371092","DOIUrl":"https://doi.org/10.1109/IJCNN.2007.4371092","url":null,"abstract":"This paper presents an optimal energy control scheme for a grid independent photovoltaic (PV) solar system consisting of a PV array, battery energy storage, and time varying loads (a small critical load and a larger variable non-critical load). The optimal controller design is based on a class of adaptive critic designs (ACDs) called the action dependant heuristic dynamic programming (ADHDP). The ADHDP class of ACDs uses two neural networks, an \"action\" network (which actually dispenses the control signals) and a \"critic\" network (which critics the action network performance). An optimal control policy is evolved by the action network over a period of time using the feedback signals provided by the critic network. The objectives of the optimal controller in order of decreasing importance is to first fully dispatch the required energy to the critical loads at all times; secondly to dispatch energy to the battery whenever necessary so as to be able to dispatch energy to the critical loads in any absence of energy from the PV array; and lastly to dispatch energy to the non-critical loads while not interfering with the first two objectives. Results on three different US cities show that the ADHDP based optimal control scheme outperforms the conventional PV-priority control scheme in maintaining the stated objectives almost all the time.","PeriodicalId":350091,"journal":{"name":"2007 International Joint Conference on Neural Networks","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116404213","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Prediction of Long-range Contacts from Sequence Profile","authors":"Peng Chen, Bing Wang, H. Wong, De-shuang Huang","doi":"10.1109/IJCNN.2007.4371084","DOIUrl":"https://doi.org/10.1109/IJCNN.2007.4371084","url":null,"abstract":"Theoretic study in this paper shows that we can obtain exact long-range contacts by adopting one classifier if the centers of sequence profiles of residue pairs for long-range contacts and non-long-range contacts are known. The adopted classifier, referred to as multiple conditional probability mass function classifier (MCPMFC), can find an optimized transformation of the variables for each of the classes and therefore resulting in K separate classifiers. As a result, about 44.48% long-range contacts are around at the sequence profile (SP) centre for long-range contacts and about 20.9% long-range contacts are correctly predicted when considering the top L/5 (L is the protein sequence length) predicted contacts and the residue pair with 24 apart. The highest cluster result gives us a clue that SP center should be a sound pathway to investigate contact map in protein structures.","PeriodicalId":350091,"journal":{"name":"2007 International Joint Conference on Neural Networks","volume":"193 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123536674","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"FPGA Implementation of Pulse Density Hopfield Neural Network","authors":"Y. Maeda, Yoshinori Fukuda","doi":"10.1109/IJCNN.2007.4371042","DOIUrl":"https://doi.org/10.1109/IJCNN.2007.4371042","url":null,"abstract":"In this paper, we present a FPGA Hopfield Neural Network system with learning capability using the simultaneous perturbation learning rule. In the neural network, outputs and internal values are represented by pulse train. That is, analog Hopfield Neural Network with pulse frequency representation is considered. The pulse density representation and the simultaneous perturbation enable the system with learning capability to easily implement as a hardware system. Details of the design are described. Some results are also shown to confirm a viability of the system configuration and the learning capability.","PeriodicalId":350091,"journal":{"name":"2007 International Joint Conference on Neural Networks","volume":"48 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123654675","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Zenglin Xu, Jianke Zhu, Michael R. Lyu, Irwin King
{"title":"Maximum Margin based Semi-supervised Spectral Kernel Learning","authors":"Zenglin Xu, Jianke Zhu, Michael R. Lyu, Irwin King","doi":"10.1109/IJCNN.2007.4370993","DOIUrl":"https://doi.org/10.1109/IJCNN.2007.4370993","url":null,"abstract":"Semi-supervised kernel learning is attracting increasing research interests recently. It works by learning an embedding of data from the input space to a Hilbert space using both labeled data and unlabeled data, and then searching for relations among the embedded data points. One of the most well-known semi-supervised kernel learning approaches is the spectral kernel learning methodology which usually tunes the spectral empirically or through optimizing some generalized performance measures. However, the kernel designing process does not involve the bias of a kernel-based learning algorithm, the deduced kernel matrix cannot necessarily facilitate a specific learning algorithm. To supplement the spectral kernel learning methods, this paper proposes a novel approach, which not only learns a kernel matrix by maximizing another generalized performance measure, the margin between two classes of data, but also leads directly to a convex optimization method for learning the margin parameters in support vector machines. Moreover, experimental results demonstrate that our proposed spectral kernel learning method achieves promising results against other spectral kernel learning methods.","PeriodicalId":350091,"journal":{"name":"2007 International Joint Conference on Neural Networks","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122050369","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
B. Schrauwen, Michiel D'Haene, D. Verstraeten, J. V. Campenhout
{"title":"Compact hardware for real-time speech recognition using a Liquid State Machine","authors":"B. Schrauwen, Michiel D'Haene, D. Verstraeten, J. V. Campenhout","doi":"10.1109/IJCNN.2007.4371111","DOIUrl":"https://doi.org/10.1109/IJCNN.2007.4371111","url":null,"abstract":"Hardware implementations of Spiking Neural Networks are numerous because they are well suited for implementation in digital and analog hardware, and outperform classic neural networks. This work presents an application driven digital hardware exploration where we implement realtime, isolated digit speech recognition using a Liquid State Machine (a recurrent neural network of spiking neurons where only the output layer is trained). First we test two existing hardware architectures, but they appear to be too fast and thus area consuming for this application. Then we present a scalable, serialised architecture that allows a very compact implementation of spiking neural networks that is still fast enough for real-time processing. This work shows that there is actually a large hardware design space of Spiking Neural Network hardware that can be explored. Existing architectures only spanned part of it.","PeriodicalId":350091,"journal":{"name":"2007 International Joint Conference on Neural Networks","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2007-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123942990","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}