{"title":"Learning desirable actions in two-player two-action games","authors":"K. Moriyama","doi":"10.1109/ISADS.2005.1452119","DOIUrl":"https://doi.org/10.1109/ISADS.2005.1452119","url":null,"abstract":"Reinforcement learning is widely used to let an autonomous agent learn actions in an environment, and recently, it is used in a multi-agent context in which several agents share an environment. Most of multi-agent reinforcement learning algorithms aim to converge to a Nash equilibrium of game theory, but it does not necessarily mean a desirable result On the other hand, there are several methods aiming to depart from unfavorable Nash equilibria, but they use other agents' information for learning and the condition whether or not they work has not yet been analyzed and discussed in detail. In this paper, we first see the sufficient conditions of symmetric two-player two-action games that show whether or not reinforcement learning agents learn to bring the desirable result After that, we construct a new method that does not need any other agents' information for learning.","PeriodicalId":120577,"journal":{"name":"Proceedings Autonomous Decentralized Systems, 2005. ISADS 2005.","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2005-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127847117","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A reliable multicast protocol for mailbox-based mobile agent communications","authors":"Jiannong Cao, W. Xu, A. Chan, Jing Li","doi":"10.1109/ISADS.2005.1452023","DOIUrl":"https://doi.org/10.1109/ISADS.2005.1452023","url":null,"abstract":"In this paper, we propose a reliable multicast protocol for mobile agent communications, which is a multicast extension to our previous adaptive and reliable protocol (ARP). ARP uses the mailbox-based scheme, where each mobile agent is associated with a mailbox for message delivery. The mailbox can be decoupled from the mobile agent and migrate with lower mobility. By adjusting the system parameters such as synchronization between mobile entities and mailbox migration frequency, ARP achieves adaptability and ensures reliability. In extending ARP to group communications, we group mailboxes residing on a host and belonging to the same multicast group into a cluster, and let all mailbox clusters form a logical ring. We present a token-based algorithm and a mailbox migration algorithm to achieve atomicity and total ordering of multicast messages. Also, we prove the correctness of the protocol and discuss the performance evaluation results obtained from simulations.","PeriodicalId":120577,"journal":{"name":"Proceedings Autonomous Decentralized Systems, 2005. ISADS 2005.","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2005-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123200249","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Applying synthesized immune networks hypothesis to mobile robots","authors":"Q. Duan, R. X. Wang, H. S. Feng, L. G. Wang","doi":"10.1109/ISADS.2005.1452022","DOIUrl":"https://doi.org/10.1109/ISADS.2005.1452022","url":null,"abstract":"Based on the analogies between multi autonomous robots system (MARS) and immune system, a synthesized immune networks hypothesis and the algorithm to solve the route planning and cooperation problem on MARS are proposed. The route planning and cooperation problem is transformed to the interaction mechanism among antibody, antigen and small-scaled immune networks. The pursuit problem is used to validate the hypothesis. Simulation results suggest that the proposal is promising.","PeriodicalId":120577,"journal":{"name":"Proceedings Autonomous Decentralized Systems, 2005. ISADS 2005.","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2005-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131443695","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ningjiang Chen, Jun Wei, Bo Yang, Jinling Wang, Tao Huang
{"title":"A QoS-enable failure detection framework for J2EE application server","authors":"Ningjiang Chen, Jun Wei, Bo Yang, Jinling Wang, Tao Huang","doi":"10.1109/ISADS.2005.1452132","DOIUrl":"https://doi.org/10.1109/ISADS.2005.1452132","url":null,"abstract":"As a basic reliability guarantee technology in distributed systems, failure detection provides the ability of timely detecting the liveliness of runtime systems. Effective failure detection is very important to J2EE application server (JAS), the leading middleware in Web computing environment, and it also needs to meet the requirements of reconfiguration, flexibility and adaptability. Based on the QoS (quality of service) specification of failure detector, this paper presents a QoS-enable failure detection framework for JAS, which satisfies the requirements of dynamically adjusting qualities and flexible integration of failure detectors. The work has been implemented in OnceAS application server that is developed by Institute of Software, Chinese Academy of Sciences. The experiments show that the framework can provide good QoS of failure detection in JAS.","PeriodicalId":120577,"journal":{"name":"Proceedings Autonomous Decentralized Systems, 2005. ISADS 2005.","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2005-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128992465","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An ideal run mode for mass transit based on ADS","authors":"Qing He, Xiaoyun Feng, Jinling Zhu, Hongyun He","doi":"10.1109/ISADS.2005.1452064","DOIUrl":"https://doi.org/10.1109/ISADS.2005.1452064","url":null,"abstract":"A new train control system conception is suggested and contrasted with the conventional train control mode in this paper. This ideal control mode, in the standpoint of satisfying the ideal desire of passengers, is based on \"soft connection\" and ADS (autonomous decentralized system), and makes the train operate in high speed and high density. This model solves the problem that the train must stop in the station and proposes a new future transportation conception.","PeriodicalId":120577,"journal":{"name":"Proceedings Autonomous Decentralized Systems, 2005. ISADS 2005.","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2005-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129390004","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Zhonggui Ma, Bin Ye, X. Ban, Guangping Zeng, Xuyan Tu
{"title":"The study on model and architecture of SoftMan group based on intelligent autonomous decentralized systems","authors":"Zhonggui Ma, Bin Ye, X. Ban, Guangping Zeng, Xuyan Tu","doi":"10.1109/ISADS.2005.1452153","DOIUrl":"https://doi.org/10.1109/ISADS.2005.1452153","url":null,"abstract":"In this paper, the concepts and characteristics of SoftMan and SoftMan Group are introduced. And SoftMan is a virtual robot which has characteristics of distributed mobile agent, Robot and Artificial Life living in network. The characteristics of research platform for SoftMan are introduced. The model of SoftMan about fitness, physiological development, self-reproduce and sport is given, and architecture for SoftMan group based on Intelligent Autonomous Decentralized Systems is proposed. This architecture introduces inner data structures, function modules and database of SoftMan. At the same time, SoftMan communication model with multi-level hierarchical architecture on the basis of Client/Server Model and Peer-To-Peer Model is put forward. This model has the merits of the two models discussed above.","PeriodicalId":120577,"journal":{"name":"Proceedings Autonomous Decentralized Systems, 2005. ISADS 2005.","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2005-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126759703","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Dynamic transport services using flexible positioning of bus stations","authors":"Naoto Mukai, Toyohide Watanabe","doi":"10.1109/ISADS.2005.1452063","DOIUrl":"https://doi.org/10.1109/ISADS.2005.1452063","url":null,"abstract":"In these years, a dynamic transport service which is called demand-bus system by using the contemporary realtime location technologies is focused by public administrations. The most important feature of the services is on-demand processing; i.e., customers can call transport vehicles anytime and get on/off anywhere. However, in the existing circumstances, the demand-bus system is still on the developing stage. In this paper, we classify the demand-bus system into two types: semi-demand and full-demand, on the basis of bus station types. Moreover, we propose methods to solve the real-time problems, (i.e., assignment and scheduling problems), in the demand-bus system by using anticipated future routes of transport vehicles. Finally, we report simulation results and consider effectiveness and possibility of the demand-bus system in an urban area.","PeriodicalId":120577,"journal":{"name":"Proceedings Autonomous Decentralized Systems, 2005. ISADS 2005.","volume":"73 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2005-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129038596","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An adaptive fuzzy logic controller with self-tuning scaling factors based on neural networks","authors":"Huiwen Deng, Yi Wang","doi":"10.1109/ISADS.2005.1452096","DOIUrl":"https://doi.org/10.1109/ISADS.2005.1452096","url":null,"abstract":"Scaling factors tuning is one of the most used method to enhance the performance of a fuzzy logic controller (FLC). In this paper, we bring forward an adaptive FLC with self adjusting scaling factors (SFs) using neural networks (NNs). Definitions of SFs and their effects on the overall performance of an FLC are analyzed. Detailed control scheme, learning mechanism for the NNs and simulation results for typical second-order linear and nonlinear systems are showed.","PeriodicalId":120577,"journal":{"name":"Proceedings Autonomous Decentralized Systems, 2005. ISADS 2005.","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2005-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121536294","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Basic building blocks for mobile service provisioning","authors":"B. Mrohs, C. Räck, S. Steglich","doi":"10.1109/ISADS.2005.1452024","DOIUrl":"https://doi.org/10.1109/ISADS.2005.1452024","url":null,"abstract":"Realizing services targeted to fixed network environments today is supported by a large number of environments that provide essential functionalities to service developers. However, developers of mobile services for 3G systems and beyond systems still challenge the problem of not being able to rely on a specific environment for mobile service provisioning. In ongoing research projects about future service scenarios and platforms we address this problem. The projects aim to provide mobile service developers a specification for an environment supporting personalization, context-awareness and service adaptation features through well defined interfaces, allowing them to realize ubiquitous services. This paper describes the basic building blocks of such a mobile service execution environment.","PeriodicalId":120577,"journal":{"name":"Proceedings Autonomous Decentralized Systems, 2005. ISADS 2005.","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2005-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122235346","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"ADPE: agent-based decentralized process engine","authors":"S. Chou","doi":"10.1109/ISADS.2005.1452098","DOIUrl":"https://doi.org/10.1109/ISADS.2005.1452098","url":null,"abstract":"Process-centered software engineering environments (PSEEs) facilitate controlling complicated software processes. Traditional PSEEs are generally centrally controlled, which may result in the following drawbacks: (1) the server may become a bottleneck; and (2) when the server is down, processes need to be suspended. To overcome the drawbacks, we developed a decentralized process engine ADPE (agent-based decentralized process engine). ADPE can be embedded in any PSEE to decentralize the PSEE. This paper presents ADPE.","PeriodicalId":120577,"journal":{"name":"Proceedings Autonomous Decentralized Systems, 2005. ISADS 2005.","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2005-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125611617","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}