In this paper,a theoretical framework of Multiagent Simulation(MAS)is proposed for strategic bidding in electricity markets using reinforcement learning,which consists of two parts:one is a MAS system used to simulate...In this paper,a theoretical framework of Multiagent Simulation(MAS)is proposed for strategic bidding in electricity markets using reinforcement learning,which consists of two parts:one is a MAS system used to simulate the competitive bidding of the actual electricity market;the other is an adaptive learning strategy bidding system used to provide agents with more intelligent bidding strategies.An ExperienceWeighted Attraction(EWA)reinforcement learning algorithm(RLA)is applied to the MAS model and a new MAS method is presented for strategic bidding in electricity markets using a new Improved EWA(IEWA).From both qualitative and quantitative perspectives,it is compared with three other MAS methods using the Roth-Erev(RE),Q-learning and EWA.The results show that the performance of the MAS method using IEWA is proved to be better than the others.The four MAS models using four RLAs are built for strategic bidding in electricity markets.Through running the four MAS models,the rationality and correctness of the four MAS methods are verified for strategic bidding in electricity markets using reinforcement learning.展开更多
It is the matter for achievement of the low carbon transport system that the excessive use of private vehicles can be controlled appropriately.Not only improvement of service level of modes except private vehicle,but ...It is the matter for achievement of the low carbon transport system that the excessive use of private vehicles can be controlled appropriately.Not only improvement of service level of modes except private vehicle,but also consciousness for environmental problem of individual trip maker is important for eco-commuting promotion.On the other hand,consciousness for environment would be changed by influence of other person.Accordingly,it is aimed in the study that the structure of decision-making process for modal shift to the eco-commuting mode in the local city is described considering environmental consciousness and social interaction.For the purpose,the consciousness for the environment problem and the travel behavior of the commuter at the suburban area in the local city are investigated by the questionnaire survey.The covariance structure about the eco-consciousness is analyzed with the database of the questionnaire survey by structural equation modeling.As the result,it can be confirmed with the structural equation model that the individual environmental consciousness is strongly related with the intention of self-sacrifice and is influenced with the local interaction of the individual connections.On the other hand,the intention of modal shift for the commuting mode is analyzed with the database of the questionnaire survey.It can be found out that the environmental consciousness is not statistically significant for commuting mode choice with the present poor level of service of public transport.However,the intention of self-sacrifice for the prevention of the global warming is statistically confirmed as the factor of modal shift with the operation of eco-commuting bus service with the RP/SP integrated estimation method.As the result,the multi-agent simulation system with social interaction model for eco consciousness is developed to measure the effect of the eco-commuting promotion.For the purpose,the carbon dioxide emission is estimated based on traffic demand and road network condition in the traffic environment model.On the other hand,the relation between agents is defined based on the small world network.The proposed multi-agent simulation is applied to measure the effect of the eco-commuting promotion such as improvement of level of service on the public transport or education of eco-consciousness.The effect of the promotion plan can be observed with the proposed multi-agent system.Finally,it can be concluded that the proposed multi-agent simulation with social interaction for eco-consciousness is useful for planning of eco-commuting promotion.展开更多
目的:比较国内外Agent行为建模与仿真研究热点与趋势,为我国研究者更有效地应用Agent行为建模与仿真提供参考依据。方法:运用CiteSpace5.7R5软件对中国知网和Web of Science核心合集数据库2011年1月1日至2021年3月31日中有关Agent行为...目的:比较国内外Agent行为建模与仿真研究热点与趋势,为我国研究者更有效地应用Agent行为建模与仿真提供参考依据。方法:运用CiteSpace5.7R5软件对中国知网和Web of Science核心合集数据库2011年1月1日至2021年3月31日中有关Agent行为建模与仿真研究的文献进行图谱量化分析。结果:共检索到有效中文文献864篇、英文文献2323篇,国内发文量整体呈下降趋势,国外发文量整体呈上升趋势,发文量高的国家集中在发达国家,国外研究前沿已经延伸到物理学、金融学、哲学、生物学、物流学、人工智能等方面。国内研究热点主要集中在社会学、物理学、网络模型等方面。结论:Agent行为建模与仿真研究的应用范围较广泛,与国际相比国内Agent行为建模与仿真研究还存在一定的差距,研究深度和广度有待进一步拓展,国内应参考国际Agent行为建模与仿真研究的热点及前沿,探索适合我国特色的Agent行为建模与仿真系统体系,以促进我国Agent行为建模与仿真的发展。展开更多
The concept of the method resource is introduced to deal with the cooperative application problem of different electro-optical countermeasure equipments. Based on this concept, a new approach is introduced to distribu...The concept of the method resource is introduced to deal with the cooperative application problem of different electro-optical countermeasure equipments. Based on this concept, a new approach is introduced to distribute the jamming resources of electro-optical countermeasures, and it is used to deploy and manage electro-optical countermeasures resources under the restriction conditions of cooperation and incompatibility disposing. The resource management procedure is formalized by Finite State Machine (FSM). By using the cooperative resource operation system on the basis of multi-agent systems, a complex system with three incompatible swarms is constructed and cooperative operation procedures are demonstrated by simulations.展开更多
Information diffusion is significant for emergencymanagement as it can decide the severity of accidents. In this paper, we set up a communication model of passengers for the metroemergency. In the model, four categori...Information diffusion is significant for emergencymanagement as it can decide the severity of accidents. In this paper, we set up a communication model of passengers for the metroemergency. In the model, four categories of passengers are definedas unknown passengers, supportive passengers, neutral passengers and opposed passengers. Three passengers' characteristics are taken into account, such as spreading desire, the trustworthinessand the passengers' uncertainty about their opinions. From thesimulation results, we can see that the passengers' uncertainty about their opinions has a positive correlation with the time ofpassengers' opinions reaching consensus, while other two factorsboth have a negative correlation. The result is useful for metroofficials to guide and control emergency information.展开更多
基金supported by the National Key Research and Development Program of China(2016YFB0901104)。
文摘In this paper,a theoretical framework of Multiagent Simulation(MAS)is proposed for strategic bidding in electricity markets using reinforcement learning,which consists of two parts:one is a MAS system used to simulate the competitive bidding of the actual electricity market;the other is an adaptive learning strategy bidding system used to provide agents with more intelligent bidding strategies.An ExperienceWeighted Attraction(EWA)reinforcement learning algorithm(RLA)is applied to the MAS model and a new MAS method is presented for strategic bidding in electricity markets using a new Improved EWA(IEWA).From both qualitative and quantitative perspectives,it is compared with three other MAS methods using the Roth-Erev(RE),Q-learning and EWA.The results show that the performance of the MAS method using IEWA is proved to be better than the others.The four MAS models using four RLAs are built for strategic bidding in electricity markets.Through running the four MAS models,the rationality and correctness of the four MAS methods are verified for strategic bidding in electricity markets using reinforcement learning.
基金The research is granted by Japanese Ministry of Education as a part of Grants-in-Aid for Scientific Research,No.(C)22560533.The author records here warmest appreciation to the Resident Conference for Environment of Tokushima Prefecture for collecting the data in the field of actual travel behavior on the social experiment.
文摘It is the matter for achievement of the low carbon transport system that the excessive use of private vehicles can be controlled appropriately.Not only improvement of service level of modes except private vehicle,but also consciousness for environmental problem of individual trip maker is important for eco-commuting promotion.On the other hand,consciousness for environment would be changed by influence of other person.Accordingly,it is aimed in the study that the structure of decision-making process for modal shift to the eco-commuting mode in the local city is described considering environmental consciousness and social interaction.For the purpose,the consciousness for the environment problem and the travel behavior of the commuter at the suburban area in the local city are investigated by the questionnaire survey.The covariance structure about the eco-consciousness is analyzed with the database of the questionnaire survey by structural equation modeling.As the result,it can be confirmed with the structural equation model that the individual environmental consciousness is strongly related with the intention of self-sacrifice and is influenced with the local interaction of the individual connections.On the other hand,the intention of modal shift for the commuting mode is analyzed with the database of the questionnaire survey.It can be found out that the environmental consciousness is not statistically significant for commuting mode choice with the present poor level of service of public transport.However,the intention of self-sacrifice for the prevention of the global warming is statistically confirmed as the factor of modal shift with the operation of eco-commuting bus service with the RP/SP integrated estimation method.As the result,the multi-agent simulation system with social interaction model for eco consciousness is developed to measure the effect of the eco-commuting promotion.For the purpose,the carbon dioxide emission is estimated based on traffic demand and road network condition in the traffic environment model.On the other hand,the relation between agents is defined based on the small world network.The proposed multi-agent simulation is applied to measure the effect of the eco-commuting promotion such as improvement of level of service on the public transport or education of eco-consciousness.The effect of the promotion plan can be observed with the proposed multi-agent system.Finally,it can be concluded that the proposed multi-agent simulation with social interaction for eco-consciousness is useful for planning of eco-commuting promotion.
文摘目的:比较国内外Agent行为建模与仿真研究热点与趋势,为我国研究者更有效地应用Agent行为建模与仿真提供参考依据。方法:运用CiteSpace5.7R5软件对中国知网和Web of Science核心合集数据库2011年1月1日至2021年3月31日中有关Agent行为建模与仿真研究的文献进行图谱量化分析。结果:共检索到有效中文文献864篇、英文文献2323篇,国内发文量整体呈下降趋势,国外发文量整体呈上升趋势,发文量高的国家集中在发达国家,国外研究前沿已经延伸到物理学、金融学、哲学、生物学、物流学、人工智能等方面。国内研究热点主要集中在社会学、物理学、网络模型等方面。结论:Agent行为建模与仿真研究的应用范围较广泛,与国际相比国内Agent行为建模与仿真研究还存在一定的差距,研究深度和广度有待进一步拓展,国内应参考国际Agent行为建模与仿真研究的热点及前沿,探索适合我国特色的Agent行为建模与仿真系统体系,以促进我国Agent行为建模与仿真的发展。
文摘The concept of the method resource is introduced to deal with the cooperative application problem of different electro-optical countermeasure equipments. Based on this concept, a new approach is introduced to distribute the jamming resources of electro-optical countermeasures, and it is used to deploy and manage electro-optical countermeasures resources under the restriction conditions of cooperation and incompatibility disposing. The resource management procedure is formalized by Finite State Machine (FSM). By using the cooperative resource operation system on the basis of multi-agent systems, a complex system with three incompatible swarms is constructed and cooperative operation procedures are demonstrated by simulations.
基金Supported by the National Natural Science Foundation of China(71272045)the Humanities and Social Science Research Special Project of Ministry of Education of China(14JDGC016)
文摘Information diffusion is significant for emergencymanagement as it can decide the severity of accidents. In this paper, we set up a communication model of passengers for the metroemergency. In the model, four categories of passengers are definedas unknown passengers, supportive passengers, neutral passengers and opposed passengers. Three passengers' characteristics are taken into account, such as spreading desire, the trustworthinessand the passengers' uncertainty about their opinions. From thesimulation results, we can see that the passengers' uncertainty about their opinions has a positive correlation with the time ofpassengers' opinions reaching consensus, while other two factorsboth have a negative correlation. The result is useful for metroofficials to guide and control emergency information.
