naa a22 4500 510795242 CHVBK 20180411083334.0 cr unu---uuuuu 180411e20130301xx s 000 0 eng 10.1007/s11277-012-0611-9 doi (NATIONALLICENCE)springer-10.1007/s11277-012-0611-9 Reinforcement-Learning-Based Double Auction Design for Dynamic Spectrum Access in Cognitive Radio Networks [Elektronische Daten] [Yinglei Teng, F. Yu, Ke Han, Yifei Wei, Yong Zhang] In cognitive radio networks, an important issue is to share the detected available spectrum among different secondary users to improve the network performance. Although some work has been done for dynamic spectrum access, the learning capability of cognitive radio networks is largely ignored in the previous work. In this paper, we propose a reinforcement-learning-based double auction algorithm aiming to improve the performance of dynamic spectrum access in cognitive radio networks. The dynamic spectrum access process is modeled as a double auction game. Based on the spectrum access history information, both primary users and secondary users can estimate the impact on their future rewards and then adapt their spectrum access or release strategies effectively to compete for channel opportunities. Simulation results show that the proposed reinforcement-learning-based double auction algorithm can significantly improve secondary users' performance in terms of packet loss, bidding efficiency and transmission rate or opportunity access. Springer Science+Business Media, LLC., 2012 Reinforcement learning nationallicence Cognitive radio networks nationallicence Dynamic spectrum access (DSA) nationallicence Double auction nationallicence Teng Yinglei Beijing University of Posts and Telecommunications, Beijing, China aut Yu F. Defense R&D Canada, Ottawa, ON, Canada aut Han Ke Beijing University of Posts and Telecommunications, Beijing, China aut Wei Yifei Beijing University of Posts and Telecommunications, Beijing, China aut Zhang Yong Beijing University of Posts and Telecommunications, Beijing, China aut Wireless Personal Communications Springer US; http://www.springer-ny.com 69/2(2013-03-01), 771-791 0929-6212 69:2<771 2013 69 11277 https://doi.org/10.1007/s11277-012-0611-9 text/html Onlinezugriff via DOI 1 research-article jats NATIONALLICENCE 856 40 https://doi.org/10.1007/s11277-012-0611-9 text/html Onlinezugriff via DOI NATIONALLICENCE 700 1- Teng Yinglei Beijing University of Posts and Telecommunications, Beijing, China aut NATIONALLICENCE 700 1- Yu F. Defense R&D Canada, Ottawa, ON, Canada aut NATIONALLICENCE 700 1- Han Ke Beijing University of Posts and Telecommunications, Beijing, China aut NATIONALLICENCE 700 1- Wei Yifei Beijing University of Posts and Telecommunications, Beijing, China aut NATIONALLICENCE 700 1- Zhang Yong Beijing University of Posts and Telecommunications, Beijing, China aut NATIONALLICENCE 773 0- Wireless Personal Communications Springer US; http://www.springer-ny.com 69/2(2013-03-01), 771-791 0929-6212 69:2<771 2013 69 11277 Metadata rights reserved Springer special CC-BY-NC licence nationallicence BK010053 XK010053 XK010000 NATIONALLICENCE NATIONALLICENCE NL-springer