01841nas a2200169   4500008004100000245005800041210005800099260004700157520127100204100002201475700001901497700001901516700001501535700002001550700001601570856008501586       2018                        eng d00aCognitive Engine Testbed for Vehicular Communications0 aCognitive Engine Testbed for Vehicular Communications  aTucson, ArizonabThe University of Arizona3 a<p>Ad-hoc networks have the potential to increase the safety and reliability of autonomous vehicles. The amount of radio spectrum available for such networks is limited, however. The use of cognitive radio, especially when integrated with reinforcement learning algorithms, may help to ease the issue of limited spectrum by finding optimal transmission policies and detecting the presence of other users, especially in a scenario where a Primary User and Secondary User are contesting for spectrum. This paper presents a testbed for simulating cognitive engines in these networks using a variety of reinforcement learning algorithms, including -greedy, Softmax Strategy, and Q-Learning. The goal of these cognitive engines is to learn to choose the best modulation and coding rates given various channel conditions and a user-defined optimization goal (i.e. maximize throughput, minimize bit error rate). The cognitive engine then learns the optimal coding rates and modulation schemes for the given environment, and the testbed displays a visual of the performance of the cognitive engine at each time step. In the case of Q-learning in a Primary User vs. Secondary User scenario, the cognitive engine also learns to choose the best channel for transmission.</p>
1 aAnderson, William1 aAponik, Ashley1 aDaoud, Youssef1 aTeku, Noel1 aVanhoy, Garrett1 aBose, Tamal  uhttp://csl.arizona.edu/content/cognitive-engine-testbed-vehicular-communications