Optimal channel-sensing policy based on Fuzzy Q-Learning process over cognitive radio systems

Fereidoun H. Panahi, Tomoaki Ohtsuki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

13 Citations (Scopus)

Abstract

In a cognitive radio (CR) network, the channel sensing scheme to detect the appearance of a primary user (PU) directly affects the performances of both CR and PU. However, in practical systems, the CR is prone to sensing errors due to inefficient sensing scheme. This may lead to interfering with primary user and low system performance. In this paper, we present a learning based scheme for channel sensing in CR network. Specifically, we formulate the channel sensing problem as a partially observable Markov decision process (POMDP), where the most likely channel state is derived by a learning process called Fuzzy Q-Learning (FQL). The optimal policy is derived by solving the problem. The simulation results show the effectiveness and efficiency of our proposed scheme.

Original languageEnglish
Title of host publicationIEEE International Conference on Communications
Pages2677-2682
Number of pages6
DOIs
Publication statusPublished - 2013
Event2013 IEEE International Conference on Communications, ICC 2013 - Budapest, Hungary
Duration: 2013 Jun 92013 Jun 13

Other

Other2013 IEEE International Conference on Communications, ICC 2013
CountryHungary
CityBudapest
Period13/6/913/6/13

Fingerprint

Radio systems
Cognitive radio

Keywords

  • channel sensing
  • Cognitive Radio (CR)
  • Fuzzy Q-Learning (FQL)
  • partially observable Markov decision process (POMDP)
  • Reinforcement learning (RL)

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Computer Networks and Communications

Cite this

Panahi, F. H., & Ohtsuki, T. (2013). Optimal channel-sensing policy based on Fuzzy Q-Learning process over cognitive radio systems. In IEEE International Conference on Communications (pp. 2677-2682). [6654941] https://doi.org/10.1109/ICC.2013.6654941

Optimal channel-sensing policy based on Fuzzy Q-Learning process over cognitive radio systems. / Panahi, Fereidoun H.; Ohtsuki, Tomoaki.

IEEE International Conference on Communications. 2013. p. 2677-2682 6654941.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Panahi, FH & Ohtsuki, T 2013, Optimal channel-sensing policy based on Fuzzy Q-Learning process over cognitive radio systems. in IEEE International Conference on Communications., 6654941, pp. 2677-2682, 2013 IEEE International Conference on Communications, ICC 2013, Budapest, Hungary, 13/6/9. https://doi.org/10.1109/ICC.2013.6654941
Panahi, Fereidoun H. ; Ohtsuki, Tomoaki. / Optimal channel-sensing policy based on Fuzzy Q-Learning process over cognitive radio systems. IEEE International Conference on Communications. 2013. pp. 2677-2682
@inproceedings{2c62fcaee244412f857606de72aa5d92,
title = "Optimal channel-sensing policy based on Fuzzy Q-Learning process over cognitive radio systems",
abstract = "In a cognitive radio (CR) network, the channel sensing scheme to detect the appearance of a primary user (PU) directly affects the performances of both CR and PU. However, in practical systems, the CR is prone to sensing errors due to inefficient sensing scheme. This may lead to interfering with primary user and low system performance. In this paper, we present a learning based scheme for channel sensing in CR network. Specifically, we formulate the channel sensing problem as a partially observable Markov decision process (POMDP), where the most likely channel state is derived by a learning process called Fuzzy Q-Learning (FQL). The optimal policy is derived by solving the problem. The simulation results show the effectiveness and efficiency of our proposed scheme.",
keywords = "channel sensing, Cognitive Radio (CR), Fuzzy Q-Learning (FQL), partially observable Markov decision process (POMDP), Reinforcement learning (RL)",
author = "Panahi, {Fereidoun H.} and Tomoaki Ohtsuki",
year = "2013",
doi = "10.1109/ICC.2013.6654941",
language = "English",
isbn = "9781467331227",
pages = "2677--2682",
booktitle = "IEEE International Conference on Communications",

}

TY - GEN

T1 - Optimal channel-sensing policy based on Fuzzy Q-Learning process over cognitive radio systems

AU - Panahi, Fereidoun H.

AU - Ohtsuki, Tomoaki

PY - 2013

Y1 - 2013

N2 - In a cognitive radio (CR) network, the channel sensing scheme to detect the appearance of a primary user (PU) directly affects the performances of both CR and PU. However, in practical systems, the CR is prone to sensing errors due to inefficient sensing scheme. This may lead to interfering with primary user and low system performance. In this paper, we present a learning based scheme for channel sensing in CR network. Specifically, we formulate the channel sensing problem as a partially observable Markov decision process (POMDP), where the most likely channel state is derived by a learning process called Fuzzy Q-Learning (FQL). The optimal policy is derived by solving the problem. The simulation results show the effectiveness and efficiency of our proposed scheme.

AB - In a cognitive radio (CR) network, the channel sensing scheme to detect the appearance of a primary user (PU) directly affects the performances of both CR and PU. However, in practical systems, the CR is prone to sensing errors due to inefficient sensing scheme. This may lead to interfering with primary user and low system performance. In this paper, we present a learning based scheme for channel sensing in CR network. Specifically, we formulate the channel sensing problem as a partially observable Markov decision process (POMDP), where the most likely channel state is derived by a learning process called Fuzzy Q-Learning (FQL). The optimal policy is derived by solving the problem. The simulation results show the effectiveness and efficiency of our proposed scheme.

KW - channel sensing

KW - Cognitive Radio (CR)

KW - Fuzzy Q-Learning (FQL)

KW - partially observable Markov decision process (POMDP)

KW - Reinforcement learning (RL)

UR - http://www.scopus.com/inward/record.url?scp=84891347909&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84891347909&partnerID=8YFLogxK

U2 - 10.1109/ICC.2013.6654941

DO - 10.1109/ICC.2013.6654941

M3 - Conference contribution

SN - 9781467331227

SP - 2677

EP - 2682

BT - IEEE International Conference on Communications

ER -