Selecting method of sending block images based on time-domain frequency estimation for low delay live video streaming system

Daiki Abe, Takahiro Yakoh

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

To realize low delay live video streaming system over lossy network, each captured frame must be divided into block images, and these images must be encoded, packetized, and sent selectively. To improve the quality of reproduced frames at the receiver side, the selecting method of the block images must be sophisticated. This paper proposed an optimal selecting method of block images. The method consists of three phases based on the formulated two optimization problems. Firstly, a frequency analysis method is applied to the recent luminance value for each block area. Secondly, sendable block ratio is optimally distributed among block areas based on the result of frequency analysis to satisfy the available bandwidth condition. Finally, the optimal timings of sending are planned for each block area to minimize the error of reproduced image under the condition of assigned sendable block ratio. Some experiments were conducted to evaluate the proposed method using three frequently used reference video sequences. The results of comparison with the conventional method shows that the proposed method improved the mean squared error (MSE) of reproduced image up to 64%. Another results shows that the robustness of the proposed method against packet loss can be changed by modifying the parameter of the optimization problem.

Original languageEnglish
Pages (from-to)1888-1896
Number of pages9
JournalIEEJ Transactions on Electronics, Information and Systems
Volume134
Issue number12
DOIs
Publication statusPublished - 2014

Fingerprint

Frequency estimation
Video streaming
Packet loss
Luminance
Bandwidth
Experiments

Keywords

  • Image transmission
  • Live video streaming
  • Teleoperation

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this

@article{c5f9b234696148e3926a8f036fb6e0ee,
title = "Selecting method of sending block images based on time-domain frequency estimation for low delay live video streaming system",
abstract = "To realize low delay live video streaming system over lossy network, each captured frame must be divided into block images, and these images must be encoded, packetized, and sent selectively. To improve the quality of reproduced frames at the receiver side, the selecting method of the block images must be sophisticated. This paper proposed an optimal selecting method of block images. The method consists of three phases based on the formulated two optimization problems. Firstly, a frequency analysis method is applied to the recent luminance value for each block area. Secondly, sendable block ratio is optimally distributed among block areas based on the result of frequency analysis to satisfy the available bandwidth condition. Finally, the optimal timings of sending are planned for each block area to minimize the error of reproduced image under the condition of assigned sendable block ratio. Some experiments were conducted to evaluate the proposed method using three frequently used reference video sequences. The results of comparison with the conventional method shows that the proposed method improved the mean squared error (MSE) of reproduced image up to 64{\%}. Another results shows that the robustness of the proposed method against packet loss can be changed by modifying the parameter of the optimization problem.",
keywords = "Image transmission, Live video streaming, Teleoperation",
author = "Daiki Abe and Takahiro Yakoh",
year = "2014",
doi = "10.1541/ieejeiss.134.1888",
language = "English",
volume = "134",
pages = "1888--1896",
journal = "IEEJ Transactions on Electronics, Information and Systems",
issn = "0385-4221",
publisher = "The Institute of Electrical Engineers of Japan",
number = "12",

}

TY - JOUR

T1 - Selecting method of sending block images based on time-domain frequency estimation for low delay live video streaming system

AU - Abe, Daiki

AU - Yakoh, Takahiro

PY - 2014

Y1 - 2014

N2 - To realize low delay live video streaming system over lossy network, each captured frame must be divided into block images, and these images must be encoded, packetized, and sent selectively. To improve the quality of reproduced frames at the receiver side, the selecting method of the block images must be sophisticated. This paper proposed an optimal selecting method of block images. The method consists of three phases based on the formulated two optimization problems. Firstly, a frequency analysis method is applied to the recent luminance value for each block area. Secondly, sendable block ratio is optimally distributed among block areas based on the result of frequency analysis to satisfy the available bandwidth condition. Finally, the optimal timings of sending are planned for each block area to minimize the error of reproduced image under the condition of assigned sendable block ratio. Some experiments were conducted to evaluate the proposed method using three frequently used reference video sequences. The results of comparison with the conventional method shows that the proposed method improved the mean squared error (MSE) of reproduced image up to 64%. Another results shows that the robustness of the proposed method against packet loss can be changed by modifying the parameter of the optimization problem.

AB - To realize low delay live video streaming system over lossy network, each captured frame must be divided into block images, and these images must be encoded, packetized, and sent selectively. To improve the quality of reproduced frames at the receiver side, the selecting method of the block images must be sophisticated. This paper proposed an optimal selecting method of block images. The method consists of three phases based on the formulated two optimization problems. Firstly, a frequency analysis method is applied to the recent luminance value for each block area. Secondly, sendable block ratio is optimally distributed among block areas based on the result of frequency analysis to satisfy the available bandwidth condition. Finally, the optimal timings of sending are planned for each block area to minimize the error of reproduced image under the condition of assigned sendable block ratio. Some experiments were conducted to evaluate the proposed method using three frequently used reference video sequences. The results of comparison with the conventional method shows that the proposed method improved the mean squared error (MSE) of reproduced image up to 64%. Another results shows that the robustness of the proposed method against packet loss can be changed by modifying the parameter of the optimization problem.

KW - Image transmission

KW - Live video streaming

KW - Teleoperation

UR - http://www.scopus.com/inward/record.url?scp=84916613497&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84916613497&partnerID=8YFLogxK

U2 - 10.1541/ieejeiss.134.1888

DO - 10.1541/ieejeiss.134.1888

M3 - Article

VL - 134

SP - 1888

EP - 1896

JO - IEEJ Transactions on Electronics, Information and Systems

JF - IEEJ Transactions on Electronics, Information and Systems

SN - 0385-4221

IS - 12

ER -