Complex event processing over uncertain data streams

Hideyuki Kawashima, Hiroyuki Kitagawa, Xin Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

31 Citations (Scopus)

Abstract

Pattern matching over event streams is well developed. However, with the increasing demand of measurement accuracy, confidence of more complex events sourced from original, continuously arriving events generated from sensor kind electronic devices is becoming more and more been concerned. Actually, some applications such as RFID-based supply chain management and monitoring in health care require data stream with high reliability, but current hardware and wireless communication techniques cannot support 100% confident data, one stream processing engine which can report confidence for processed complex events over uncertain data is needed. In this paper, we propose an optimized method to not only calculate the probability of outputs of compound events but also obtain the value of confidence of the complex pattern given by user against uncertain raw input data stream generated by distrustful network devices. Our proposal is based on an existing stream processing engine SASE+, and we extend its evaluation model NFAb automaton to a new type of automaton in order to manage the runtime against probabilistic stream. In the design of automaton, we consider optimizations to reduce the computation cost and response time to a realistic degree with long sliding time window.

Original languageEnglish
Title of host publicationProceedings - International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, 3PGCIC 2010
Pages521-526
Number of pages6
DOIs
Publication statusPublished - 2010 Dec 1
Externally publishedYes
Event5th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, 3PGCIC 2010 - Fukuoka, Japan
Duration: 2010 Nov 42010 Nov 6

Other

Other5th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, 3PGCIC 2010
CountryJapan
CityFukuoka
Period10/11/410/11/6

Fingerprint

Engines
Pattern matching
Supply chain management
Processing
Health care
Radio frequency identification (RFID)
Hardware
Monitoring
Communication
Sensors
Costs

Keywords

  • Complex Event Processing
  • Data Stream
  • Uncertainty

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Software

Cite this

Kawashima, H., Kitagawa, H., & Li, X. (2010). Complex event processing over uncertain data streams. In Proceedings - International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, 3PGCIC 2010 (pp. 521-526). [5662592] https://doi.org/10.1109/3PGCIC.2010.89

Complex event processing over uncertain data streams. / Kawashima, Hideyuki; Kitagawa, Hiroyuki; Li, Xin.

Proceedings - International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, 3PGCIC 2010. 2010. p. 521-526 5662592.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kawashima, H, Kitagawa, H & Li, X 2010, Complex event processing over uncertain data streams. in Proceedings - International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, 3PGCIC 2010., 5662592, pp. 521-526, 5th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, 3PGCIC 2010, Fukuoka, Japan, 10/11/4. https://doi.org/10.1109/3PGCIC.2010.89
Kawashima H, Kitagawa H, Li X. Complex event processing over uncertain data streams. In Proceedings - International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, 3PGCIC 2010. 2010. p. 521-526. 5662592 https://doi.org/10.1109/3PGCIC.2010.89
Kawashima, Hideyuki ; Kitagawa, Hiroyuki ; Li, Xin. / Complex event processing over uncertain data streams. Proceedings - International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, 3PGCIC 2010. 2010. pp. 521-526
@inproceedings{e1ec6659dadc4f239b3c5263bc242a77,
title = "Complex event processing over uncertain data streams",
abstract = "Pattern matching over event streams is well developed. However, with the increasing demand of measurement accuracy, confidence of more complex events sourced from original, continuously arriving events generated from sensor kind electronic devices is becoming more and more been concerned. Actually, some applications such as RFID-based supply chain management and monitoring in health care require data stream with high reliability, but current hardware and wireless communication techniques cannot support 100{\%} confident data, one stream processing engine which can report confidence for processed complex events over uncertain data is needed. In this paper, we propose an optimized method to not only calculate the probability of outputs of compound events but also obtain the value of confidence of the complex pattern given by user against uncertain raw input data stream generated by distrustful network devices. Our proposal is based on an existing stream processing engine SASE+, and we extend its evaluation model NFAb automaton to a new type of automaton in order to manage the runtime against probabilistic stream. In the design of automaton, we consider optimizations to reduce the computation cost and response time to a realistic degree with long sliding time window.",
keywords = "Complex Event Processing, Data Stream, Uncertainty",
author = "Hideyuki Kawashima and Hiroyuki Kitagawa and Xin Li",
year = "2010",
month = "12",
day = "1",
doi = "10.1109/3PGCIC.2010.89",
language = "English",
isbn = "9780769542379",
pages = "521--526",
booktitle = "Proceedings - International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, 3PGCIC 2010",

}

TY - GEN

T1 - Complex event processing over uncertain data streams

AU - Kawashima, Hideyuki

AU - Kitagawa, Hiroyuki

AU - Li, Xin

PY - 2010/12/1

Y1 - 2010/12/1

N2 - Pattern matching over event streams is well developed. However, with the increasing demand of measurement accuracy, confidence of more complex events sourced from original, continuously arriving events generated from sensor kind electronic devices is becoming more and more been concerned. Actually, some applications such as RFID-based supply chain management and monitoring in health care require data stream with high reliability, but current hardware and wireless communication techniques cannot support 100% confident data, one stream processing engine which can report confidence for processed complex events over uncertain data is needed. In this paper, we propose an optimized method to not only calculate the probability of outputs of compound events but also obtain the value of confidence of the complex pattern given by user against uncertain raw input data stream generated by distrustful network devices. Our proposal is based on an existing stream processing engine SASE+, and we extend its evaluation model NFAb automaton to a new type of automaton in order to manage the runtime against probabilistic stream. In the design of automaton, we consider optimizations to reduce the computation cost and response time to a realistic degree with long sliding time window.

AB - Pattern matching over event streams is well developed. However, with the increasing demand of measurement accuracy, confidence of more complex events sourced from original, continuously arriving events generated from sensor kind electronic devices is becoming more and more been concerned. Actually, some applications such as RFID-based supply chain management and monitoring in health care require data stream with high reliability, but current hardware and wireless communication techniques cannot support 100% confident data, one stream processing engine which can report confidence for processed complex events over uncertain data is needed. In this paper, we propose an optimized method to not only calculate the probability of outputs of compound events but also obtain the value of confidence of the complex pattern given by user against uncertain raw input data stream generated by distrustful network devices. Our proposal is based on an existing stream processing engine SASE+, and we extend its evaluation model NFAb automaton to a new type of automaton in order to manage the runtime against probabilistic stream. In the design of automaton, we consider optimizations to reduce the computation cost and response time to a realistic degree with long sliding time window.

KW - Complex Event Processing

KW - Data Stream

KW - Uncertainty

UR - http://www.scopus.com/inward/record.url?scp=84859779484&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84859779484&partnerID=8YFLogxK

U2 - 10.1109/3PGCIC.2010.89

DO - 10.1109/3PGCIC.2010.89

M3 - Conference contribution

AN - SCOPUS:84859779484

SN - 9780769542379

SP - 521

EP - 526

BT - Proceedings - International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, 3PGCIC 2010

ER -