流数据分析与管理综述.pdf

1000-9825/2004/15(08)1172 ©2004 Journal of Software 软 件 学 报 Vol.15, No.8 流数据分析与管理综述 金澈清, 钱卫宁, 周傲英+ (复旦大学 计算机科学与工程学系,上海 200433) Analysis and Management of Streaming Data: A Survey JIN Che-Qing, QIAN Wei-Ning, ZHOU Ao-Ying+ (Department of Computer Science and Engineering, Fudan University, Shanghai 200433, China) + Corresponding author: Phn: +86-21 Fax: +86-21 E-mail: ayzhou@, Received 2003-09-01; Accepted 2004-03-29 Jin CQ, Qian WN, Zhou AY. Analysis and management of streaming data: A survey. Journal of Software, 2004,15(8):1172~1181. /1000-9825/15/ 1172.htm Abstract: The study on streaming data is one of the hot topics among the database circle all over the world recently. During the past three decades, conventional database technologies have been well developed and widely applied. Unfortunately, they could not be adopted to handle a new kind of data, named streaming data, which is generated from applications such as network routing, sensor networking, stock analysis, etc. Because of the rapid data arriving speed and huge size of data set in stream model, novel algorithms that only require seeing the whole data set once are devised to support aggregation queries on demand. In addition, this kind of algorithms usually owns a data structure far smaller than the size of the whole data set. The ways to devise such synopsis data structures are introduced. These different approaches are also compared by listing historical works upon two classical problems over stream. Key words: streaming data; synopsis data structure; landmark model; sliding window model 摘 要: 有关流数据分析与管理的研究是目前国际数据库研究领域的一个热点.在过去30 多年中,尽管传统数 据库技术发展迅速且得到了广泛应用,但是它不能够处理在诸如网络路由、传感器网络、股票分析等应用中所 生成的一种新型数据, 即流数据.流数据的