haku: @keyword distributed system / yhteensä: 17
viite: 2 / 17
| Tekijä: | Wang, Yangjun |
| Työn nimi: | Stream Processing Systems Benchmark: StreamBench |
| Julkaisutyyppi: | Diplomityö |
| Julkaisuvuosi: | 2016 |
| Sivut: | (7) + 59 Kieli: eng |
| Koulu/Laitos/Osasto: | Perustieteiden korkeakoulu |
| Oppiaine: | Foundations of Advanced Computing (SCI3014) |
| Valvoja: | Gionis, Aristides |
| Ohjaaja: | De Francisci Morales, Gianmarco |
| Elektroninen julkaisu: | http://urn.fi/URN:NBN:fi:aalto-201606172599 |
| Sijainti: | P1 Ark Aalto 5795 | Arkisto |
| Avainsanat: | big data stream processing benchmark distributed system |
| Tiivistelmä (eng): | Batch processing technologies (Such as MapReduce, Hive, Pig) have matured and been widely used in the industry. These systems solved the issue processing big volumes of data successfully. However, first big amount of data need to be collected and stored in a database or file system. That is very time-consuming. Then it takes time to finish batch processing analysis jobs before get any results. While there are many cases that need analysed results from unbounded sequence of data in seconds or sub-seconds. To satisfy the increasing demand of processing such streaming data, several streaming processing systems are implemented and widely adopted, such as Apache Storm, Apache Spark, IBM InfoSphere Streams, and Apache Flink. They all support online stream processing, high scalability, and tasks monitoring. While how to evaluate stream processing systems before choosing one in production development is an open question. In this thesis, we introduce StreamBench, a benchmark framework to facilitate performance comparisons of stream processing systems. A common API component and a core set of workloads are defined. We implement the common API and run benchmarks for three widely used open source stream processing systems: Apache Storm, Flink, and Spark Streaming. A key feature of the StreamBench framework is that it is extensible -- it supports easy definition of new workloads, in addition to making it easy to benchmark new stream processing systems. |
| ED: | 2016-07-17 |
INSSI tietueen numero: 54029
+ lisää koriin
INSSI