- Title
- Log²: a cost-aware logging mechanism for performance diagnosis
- Creator
- Ding, Rui; Zhou, Hucheng; Lou, Jian-Guang; Zhang, Hongyu; Lin, Qingwei; Fu, Qiang; Zhang, Dongmei; Xie, Tao
- Relation
- 2015 USENIX Annual Technical Conference (USENIC ATC '15). Proceedings of the 2015 USENIX Annual Technical Conference (Santa Clara, CA 8-10 July, 2015) p. 139-150
- Relation
- https://www.usenix.org/node/190487
- Publisher
- USENIX Association
- Resource Type
- conference paper
- Date
- 2015
- Description
- Logging has been a common practice for monitoring and diagnosing performance issues. However, logging comes at a cost, especially for large-scale online service systems. First, the overhead incurred by intensive logging is non-negligible. Second, it is costly to diagnose a performance issue if there are a tremendous amount of redundant logs. Therefore, we believe that it is important to limit the overhead incurred by logging, without sacrificing the logging effectiveness. In this paper we propose Log², a cost-aware logging mechanism. Given a “budget” (defined as the maximum volume of logs allowed to be output in a time interval), Log² makes the “whether to log” decision through a two-phase filtering mechanism. In the first phase, a large number of irrelevant logs are discarded efficiently. In the second phase, useful logs are cached and output while complying with logging budget. In this way, Log² keeps the useful logs and discards the less useful ones. We have implemented Log² and evaluated it on an open source system as well as a real-world online service system from Microsoft. The experimental results show that Log² can control logging overhead while preserving logging effectiveness.
- Subject
- logging; performance diagnosis; online service systems; Log²
- Identifier
- http://hdl.handle.net/1959.13/1356991
- Identifier
- uon:31844
- Identifier
- ISBN:9781931971225
- Language
- eng
- Full Text
- Reviewed
- Hits: 2221
- Visitors: 2601
- Downloads: 422
| Thumbnail | File | Description | Size | Format | |||
|---|---|---|---|---|---|---|---|
| View Details Download | ATTACHMENT02 | Publisher version (open access) | 397 KB | Adobe Acrobat PDF | View Details Download |