In this paper, we propose LogReducer, a non-intrusive and language-independent log reduction framework based on eBPF (Extended Berkeley Packet Filter), consisting of both online and offline processes. After two months of serving the offline process of LogReducer in WeChat, the log storage overhead has dropped from 19.7 PB per day to 12.0 PB (i.e., about a 39.08% decrease).
Guangba Yu,
Pengfei Chen,
Pairui Li,
Tianjun Weng,
Haibing Zheng,
Yuetang Deng,
Zibin Zheng