摘要
介绍了使用Node.js来实现一个分布式的数据流日志处理系统.为解决随着运行服务数量的增加,基于文件的日志操作会带来的存储性能瓶颈和必须要多处查看等问题提供一种方案.将日志从文件还原为流,利用Node.js来实现一个可分布式获得各日志数据流并且汇聚到中心存储的新型日志系统octoLogStreamlet.充分利用Node.js的非阻塞I/O特性及NoSQL数据库的读写高性能,实现多个数据流同时写入.系统适用于有集中存放日志需求的计算机服务集群.集中存放后对日志的处理和使用均提供了极大的便利.
This paper introduces a distributed log service System treating logs as data streams built with Node.js. and provides a solution to the problem that with the service number increases, the operation based on files gives rise to disadvantages that files I/O have performance bottleneck and have to be checked at multiple places. Logs are considered as a sort of data stream rather than files. Write a new log service system named octoLogStreamlet which collects the streams to a central storage with Node.js. Combining Node.js＇ non-blocking I/O model and outstanding performance of NoSQL database, the system meets the requirements to cope with distributed data streams. The system is suitable for computer clusters needing centralized storage of logs, which provides great convenience for processing and utilizing logs.
出处
《计算机系统应用》
2013年第2期68-71,共4页
Computer Systems & Applications
