DomeOS的标准日志收集组件-flume

基础

使用flume1.6版本，使用tail -F获取日志信息，并上报到kafka中，所有信息通过环境变量导入，使用脚本生成配置文件

环境变量，示例如下：

DOMEOS_FLUME_LOG_COUNT=2
DOMEOS_FLUME_LOGFILE1=/log/xxx.log
DOMEOS_FLUME_TOPIC1=log1
DOMEOS_FLUME_MORECMD1=" | grep "ERROR\|FATAL" | awk -vnhost="$HOSTNAME" '{print "["nhost"]—"$0}'
DOMEOS_FLUME_LOGFILE2=/log/xxx2.log
DOMEOS_FLUME_TOPIC2=log2
DOMEOS_KAFKA_BROKER=xx.xx.xx.xx:xxxx
DOMEOS_FLUME_CHANNEL_DIR=/log/

DomeOS的标准日志清理组件-cleanlog

环境变量，示例如下：

DOMEOS_CLEAN_LOG_COUNT=2
DOMEOS_CLEAN_LOGFILE1=/log/xxx.log
DOMEOS_CLEAN_EXPIRETIME1=7200 # 单位分钟
DOMEOS_CLEAN_LOGFILE2=/log/xxx.log
DOMEOS_CLEAN_EXPIRETIME2=3600 # 单位分钟