收集文件夹的内容到HDFS,按照时间分区

时间:2025-03-30 16:59:29
# Name the components on this agent
 = r1
 = k1
 = c1
 
# Describe/configure the source
. = spooldir
. = /bigdata/testdata/spool_dir
 
# Describe the sink
. = hdfs
.=hdfs://localhost:8020/flume/log/%m%d%H%M
.=CompressedStream
.=
.=page-views
.=0
.	=1000000
.=30

.=true
.=true
.=1
.=minute

# Use a channel which buffers events in memory
. = memory
. = 1000
. = 100
 
# Bind the source and sink to the channel
. = c1
. = c1