PyFlink UDF 实时日志监控告警实现

时间:2022-02-21 13:58:56
【文件属性】:

文件名称:PyFlink UDF 实时日志监控告警实现

文件大小:1.59MB

文件格式:ZIP

更新时间:2022-02-21 13:58:56

flink 大数据 big data

本实例通过 Flink 结合 UDF 对系统上报的日志进行实时解析并生成告警,搭建实时监控告警系统


【文件预览】:
UDF
----udf_define.py(4KB)
----result()
--------part-e18d3aee-7478-452e-b8df-ba1c42536550-task-4-file-0(16KB)
--------.staging_1635856846947()
--------.staging_1635860560716()
--------.staging_1635857346727()
--------part-f148f66b-7b71-4897-828c-285946e49d5a-task-3-file-0(16KB)
--------.staging_1635856737477()
--------.staging_1635859699653()
--------.staging_1635857818144()
--------.staging_1635857057771()
--------.staging_1635857299441()
--------.staging_1635857085236()
----udf_hashCode_tableAPI.py(3KB)
----val.csv(8B)
----syslog(10KB)
----requirements.txt(56B)
----cached_dir()
--------Faker-9.7.1.tar.gz(1.12MB)
--------text-unidecode-1.3.tar.gz(75KB)
--------six-1.16.0.tar.gz(33KB)
--------python-dateutil-2.8.2.tar.gz(349KB)
----udf_hashCode_SQL.py(2KB)
----res()
--------part-6259709d-4e7c-42ac-88f5-82ac54603dd0-task-2-file-0(51B)
--------part-6259709d-4e7c-42ac-88f5-82ac54603dd0-task-5-file-0(51B)
--------part-7c934916-c026-4172-94e0-bd65f07d2348-task-0-file-0(51B)
--------part-df4e08f7-8d59-4261-9b1a-b530a4e9111f-task-7-file-0(51B)
--------part-df4e08f7-8d59-4261-9b1a-b530a4e9111f-task-8-file-0(51B)
--------part-df4e08f7-8d59-4261-9b1a-b530a4e9111f-task-1-file-0(51B)
--------part-7c934916-c026-4172-94e0-bd65f07d2348-task-8-file-0(51B)
--------part-df4e08f7-8d59-4261-9b1a-b530a4e9111f-task-5-file-0(51B)
--------part-7c934916-c026-4172-94e0-bd65f07d2348-task-9-file-0(51B)
--------part-7c934916-c026-4172-94e0-bd65f07d2348-task-7-file-0(51B)
--------part-6259709d-4e7c-42ac-88f5-82ac54603dd0-task-9-file-0(51B)
--------part-6259709d-4e7c-42ac-88f5-82ac54603dd0-task-11-file-0(51B)
----udf_logAnalyse.py(10KB)

网友评论