AKA ES Nginx Logs
由神翔,青空,睿希完成
一、介绍
- 由Q群:IT信息文案策划中心 制作
- https://www.akiraka.net
二、Update Logs
2020-04-23
- 新增今日访问pv、今日访问uv、7天访问pv图表
- 针对k8s ingress nginx 日志已测试ok。
- k8s 部署文档正在写
2020-09-30
- 反馈导入必须有 Prometheus 现已移除 Prometheus
三、ELK Version
Name | 7.3.1 | 7.6.1 | 7.9.1 |
---|---|---|---|
kibana | ok | ok | ok |
filebeat | ok | ok | ok |
logstash | ok | ok | ok |
elasticsearch | ok | ok | ok |
四、Error
- 字段错误
logstash 引索必须是 logstash-* 开头,否则需要修改logstash 才可正常
Nginx 字段
- 请保证 nginx 使用该字段,名称如果有修改,grafana 模板需要做一定修改
log_format aka_logs
'{"@timestamp":"$time_iso8601",'
'"host":"$hostname",'
'"server_ip":"$server_addr",'
'"client_ip":"$remote_addr",'
'"xff":"$http_x_forwarded_for",'
'"domain":"$host",'
'"url":"$uri",'
'"referer":"$http_referer",'
'"args":"$args",'
'"upstreamtime":"$upstream_response_time",'
'"responsetime":"$request_time",'
'"request_method":"$request_method",'
'"status":"$status",'
'"size":"$body_bytes_sent",'
'"request_body":"$request_body",'
'"request_length":"$request_length",'
'"protocol":"$server_protocol",'
'"upstreamhost":"$upstream_addr",'
'"file_dir":"$request_filename",'
'"http_user_agent":"$http_user_agent"'
'}';
filebeat 配置
#=========================== Filebeat inputs =============================
filebeat.inputs:
# 收集nginx日志
- type: log
enabled: true
paths:
- /data/wwwlogs/*_nginx.log
# 日志是json开启这个
json.keys_under_root: true
json.overwrite_keys: true
json.add_error_key: true
#-------------------------- Redis output ------------------------------
output.redis:
hosts: ["host"] #输出到redis的机器
password: "password"
key: "nginx_logs" #redis中日志数据的key值ֵ
db: 0
timeout: 5
logstash 配置
图片
Data source config
Collector config:
Upload an updated version of an exported dashboard.json file from Grafana
Revision | Description | Created | |
---|---|---|---|
Download |
Google Cloud logs
Easily monitor Google Cloud logs with Grafana Cloud's out-of-the-box monitoring solution.
Learn moreGet this dashboard
Import the dashboard template
or