- Filebeat Reference: other versions:
- Filebeat overview
- Quick start: installation and configuration
- Set up and run
- Upgrade
- How Filebeat works
- Configure
- Inputs
- Modules
- General settings
- Project paths
- Config file loading
- Output
- Kerberos
- SSL
- Index lifecycle management (ILM)
- Elasticsearch index template
- Kibana endpoint
- Kibana dashboards
- Processors
- Define processors
- add_cloud_metadata
- add_cloudfoundry_metadata
- add_docker_metadata
- add_fields
- add_host_metadata
- add_id
- add_kubernetes_metadata
- add_labels
- add_locale
- add_network_direction
- add_nomad_metadata
- add_observer_metadata
- add_process_metadata
- add_tags
- append
- community_id
- convert
- copy_fields
- decode_base64_field
- decode_cef
- decode_csv_fields
- decode_duration
- decode_json_fields
- decode_xml
- decode_xml_wineventlog
- decompress_gzip_field
- detect_mime_type
- dissect
- dns
- drop_event
- drop_fields
- extract_array
- fingerprint
- include_fields
- move_fields
- parse_aws_vpc_flow_log
- rate_limit
- registered_domain
- rename
- replace
- script
- syslog
- timestamp
- translate_sid
- truncate_fields
- urldecode
- Autodiscover
- Internal queue
- Logging
- HTTP endpoint
- Regular expression support
- Instrumentation
- Feature flags
- filebeat.reference.yml
- How to guides
- Override configuration settings
- Load the Elasticsearch index template
- Change the index name
- Load Kibana dashboards
- Load ingest pipelines
- Enrich events with geoIP information
- Deduplicate data
- Parse data using an ingest pipeline
- Use environment variables in the configuration
- Avoid YAML formatting problems
- Migrate
log
input configurations tofilestream
- Modules
- Modules overview
- ActiveMQ module
- Apache module
- Auditd module
- AWS module
- AWS Fargate module
- Azure module
- Barracuda module
- Bluecoat module
- CEF module
- Check Point module
- Cisco module
- CoreDNS module
- CrowdStrike module
- Cyberark PAS module
- Cylance module
- Elasticsearch module
- Envoyproxy Module
- F5 module
- Fortinet module
- Google Cloud module
- Google Workspace module
- HAproxy module
- IBM MQ module
- Icinga module
- IIS module
- Imperva module
- Infoblox module
- Iptables module
- Juniper module
- Kafka module
- Kibana module
- Logstash module
- Microsoft module
- MISP module
- MongoDB module
- MSSQL module
- MySQL module
- MySQL Enterprise module
- NATS module
- NetFlow module
- Netscout module
- Nginx module
- Office 365 module
- Okta module
- Oracle module
- Osquery module
- Palo Alto Networks module
- pensando module
- PostgreSQL module
- Proofpoint module
- RabbitMQ module
- Radware module
- Redis module
- Salesforce module
- Santa module
- Snort module
- Snyk module
- Sonicwall module
- Sophos module
- Squid module
- Suricata module
- System module
- Threat Intel module
- Tomcat module
- Traefik module
- Zeek (Bro) Module
- ZooKeeper module
- Zoom module
- Zscaler module
- Exported fields
- ActiveMQ fields
- Apache fields
- Auditd fields
- AWS fields
- AWS CloudWatch fields
- AWS Fargate fields
- Azure fields
- Barracuda Web Application Firewall fields
- Beat fields
- Blue Coat Director fields
- Decode CEF processor fields fields
- CEF fields
- Checkpoint fields
- Cisco fields
- Cloud provider metadata fields
- Coredns fields
- Crowdstrike fields
- CyberArk PAS fields
- CylanceProtect fields
- Docker fields
- ECS fields
- Elasticsearch fields
- Envoyproxy fields
- Big-IP Access Policy Manager fields
- Fortinet fields
- Google Cloud Platform (GCP) fields
- google_workspace fields
- HAProxy fields
- Host fields
- ibmmq fields
- Icinga fields
- IIS fields
- Imperva SecureSphere fields
- Infoblox NIOS fields
- iptables fields
- Jolokia Discovery autodiscover provider fields
- Juniper JUNOS fields
- Kafka fields
- kibana fields
- Kubernetes fields
- Log file content fields
- logstash fields
- Lumberjack fields
- Microsoft fields
- MISP fields
- mongodb fields
- mssql fields
- MySQL fields
- MySQL Enterprise fields
- NATS fields
- NetFlow fields
- Arbor Peakflow SP fields
- Nginx fields
- Office 365 fields
- Okta fields
- Oracle fields
- Osquery fields
- panw fields
- Pensando fields
- PostgreSQL fields
- Process fields
- Proofpoint Email Security fields
- RabbitMQ fields
- Radware DefensePro fields
- Redis fields
- s3 fields
- Salesforce fields
- Google Santa fields
- Snort/Sourcefire fields
- Snyk fields
- Sonicwall-FW fields
- sophos fields
- Squid fields
- Suricata fields
- System fields
- threatintel fields
- Apache Tomcat fields
- Traefik fields
- Zeek fields
- ZooKeeper fields
- Zoom fields
- Zscaler NSS fields
- Monitor
- Secure
- Troubleshoot
- Get help
- Debug
- Understand logged metrics
- Common problems
- Error extracting container id while using Kubernetes metadata
- Can’t read log files from network volumes
- Filebeat isn’t collecting lines from a file
- Too many open file handlers
- Registry file is too large
- Inode reuse causes Filebeat to skip lines
- Log rotation results in lost or duplicate events
- Open file handlers cause issues with Windows file rotation
- Filebeat is using too much CPU
- Dashboard in Kibana is breaking up data fields incorrectly
- Fields are not indexed or usable in Kibana visualizations
- Filebeat isn’t shipping the last line of a file
- Filebeat keeps open file handlers of deleted files for a long time
- Filebeat uses too much bandwidth
- Error loading config file
- Found unexpected or unknown characters
- Logstash connection doesn’t work
- Publishing to Logstash fails with "connection reset by peer" message
- @metadata is missing in Logstash
- Not sure whether to use Logstash or Beats
- SSL client fails to connect to Logstash
- Monitoring UI shows fewer Beats than expected
- Dashboard could not locate the index-pattern
- High RSS memory usage due to MADV settings
- Contribute to Beats
haproxy Module
-
haproxy.frontend_name
-
Name of the frontend (or listener) which received and processed the connection.
-
haproxy.backend_name
-
Name of the backend (or listener) which was selected to manage the connection to the server.
-
haproxy.server_name
-
Name of the last server to which the connection was sent.
-
haproxy.total_waiting_time_ms
-
Total time in milliseconds spent waiting in the various queues
type: long
-
haproxy.connection_wait_time_ms
-
Total time in milliseconds spent waiting for the connection to establish to the final server
type: long
-
haproxy.bytes_read
-
Total number of bytes transmitted to the client when the log is emitted.
type: long
-
haproxy.time_queue
-
Total time in milliseconds spent waiting in the various queues.
type: long
-
haproxy.time_backend_connect
-
Total time in milliseconds spent waiting for the connection to establish to the final server, including retries.
type: long
-
haproxy.server_queue
-
Total number of requests which were processed before this one in the server queue.
type: long
-
haproxy.backend_queue
-
Total number of requests which were processed before this one in the backend’s global queue.
type: long
-
haproxy.bind_name
-
Name of the listening address which received the connection.
-
haproxy.error_message
-
Error message logged by HAProxy in case of error.
type: text
-
haproxy.source
-
The HAProxy source of the log
type: keyword
-
haproxy.termination_state
-
Condition the session was in when the session ended.
-
haproxy.mode
-
mode that the frontend is operating (TCP or HTTP)
type: keyword
Contains various counts of connections active in the process.
-
haproxy.connections.active
-
Total number of concurrent connections on the process when the session was logged.
type: long
-
haproxy.connections.frontend
-
Total number of concurrent connections on the frontend when the session was logged.
type: long
-
haproxy.connections.backend
-
Total number of concurrent connections handled by the backend when the session was logged.
type: long
-
haproxy.connections.server
-
Total number of concurrent connections still active on the server when the session was logged.
type: long
-
haproxy.connections.retries
-
Number of connection retries experienced by this session when trying to connect to the server.
type: long
Information about the client doing the request
-
haproxy.client.ip
-
type: alias
alias to: source.address
-
haproxy.client.port
-
type: alias
alias to: source.port
-
haproxy.process_name
-
type: alias
alias to: process.name
-
haproxy.pid
-
type: alias
alias to: process.pid
Destination information
-
haproxy.destination.port
-
type: alias
alias to: destination.port
-
haproxy.destination.ip
-
type: alias
alias to: destination.ip
Contains GeoIP information gathered based on the client.ip field. Only present if the GeoIP Elasticsearch plugin is available and used.
-
haproxy.geoip.continent_name
-
type: alias
alias to: source.geo.continent_name
-
haproxy.geoip.country_iso_code
-
type: alias
alias to: source.geo.country_iso_code
-
haproxy.geoip.location
-
type: alias
alias to: source.geo.location
-
haproxy.geoip.region_name
-
type: alias
alias to: source.geo.region_name
-
haproxy.geoip.city_name
-
type: alias
alias to: source.geo.city_name
-
haproxy.geoip.region_iso_code
-
type: alias
alias to: source.geo.region_iso_code
Please add description
Fields related to the HTTP response
-
haproxy.http.response.captured_cookie
-
Optional "name=value" entry indicating that the client had this cookie in the response.
-
haproxy.http.response.captured_headers
-
List of headers captured in the response due to the presence of the "capture response header" statement in the frontend.
type: keyword
-
haproxy.http.response.status_code
-
type: alias
alias to: http.response.status_code
Fields related to the HTTP request
-
haproxy.http.request.captured_cookie
-
Optional "name=value" entry indicating that the server has returned a cookie with its request.
-
haproxy.http.request.captured_headers
-
List of headers captured in the request due to the presence of the "capture request header" statement in the frontend.
type: keyword
-
haproxy.http.request.raw_request_line
-
Complete HTTP request line, including the method, request and HTTP version string.
type: keyword
-
haproxy.http.request.time_wait_without_data_ms
-
Total time in milliseconds spent waiting for the server to send a full HTTP response, not counting data.
type: long
-
haproxy.http.request.time_wait_ms
-
Total time in milliseconds spent waiting for a full HTTP request from the client (not counting body) after the first byte was received.
type: long
TCP log format
-
haproxy.tcp.connection_waiting_time_ms
-
Total time in milliseconds elapsed between the accept and the last close
type: long