- Logstash Reference: other versions:
- Logstash Introduction
- Getting Started with Logstash
- How Logstash Works
- Setting Up and Running Logstash
- Logstash Directory Layout
- Logstash Configuration Files
- logstash.yml
- Secrets keystore for secure settings
- Running Logstash from the Command Line
- Running Logstash as a Service on Debian or RPM
- Running Logstash on Docker
- Configuring Logstash for Docker
- Running Logstash on Windows
- Logging
- Shutting Down Logstash
- Installing X-Pack
- Setting Up X-Pack
- Upgrading Logstash
- Configuring Logstash
- Structure of a Config File
- Accessing Event Data and Fields in the Configuration
- Using Environment Variables in the Configuration
- Logstash Configuration Examples
- Multiple Pipelines
- Pipeline-to-Pipeline Communication (Beta)
- Reloading the Config File
- Managing Multiline Events
- Glob Pattern Support
- Converting Ingest Node Pipelines
- Logstash-to-Logstash Communication
- Centralized Pipeline Management
- X-Pack monitoring
- X-Pack security
- X-Pack Settings
- Managing Logstash
- Working with Logstash Modules
- Working with Filebeat Modules
- Data Resiliency
- Transforming Data
- Deploying and Scaling Logstash
- Performance Tuning
- Monitoring Logstash
- Monitoring APIs
- Working with plugins
- Input plugins
- azure_event_hubs
- beats
- cloudwatch
- couchdb_changes
- dead_letter_queue
- elasticsearch
- exec
- file
- ganglia
- gelf
- generator
- github
- google_cloud_storage
- google_pubsub
- graphite
- heartbeat
- http
- http_poller
- imap
- irc
- jdbc
- jms
- jmx
- kafka
- kinesis
- log4j
- lumberjack
- meetup
- pipe
- puppet_facter
- rabbitmq
- redis
- relp
- rss
- s3
- salesforce
- snmp
- snmptrap
- sqlite
- sqs
- stdin
- stomp
- syslog
- tcp
- udp
- unix
- varnishlog
- websocket
- wmi
- xmpp
- Output plugins
- boundary
- circonus
- cloudwatch
- csv
- datadog
- datadog_metrics
- elastic_app_search
- elasticsearch
- exec
- file
- ganglia
- gelf
- google_bigquery
- google_pubsub
- graphite
- graphtastic
- http
- influxdb
- irc
- juggernaut
- kafka
- librato
- loggly
- lumberjack
- metriccatcher
- mongodb
- nagios
- nagios_nsca
- opentsdb
- pagerduty
- pipe
- rabbitmq
- redis
- redmine
- riak
- riemann
- s3
- sns
- solr_http
- sqs
- statsd
- stdout
- stomp
- syslog
- tcp
- timber
- udp
- webhdfs
- websocket
- xmpp
- zabbix
- Filter plugins
- aggregate
- alter
- cidr
- cipher
- clone
- csv
- date
- de_dot
- dissect
- dns
- drop
- elapsed
- elasticsearch
- environment
- extractnumbers
- fingerprint
- geoip
- grok
- http
- i18n
- jdbc_static
- jdbc_streaming
- json
- json_encode
- kv
- memcached
- metricize
- metrics
- mutate
- prune
- range
- ruby
- sleep
- split
- syslog_pri
- threats_classifier
- throttle
- tld
- translate
- truncate
- urldecode
- useragent
- uuid
- xml
- Codec plugins
- Tips and Best Practices
- Troubleshooting Common Problems
- Contributing to Logstash
- How to write a Logstash input plugin
- How to write a Logstash codec plugin
- How to write a Logstash filter plugin
- How to write a Logstash output plugin
- Documenting your plugin
- Contributing a Patch to a Logstash Plugin
- Logstash Plugins Community Maintainer Guide
- Submitting your plugin to RubyGems.org and the logstash-plugins repository
- Contributing a Java Plugin
- Glossary of Terms
- Breaking Changes
- Release Notes
- Logstash 6.8.23 Release Notes
- Logstash 6.8.22 Release Notes
- Logstash 6.8.21 Release Notes
- Logstash 6.8.20 Release Notes
- Logstash 6.8.19 Release Notes
- Logstash 6.8.18 Release Notes
- Logstash 6.8.17 Release Notes
- Logstash 6.8.16 Release Notes
- Logstash 6.8.15 Release Notes
- Logstash 6.8.14 Release Notes
- Logstash 6.8.13 Release Notes
- Logstash 6.8.12 Release Notes
- Logstash 6.8.11 Release Notes
- Logstash 6.8.10 Release Notes
- Logstash 6.8.9 Release Notes
- Logstash 6.8.8 Release Notes
- Logstash 6.8.7 Release Notes
- Logstash 6.8.6 Release Notes
- Logstash 6.8.5 Release Notes
- Logstash 6.8.4 Release Notes
- Logstash 6.8.3 Release Notes
- Logstash 6.8.2 Release Notes
- Logstash 6.8.1 Release Notes
- Logstash 6.8.0 Release Notes
- Logstash 6.7.2 Release Notes
- Logstash 6.7.1 Release Notes
- Logstash 6.7.0 Release Notes
- Logstash 6.6.2 Release Notes
- Logstash 6.6.1 Release Notes
- Logstash 6.6.0 Release Notes
- Logstash 6.5.4 Release Notes
- Logstash 6.5.3 Release Notes
- Logstash 6.5.2 Release Notes
- Logstash 6.5.1 Release Notes
- Logstash 6.5.0 Release Notes
- Logstash 6.4.3 Release Notes
- Logstash 6.4.2 Release Notes
- Logstash 6.4.1 Release Notes
- Logstash 6.4.0 Release Notes
- Logstash 6.3.2 Release Notes
- Logstash 6.3.1 Release Notes
- Logstash 6.3.0 Release Notes
- Logstash 6.2.4 Release Notes
- Logstash 6.2.3 Release Notes
- Logstash 6.2.2 Release Notes
- Logstash 6.2.1 Release Notes
- Logstash 6.2.0 Release Notes
- Logstash 6.1.3 Release Notes
- Logstash 6.1.2 Release Notes
- Logstash 6.1.1 Release Notes
- Logstash 6.1.0 Release Notes
IMPORTANT: No additional bug fixes or documentation updates
will be released for this version. For the latest information, see the
current release documentation.
Logstash 6.3.1 Release Notes
editLogstash 6.3.1 Release Notes
edit- Adds a Persistent Queue repair utility, enabling self-recovery of corrupted PQs (Issue 9710).
- Fixes two separate issues in Experimental Java Execution mode where complex pipeline configurations could fail to compile (Issue 9747, Issue 9745).
- Fixes issue when running Logstash inside of a Docker container with Persistent Queue enabled where we incorrectly reported that there was insufficient space to allocate for the queue (Issue 9766).
-
Fixes issue in x-pack monitoring where
queue_push_duration_in_millis
was incorrectly reporting nanoseconds (Issue 9744). -
Fixes an issue where Logstash could fail to start when its
path.data
is a symlink (Issue 9706). -
Fixes issue with Netflow module where it could fail to populate
[geoip_dst][autonomous_system]
(Issue 9638). - Fixes a potential conflict with plugin depenencies that require Guava by explicitly loading Guava 22 (Issue 9592).
Plugins
editNetflow Codec
- Fixes exception when receiving Netflow 9 from H3C devices.
- Added support for Netflow 9 from H3C devices.
- Fixes incorrect definitions of IE 231 and IE 232.
- Fixes exceptions due to concurrent access of IPFIX templates.
- Added support for Netflow 9 reduced-size encoding support.
- Added support for Barracuda IPFIX Extended Uniflow.
Beats Input
- Fixes an issue that prevented auto-recovery in certain failure modes.
- Fixes an issue where trace-level logging omitted helpful context.
Kafka Input
- Fix race-condition where shutting down a Kafka Input before it completes startup could cause Logstash to crash.
- Upgrade Kafka client to version 1.1.0.
S3 Input
- Avoid plugin crashes when encountering bad files in S3 buckets.
- Log entry when bucket is empty.
-
Fixes
additional_settings
configuration option to properly symbolize keys for downstream library.
TCP Input
- New configuration option to set TCP keep-alive.
- Fixes an issue where the input could crash during shutdown, affecting pipeline reloads.
UDP Input
- Mitigate memory leak in JRuby’s UDP implementation.
DNS Filter
- Log timeouts as warn instead of error.
- Allow concurrent queries when cache enabled.
Elasticsearch Filter
-
Fix: The filter now only calls filter_matched on events that actually matched. This fixes issues where all events would have success-related actions happened when no match had actually happened (
add_tag
,add_field
,remove_tag
,remove_field
).
JDBC Static Filter
-
Fixed an issue where failing to specify
index_columns
would result in an obscure error message.
KV Filter
-
improves
trim_key
andtrim_value
to trim any sequence of matching characters from the beginning and ends of the corresponding keys and values; a previous implementation limited trim to a single character from each end, which was surprising. - fixes issue where we can fail to correctly break up a sequence that includes a partially-quoted value followed by another fully-quoted value by slightly reducing greediness of quoted-value captures.
Mutate Filter
-
Fix: when converting to
float
andfloat_eu
, explicitly support same range of inputs as their integer counterparts.
Elasticsearch Output
- Added support for customizing HTTP headers.
- Log an error — not a warning — when ES raises an invalid_index_name_exception.
- Improve plugin behavior when Elasticsearch is down on startup.
File Output
- Fix a bug where flush interval was being called for each event when enabled
Kafka Output
- Changed Kafka send errors to log as warn.
- Upgrade Kafka client to version 1.1.0.
S3 Output
-
Fixes
additional_settings
configuration option to properly symbolize keys for downstream library.
SQS Output
- Added the ability to send to a different account id’s queue.
On this page
Was this helpful?
Thank you for your feedback.