If you are using json_lines codec 3.2.0 (or later) with Logstash 8.16.0, 8.16.1, or 8.17.0, you may see an error similar to this one, crashing the pipelines:
unable to process event. {:message=>"input buffer full", :class=>"Java::JavaLang::IllegalStateException", :backtrace=>["org.logstash.common.BufferedTokenizerExt.extract(BufferedTokenizerExt.java:83)", "usr.share.logstash.vendor.bundle.jruby.$3_dot_1_dot_0.gems.logstash_minus_codec_minus_json_lines_minus_3_dot_2_dot_2.lib.logstash.codecs.json_lines.RUBY$method$decode$0(/usr/share/logstash/vendor/bundle/jruby/3.1.0/gems/logstash-codec-json_lines-3.2.2/lib/logstash/codecs/json_lines.rb:69)", "org.jruby.internal.runtime.methods.CompiledIRMethod.call(CompiledIRMethod.java:165)", "org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:185)",
The issue was fixed in https://github.com/elastic/logstash/pull/16760.
This problem is most likely to be seen when you are using the Logstash integration plugin to ship data between two Logstash instances, but may appear in other situations, too.
Workaround for Logstash-to-Logstash communication
The Logstash-to-Logstash issue can be mitigated by:
-
Downgrading the receiving Logstash to
8.16.2, or any Logstash in the8.15series, AND/OR -
Upgrading the Logstash integration filter of the sending Logstash to version
1.0.4.
Workaround for other json_lines codec situations
Other json_lines codec issues can be mitigated by:
-
Downgrading Logstash to
8.16.2, or any Logstash in the8.15series.
- PipelineBusV2 deadlock proofing: We fixed an issue that could cause a deadlock when the pipeline-to-pipeline feature was in use, causing pipelines (and consequently) Logstash to never terminate #16680
Elastic_integration Filter - 0.1.16
- Reflect the Elasticsearch GeoIP changes into the plugin and sync with Elasticsearch 8.16 branch #170
Xml Filter - 4.2.1
- patch rexml to improve performance of multi-threaded xml parsing #84
Beats Input - 6.9.1
- Upgrade netty to 4.1.115 #507
Http Input - 3.9.2
- Upgrade netty to 4.1.115 #183
Tcp Input - 6.4.4
- Upgrade netty to 4.1.115 #227
Http Output - 5.7.1
-
Added new development
rackupdependency to fix tests