- Metricbeat Reference: other versions:
- Metricbeat overview
- Quick start: installation and configuration
- Set up and run
- Upgrade Metricbeat
- How Metricbeat works
- Configure
- Modules
- General settings
- Project paths
- Config file loading
- Output
- Kerberos
- SSL
- Index lifecycle management (ILM)
- Elasticsearch index template
- Kibana endpoint
- Kibana dashboards
- Processors
- Define processors
- add_cloud_metadata
- add_cloudfoundry_metadata
- add_docker_metadata
- add_fields
- add_host_metadata
- add_id
- add_kubernetes_metadata
- add_labels
- add_locale
- add_observer_metadata
- add_process_metadata
- add_tags
- community_id
- convert
- copy_fields
- decode_base64_field
- decode_json_fields
- decompress_gzip_field
- dissect
- dns
- drop_event
- drop_fields
- extract_array
- fingerprint
- include_fields
- registered_domain
- rename
- script
- translate_sid
- truncate_fields
- urldecode
- Autodiscover
- Internal queue
- Logging
- HTTP endpoint
- Regular expression support
- Instrumentation
- metricbeat.reference.yml
- How to guides
- Beats central management
- Modules
- ActiveMQ module
- Aerospike module
- Apache module
- App Search module
- AWS module
- AWS billing metricset
- AWS cloudwatch metricset
- AWS dynamodb metricset
- AWS ebs metricset
- AWS ec2 metricset
- AWS elb metricset
- AWS lambda metricset
- AWS natgateway metricset
- AWS rds metricset
- AWS s3_daily_storage metricset
- AWS s3_request metricset
- AWS sns metricset
- AWS sqs metricset
- AWS transitgateway metricset
- AWS usage metricset
- AWS vpn metricset
- Azure module
- Azure app_insights metricset
- Azure billing metricset
- Azure compute_vm metricset
- Azure compute_vm_scaleset metricset
- Azure container_instance metricset
- Azure container_registry metricset
- Azure container_service metricset
- Azure database_account metricset
- Azure monitor metricset
- Azure storage metricset
- Beat module
- Ceph module
- Ceph cluster_disk metricset
- Ceph cluster_health metricset
- Ceph cluster_status metricset
- Ceph mgr_cluster_disk metricset
- Ceph mgr_cluster_health metricset
- Ceph mgr_osd_perf metricset
- Ceph mgr_osd_pool_stats metricset
- Ceph mgr_osd_tree metricset
- Ceph mgr_pool_disk metricset
- Ceph monitor_health metricset
- Ceph osd_df metricset
- Ceph osd_tree metricset
- Ceph pool_disk metricset
- Cloudfoundry module
- CockroachDB module
- Consul module
- Coredns module
- Couchbase module
- CouchDB module
- Docker module
- Dropwizard module
- Elasticsearch module
- Elasticsearch ccr metricset
- Elasticsearch cluster_stats metricset
- Elasticsearch enrich metricset
- Elasticsearch index metricset
- Elasticsearch index_recovery metricset
- Elasticsearch index_summary metricset
- Elasticsearch ml_job metricset
- Elasticsearch node metricset
- Elasticsearch node_stats metricset
- Elasticsearch pending_tasks metricset
- Elasticsearch shard metricset
- Envoyproxy module
- Etcd module
- Golang module
- Google Cloud Platform module
- Graphite module
- HAProxy module
- HTTP module
- IBM MQ module
- IIS module
- Istio module
- Jolokia module
- Kafka module
- Kibana module
- Kubernetes module
- Kubernetes apiserver metricset
- Kubernetes container metricset
- Kubernetes controllermanager metricset
- Kubernetes event metricset
- Kubernetes node metricset
- Kubernetes pod metricset
- Kubernetes proxy metricset
- Kubernetes scheduler metricset
- Kubernetes state_container metricset
- Kubernetes state_cronjob metricset
- Kubernetes state_deployment metricset
- Kubernetes state_node metricset
- Kubernetes state_persistentvolumeclaim metricset
- Kubernetes state_pod metricset
- Kubernetes state_replicaset metricset
- Kubernetes state_resourcequota metricset
- Kubernetes state_service metricset
- Kubernetes state_statefulset metricset
- Kubernetes state_storageclass metricset
- Kubernetes system metricset
- Kubernetes volume metricset
- KVM module
- linux module
- Logstash module
- Memcached module
- MongoDB module
- MSSQL module
- Munin module
- MySQL module
- NATS module
- Nginx module
- Openmetrics module
- Oracle module
- PHP_FPM module
- PostgreSQL module
- Prometheus module
- RabbitMQ module
- Redis module
- Redis Enterprise module
- SQL module
- Stan module
- Statsd module
- System module
- System core metricset
- System cpu metricset
- System diskio metricset
- System entropy metricset
- System filesystem metricset
- System fsstat metricset
- System load metricset
- System memory metricset
- System network metricset
- System network_summary metricset
- System process metricset
- System process_summary metricset
- System raid metricset
- System service metricset
- System socket metricset
- System socket_summary metricset
- System uptime metricset
- System users metricset
- Tomcat module
- Traefik module
- uWSGI module
- vSphere module
- Windows module
- ZooKeeper module
- Exported fields
- ActiveMQ fields
- Aerospike fields
- Apache fields
- App Search fields
- AWS fields
- Azure fields
- Beat fields
- Beat fields
- Ceph fields
- Cloud provider metadata fields
- Cloudfoundry fields
- CockroachDB fields
- Common fields
- Consul fields
- Coredns fields
- Couchbase fields
- CouchDB fields
- Docker fields
- Docker fields
- Dropwizard fields
- ECS fields
- Elasticsearch fields
- Envoyproxy fields
- Etcd fields
- Golang fields
- Google Cloud Platform fields
- Graphite fields
- HAProxy fields
- Host fields
- HTTP fields
- IBM MQ fields
- IIS fields
- Istio fields
- Jolokia fields
- Jolokia Discovery autodiscover provider fields
- Kafka fields
- Kibana fields
- Kubernetes fields
- Kubernetes fields
- KVM fields
- linux fields
- Logstash fields
- Memcached fields
- MongoDB fields
- MSSQL fields
- Munin fields
- MySQL fields
- NATS fields
- Nginx fields
- Openmetrics fields
- Oracle fields
- PHP_FPM fields
- PostgreSQL fields
- Process fields
- Prometheus fields
- Prometheus typed metrics fields
- RabbitMQ fields
- Redis fields
- Redis Enterprise fields
- SQL fields
- Stan fields
- Statsd fields
- System fields
- Tomcat fields
- Traefik fields
- uWSGI fields
- vSphere fields
- Windows fields
- ZooKeeper fields
- Monitor
- Secure
- Troubleshoot
- Get help
- Debug
- Common problems
- "open /compat/linux/proc: no such file or directory" error on FreeBSD
- Metricbeat collects system metrics for interfaces you didn’t configure
- Metricbeat uses too much bandwidth
- Error loading config file
- Found unexpected or unknown characters
- Logstash connection doesn’t work
- Publishing to Logstash fails with "connection reset by peer" message
- @metadata is missing in Logstash
- Not sure whether to use Logstash or Beats
- SSL client fails to connect to Logstash
- Monitoring UI shows fewer Beats than expected
- Dashboard could not locate the index-pattern
- Contribute to Beats
AWS elb metricset
editAWS elb metricset
editElastic Load Balancing publishes data points to Amazon CloudWatch for your load
balancers and your back-end instances. This aws elb
metricset collects these
Cloudwatch metrics for monitoring purposes.
AWS Permissions
editSome specific AWS permissions are required for IAM user to collect AWS ELB metrics.
ec2:DescribeRegions cloudwatch:GetMetricData cloudwatch:ListMetrics tag:getResources sts:GetCallerIdentity iam:ListAccountAliases
Dashboard
editThe aws elb metricset comes with a predefined dashboard for classic ELB. For example:

Configuration example
edit- module: aws period: 300s metricsets: - elb access_key_id: '${AWS_ACCESS_KEY_ID:""}' secret_access_key: '${AWS_SECRET_ACCESS_KEY:""}' session_token: '${AWS_SESSION_TOKEN:""}' default_region: '${AWS_REGION:us-west-1}' # This module uses the aws cloudwatch metricset, all # the options for this metricset are also available here.
Metrics
editelb metricset collects Cloudwatch metrics from classic ELB, application ELB and network ELB.
Metrics for Classic ELB
editMetric Name |
Statistic Method |
BackendConnectionErrors |
Sum |
HealthyHostCount |
Maximum |
HTTPCode_Backend_2XX |
Sum |
HTTPCode_Backend_3XX |
Sum |
HTTPCode_Backend_4XX |
Sum |
HTTPCode_Backend_5XX |
Sum |
HTTPCode_ELB_4XX |
Sum |
HTTPCode_ELB_5XX |
Sum |
Latency |
Average |
RequestCount |
Sum |
SpilloverCount |
Sum |
SurgeQueueLength |
Maximum |
UnHealthyHostCount |
Maximum |
EstimatedALBActiveConnectionCount |
Average |
EstimatedALBConsumedLCUs |
Average |
EstimatedALBNewConnectionCount |
Average |
EstimatedProcessedBytes |
Average |
Metrics for Application ELB
editMetric Name |
Statistic Method |
ActiveConnectionCount |
Sum |
ClientTLSNegotiationErrorCount |
Sum |
ConsumedLCUs |
Average |
HTTP_Fixed_Response_Count |
Sum |
HTTP_Redirect_Count |
Sum |
HTTP_Redirect_Url_Limit_Exceeded_Count |
Sum |
HTTPCode_ELB_3XX_Count |
Sum |
HTTPCode_ELB_4XX_Count |
Sum |
HTTPCode_ELB_5XX_Count |
Sum |
HTTPCode_ELB_500_Count |
Sum |
HTTPCode_ELB_502_Count |
Sum |
HTTPCode_ELB_503_Count |
Sum |
HTTPCode_ELB_504_Count |
Sum |
IPv6ProcessedBytes |
Sum |
IPv6RequestCount |
Sum |
NewConnectionCount |
Sum |
ProcessedBytes |
Sum |
RejectedConnectionCount |
Sum |
RequestCount |
Sum |
RuleEvaluations |
Sum |
Metrics for Network ELB
editMetric Name |
Statistic Method |
ActiveFlowCount |
Average |
ActiveFlowCount_TLS |
Average |
ActiveFlowCount_TCP |
Average |
ActiveFlowCount_UDP |
Average |
ConsumedLCUs |
Average |
ConsumedLCUs_TCP |
Average |
ConsumedLCUs_TLS |
Average |
ConsumedLCUs_UDP |
Average |
ClientTLSNegotiationErrorCount |
Sum |
NewFlowCount |
Sum |
NewFlowCount_TLS |
Sum |
NewFlowCount_TCP |
Sum |
NewFlowCount_UDP |
Sum |
ProcessedBytes |
Sum |
ProcessedBytes_TCP |
Sum |
ProcessedBytes_TLS |
Sum |
ProcessedBytes_UDP |
Sum |
TargetTLSNegotiationErrorCount |
Sum |
TCP_Client_Reset_Count |
Sum |
TCP_ELB_Reset_Count |
Sum |
TCP_Target_Reset_Count |
Sum |
UnHealthyHostCount |
Maximum |
HealthyHostCount |
Maximum |
This is a default metricset. If the host module is unconfigured, this metricset is enabled by default.
Fields
editFor a description of each field in the metricset, see the exported fields section.
Here is an example document generated by this metricset:
{ "@timestamp": "2017-10-12T08:05:34.853Z", "aws": { "cloudwatch": { "namespace": "AWS/ELB" }, "dimensions": { "Namespace": "AWS" }, "elb": { "metrics": { "HealthyHostCount": { "max": 2 }, "Latency": { "avg": 0.000005960464477539062 }, "RequestCount": { "sum": 1 }, "SurgeQueueLength": { "max": 1 }, "UnHealthyHostCount": { "max": 0 } } } }, "cloud": { "account": { "id": "428152502467", "name": "elastic-beats" }, "provider": "aws", "region": "us-east-1" }, "event": { "dataset": "aws.elb", "duration": 115000, "module": "aws" }, "metricset": { "name": "elb", "period": 10000 }, "service": { "type": "aws" } }
On this page