2021-07-08

Correlate system load metrics using MetricBeat

Tola Ore-Aruwaji
@thecraftman_

Working with Metricbeat and Axiom enables you to ship metrics from different sources into Axiom. With our dashboard experience, you can get a comprehensive breakdown of how your system load, metrics and data memory is performing.

From your system metrics, you can group your charts and queries, quickly identify faults and share an overview of your dashboard usage with your team members as a unified workstation.

In this guide, I will show you how to group and break down your system load metrics from Metricbeat using dashboards.

Prerequisites

  • Metricbeat installed on your machine.
  • Axiom dataset & Token.
  • Metricbeat system load module configured.

Let's dive in 🌀

  1. Visit our docs to copy, edit and configure your Metricbeat modules to ship system metrics to Axiom.
setup.ilm.enabled: false
metricbeat.config.modules:
metricbeat.modules:
- module: system
  metricsets: 
    - load  
output.elasticsearch:
    hosts: ["$YOUR_AXIOM_URL:443/api/v1/datasets/<dataset>/elastic"]
  # api_key can be your ingest or personal token
    api_key:  "user:token"

The $YOUR_AXIOM_URL is the URL of your Axiom deployment. The user:token is the ingest token for your deployment (always in a string format such as xapt-274dc2a2-5db4-4f8c-92a3-92e33bee92a7 ).

  • Run your command after entering your api_key and Axiom_URL

1

  1. To ship system metrics to Axiom you need a dataset and an Ingest token. To create a new dataset, go to Settings → Datasets on the Axiom UI.

2

  1. Generate your ingest token,
  • In the Axiom UI, click on settings, select ingest token.
  • Select Add ingest token.
  • Enter a name and description and select ADD.
  • Copy the generated token to your clipboard. Once you navigate from the page, the token can be seen again by selecting Ingest Tokens.

2

  1. Axiom dashboard lets you create control panels for your system load data, which makes it very easy for you to visualize your system load metrics and share your data with your team members.

You can create and add dashboard from your system load dataset by:

  • Adding the visualization(s) from the Analytics tab by selecting the Add to dashboard button. Adding your dashboard through this method lets you add a specific kind of virtualization gotten from running the aggregation(s) you selected.

2

  • Create a new dashboard by selecting the Dashboards feature:

2

  • You'll see a dialog that asks you for the Name and a DESCRIPTION of your new dashboard:

2

  1. After creating the Dashboard, you will see the (+) button this will enable you to add your first charts to your dashboard. Click on it to build your first query. Your charts can be Statistic Chart or Timeseries Chart.

2

  1. To create a new chart for your Dashboard, click on the (+) sign when you do so, the edit query slide-out dialog box will appear to begin the steps of creating charts, queries and graphs for your System load metrics.
  • Select your system load dataset you created in step 2.
  • Choose the specific visualization (avg, sum, count, etc) you want to see charts:
  • Here, I selected the count () aggregation to count all matching events in the systemload dataset.
  • After selecting your aggregation, click on DONE.

2

  1. Add more charts to your dashboard. Computing more charts from your system load dataset lets you understand how your system is performing in a single pane of glass.

2

  • With this, you can also figure out faults, get an overview when your load metric set has gotten to the peak.

2

  1. You can resize and move your charts after adding it by hovering your cursor to the bottom edge of on your chart. This makes sharing easy and lets everyone in your team know when changes are made and diagnose day-to-day complications quickly when they occur.

2

  1. You can change your CHART TYPE to Statistic . The Statistic chart lets you represent your charts and box plots in a number format.

With the Statistic chart, you can:

  • Get the specific value for your average system load from your numeric field.

2

  • Get the minimum value at when an uptime or down time occurred.

2

  1. You. can adjust the time interval to get a precise visualization on what happened on your system load metrics ( an hour, three hours before, 7 days ago or 30 days ago.)

2

After adding all your charts and statistics you can see all your visualizations in a single pane glass view

2

You can see how straightforward is it to group visualisations from your system load modules and metrics using Axiom Dashboard.

Any Questions? 🙂

You can read more about Axiom Metricbeat configuration on our docs

If you have specific questions or issues configuring the file, I'd love to hear about them. Contact us here or ask a question in the Axiom Community!

We do love discussing logging, observability, analytics, so feel free to hit the comments if you have any thoughts, questions, or suggestions. You can also follow us on Twitter and on our blog. And if you’ve enjoyed this post, please, take a second to share it on Twitter.

References for the road

Stay tuned for our next blog post 😇

Join us in changing how developers think about data