Skip to main content

 

Scuba Docs

Ingest Scuba logs

You can use Scuba structured logs to analyze how your organization is using Scuba. Use the log data to learn more about the queries that your users are running, both the type of query and performance metrics, as well as the overall data ingestion process.

This process is called loopback, because you are ingesting Scuba structured logs back into Scuba (looping them back into the system) for analysis.

Scuba structured logs for query usage

Scuba can ingest its structured logs for query usage to analyze how Scuba is used within your company. The following task demonstrates how to create a table, set up loopback, and then restart the Scuba service.

To loopback structured logs for query usage, do the following:

  1. Create a table to contain loopback query structured log data, using the following command.
ia table create event <query_table_name> timestamp milliseconds -s user string
  1. Set up loopback, using the following command.
ia settings update usage_loopback query_table <query_table_name>
  1. Log into the API node and restart the Scuba service with the following command.
iactl restart

Scuba structured logs for monitoring ingest

You can analyze Scuba structured logs to monitor Scuba ingest performance. The following task demonstrates how to create a table, set up ingest, and then restart the Scuba service.

To loopback structured logs for ingest, do the following:

  1. Create a table to contain the loopback structured log data, using the following command.
ia table create event <ingest_table_name> timestamp milliseconds -s pipeline_id int
  1. Set up loopback, using the following command.
ia settings update usage_loopback ingest_table <ingest_table_name>
  1. Log into ALL import nodes and restart the Scuba service with the following command.
iactl restart

 

  • Was this article helpful?