Managing diagnostic data from user interface
You can configure watsonx.data to store the diagnostic data such as queries history and query event-related information of the Presto engine (Presto) in a storage bucket in watsonx.data using the Query monitoring page. You can retrieve the history files to analyze, debug or monitor the queries from the Query workspace.
Procedure
-
From the navigation menu, select Query workspace.
-
Select the engine from Engine list and identify the Hive catalog that you created to store the QHMM data.
-
You can view the queries history and query event-related information of the Presto engine inside the tables within the catalog. Run queries to analyse the data.
-
The following tables are available by default:
query_event_raw : Includes the raw data of query events in JSON format. To view the entire event data, use the following query:
SELECT*FROM
<catalog>.<schema>
.query_event_raw;query_history : Includes the query History data. To view the entire Query History data, use the following query:
SELECT*FROM
<catalog>.<schema>
.query_history;table_stats_information_memory : Includes the memory related information. To view the memory related information, use the following query:
SELECT*from
<catalog>.<schema>
.table_stats_information_memory;
Deleting QHMM schemas and tables
Administrators can permanently delete the QHMM schemas and tables present in the QHMM enabled catalog by using the following CURL command :
curl --location --request DELETE '<SAAS_instance_url>/lakehouse/api/v2/<instance_id>/configuration/qhmm?engine_id=<engine_id>&catalog_name=<catalog_name>&schema_id=<schema_id>'
The QHMM enabled catalog must be associated to a Presto engine. If the engine is deleted or disassociated, then the catalog should be associated to next available Presto engine.
Parameter values:
<SAAS_instance_url>
: The watsonx.data access URL.<instance_id>
: The unique ID for the insatnce.<engine_id>
: The unique ID of the engine for which the schema and table information needs to be removed.<catalog_name>
: The QHMM catalog for which the schema and table information needs to be removed.<schema_id>
: The unique ID of the schema for which the table information needs to be removed.