Statistics
The Statistics module primarily shows you how Belden Horizon Data Manager uses disk space. It allows you to view user/archive data, view disk usage by period, view disk usage by projects, and archive or purge data from this sub-module.
The Statistics module includes the following sections:
- Disk Usage: Includes User data in GB, the percentage of user data usage, the Archive data in GB, the percentage of archive data usage.
- Disk usage by data object: Includes a chart with data objects depicted where you can hover over sections of the chart to view the disk usage for each data object in GB, and a list of objects showing the data objects' size, usage in percentage format, and path. You can copy the path of a listed data object.
- Data Cumulative Chart: Shows the Periods amount of disk usage for each month in bar chart format.
- Top 10 Projects Chart: Shows the cumulative amount of disk usage for each project (up to 10 projects) in bar chart format.
- Stats By Periods: Includes a data list by company and project organized by month. You can filter the list, and archive or purge a selected data item from the list.
Access Statistics UI
To access the statistics UI:
- Log in to Belden Horizon Data Manager Admin Console.
- From the Navigation panel, select Data Lifecycle. Data Lifecycle's Statistics pane by default appears.
- Base Dir: Contains all system data and logs. The path location is /.
- Data Dir: Contains user-generated data such as backup data, archived data, update files, and Docker images. The path location is /var/lib/lem.
- User Data: (Subset of Data Dir) Contains data sent from Belden Horizon Data Operations instances.
- Archive Data: (Subset of Data Dir) Contains data on generated Archives (exported .csv.gz files).
Refer to the following actions you can take on the Belden Horizon Data Manager Admin Console Data Lifecycle's Statistics pane.
[1] View data object disk usage
[2] Copy path to clipboard
- minio-storage: Storage of BHDO backup files, archived files and templates.
- mpcs-docker-registry: Storage of BHDM Docker Registry files. See Docker Settings and Docker Images.
- clickhouse-data: Storage of Clickhouse DB. See Clickhouse. This is data related to connected Belden Horizon Data Operations instances. This data is shown in more in details in Stats By Periods.
Disk Usage statistics by period include:
- Company: The company name where the disk usage resides
- Project: The project name where the disk usage resides
- Period: The month the disk usage occurred. Disk space usage is partitioned in periods. Periods will always be one month. See below for more details.
- Size: The amount of disk usage for the selected period in KB
[3] Show filter / Hide filter: Search by Company, or Project
[4] Action menu:
- Archive Data: When data is archived, the data is extracted from the Clickhouse database server and stored as a .csv.gz file. These files can be downloaded from Management.
Note:
- Each .csv.gz file is up to ten times the size of the data size (The data size that is shown in Stats By Periods section is actually a compressed size). Before you archive, ensure the Belden Horizon Edge Manager has enough disk space to contain all the .csv.gz files that it will archive. Insufficient disk space will prevent the data from being archived. After archiving, review the list of archive files to ensure the archive operation was successful.
- Purge: This will delete the data from the Belden Horizon Data Manager. Purging data cannot be undone.
Period Explained
Belden Horizon Data Manager keeps track of disk usage in partitions of months. The tracked disk usage is only for Clickhouse data (hence all archive/purge operations is applicable for only Clickhouse data). The disk usage amount is calculated either from the instance or each individual project. Each month of disk usage is defined as a period.
For example, your Belden Horizon Data Manager has five projects. To calculate disk usage, each project will be categorized as one period for the same month. So Belden Horizon Data Manager will generate five periods for the same month, each period including one project.
As an additional example, three months have passed. For the five projects above, each of them experienced some disk usage in those three months. So you will have 15 additional periods (five projects of disk usage * 3 months).
Periods are also categorized as previous or current. If the current system date is March 2023, then all disk usage by projects during March 2023 are current periods. All periods from February 2023 and before are previous periods.