DATA STORAGE

Use the DATA STORAGE tab to enable/disable the collection of historical data, modify the default settings for how data is collected and aggregated, as well as manage (or reduce) the amount of data stored.

There are several options for managing the amount of history data you store in your cache tables. The data for each metric is stored in a specific cache and, when the data is not updated in a given period of time, that data is either marked as expired or, if it has been an extended period of time, it is deleted from the cache altogether. By default, metric data is set to expired when the data in the cache has not been updated within 45 seconds. Also, by default, if the data is not updated in the cache within 3600 seconds, it is removed from the cache.

There are three main approaches to reducing the amount of storage in your cache tables. You can:

Set size limits: So that when the number of rows in the cache table exceeds the limit specified here, the oldest row of data in the cache table is deleted. Set these values in the History Rows field.
Set time limits: So that when the amount of time to wait for a row in the cache table to receive a data update exceeds the limit specified here, the data is marked expired or deleted. Set these values in the Expire Time and Delete Time fields.
Compact data: Data compaction allows you to create rules that reduce the amount of stored history data to a reasonably sized sample of your data to prevent overloading your database. The rules include a schedule for automatically reducing the amount of data. Set these values in the Condense Interval, Condense Interval and Compaction Rules fields.

The DATA STORAGE tab has the following fields:

Size - Enter the maximum number of table rows to keep in memory:

History Rows - The maximum number of rows to store in the History table. If set to 0, no History table is created. The default setting is 50,000. Caches impacted by this field are SolVpns, SolClientStats, SolAppliances, SolEndpoints, SolCspfNeighbors, SolBridgeStats, SolApplianceInterfaces, SolApplianceMessageSpool, SolEndpointStats and SolAppliancesQuality.

Compaction - Define scheduled rules that reduce the amount of stored history data to a reasonably sized sample of your data to prevent overloading your database.

Condense Interval - The time interval at which the cache history is condensed. The default is 60 seconds. Caches impacted by this field are SolVpns, SolClientStats, SolAppliances, SolEndpoints, SolCspfNeighbors, SolBridgeStats, SolApplianceInterfaces, SolApplianceMessageSpool and SolEndpointStatscaches.

Condense Raw Time - The time span of raw data kept in the cache history table. The default is 1200 seconds. Caches impacted by this field are SolVpns, SolClientStats, SolAppliances, SolEndpoints, SolCspfNeighbors, SolBridgeStats, SolApplianceInterfaces, SolApplianceMessageSpool and SolEndpointStats.

Compaction Rules - This field defines the rules used to condense your historical data in the database. By default, the columns kept in history will be aggregated by averaging rows with the following rule 1h -;1d 5m;2w 15m, which means the data from 1 hour will not be aggregated (1h - rule), the data over a period of 1 day will be aggregated every 5 minutes (1d 5m rule), and the data over a period of 2 weeks old will be aggregated every 15 minutes (2w 15m rule). Caches impacted by this field are SolVpns, SolClientStats, SolAppliances, SolEndpoints, SolCspfNeighbors, SolBridgeStats, SolApplianceInterfaces, SolApplianceMessageSpool and SolEndpointStats.

Duration - Enter the amount of time between data updates before data is expired or deleted:

Expire Time - The number of seconds to wait for a data update before cached history data is shown as Expired in displays. The caches impacted by this field are SolVpns, SolBridges, SolClients, SolClientStats, SolAppliances, SolEndpoints, SolCspfNeighbors, SolBridgeStats, SolApplianceInterfaces, SolApplianceMessageSpool, SolEndpointStats, SolEnvironmentSensors and SolAppliancesQuality.

Delete Time - The number of seconds to wait for a data update before cached history data is removed from displays. The caches impacted by this field are SolVpns, SolBridges, SolEndpoints, SolBridgeStats, SolEndpointStats and SolEnvironmentSensors.

Delete Time for Clients - The number of seconds to wait for a response from clients before removing client from displays. The caches impacted by this field are SolClients and SolClientStats.

History Storage - Toggle to Enable/Disable the types of data you want the Historian to store in the history database for Solace. Each data type has a corresponding cache. Data types and the corresponding caches are:

Brokers: Cache is SolAppliances.

Bridge Stats: Cache is SolBridgeStats.

Client Stats: Cache is SolClientStats.

CSPF Neighbors: Cache is SolCspfNeighbors.

Endpoint Stats: Cache is SolEndpointStats.

Endpoints: Cache is SolEndpoints.

Interface: Cache is SolApplianceInterfaces.

Message Spools: Cache is SolApplianceMessageSpool.

Syslog Events: Cache is SyslogEvents

VPNs: Cache is SolVpns.

History Table Name Prefix - Enter a prefix to prepend to the history data table names for these metrics.