Job Management Partner 1/Performance Management - Agent Option for Platform Description, User's Guide and Reference

[Contents][Glossary][Index][Back][Next]

Appendix A.2 Estimating disk space requirements

Disk space requirements vary according to the number of records for which performance data is collected.

This section explains how to estimate the disk space requirements of PFM - Agent for Platform.

Organization of this subsection
(1) Disk space requirements of the entire system
(2) Disk space requirements of the Store database (Store 1.0)
(3) Disk space requirements of the Store database (Store 2.0)

(1) Disk space requirements of the entire system

Table A-8 Disk space requirements of the entire system


Status of PFM - Agent for Platform		 Disk space requirements (units: MB)
HP-UX Solaris AIX Linux (x86), Linux (x64) Linux (IPF)
Installation completed# 20 15 38 10 15
Operation in the initial state 155 150 173 145 150
Other operating statuses 105 + W 100 + W 123 + W 95 + W 100 + W

Legend:
W: Disk space requirements of the Store database

#
The disk space requirements during installation of PFM - Agent for Platform are twice as large as the values shown in the table.

The disk space requirements of the Store database are computed by adding together the disk space requirements of PI-type records, PD-type records, and PL-type records.

For the formula for estimating the disk space requirements by record type, see below.

(2) Disk space requirements of the Store database (Store 1.0)

The following explains the disk space requirements of the Store database (Store 1.0).

(a) Formula for estimating disk space requirements

In the Store database, records of the same type are stored in the same file. The table below shows the disk space requirements of the Store database (Store 1.0) by record type.

Table A-9 Disk space requirements of the Store database by record type

Record type Disk space requirements estimation formula (units: bytes)
PI record type (X1 + ..... + Xa + 3,500 x a)
PD record type (Y1 + ..... + Yb + 700 x b)
PL record type (Z1 + ..... + Zc + 700 x c)

Legend:
X: Disk space requirements of each record for which historical data is collected as PI-type records

X is computed as follows:
X = {e x f + (d + 1,900) x {(e x f)/(65,250 - d) + 1}#1} x g x 1.5
Y: Disk space requirements of each record for which historical data is collected as PD-type records

Y is computed as follows:
Y ={e x h + (d + 1,900) x {(e x f)/(65,250 - d) + 1}#1 x (h/f)#2} x 1.5
Z: Disk space requirements of each record for which historical data is collected as PL-type records.

Z is computed as follows:
Z = {e x h + (d + 1,900) x {(e x f)/(65,250 - d) + 1}#1 x (h/f)#2} x 1.5
a: Number of records for which historical data is collected as PI-type records
For example, 2 if you set to save PI_CPUP and PI_DEVD.
b: Number of records for which historical data is collected as PD-type records
For example, 2 if you set to save PD_FSL and PD_FSR.
c: Number of records for which historical data is collected as PL-type records
d: Size of the fixed portion of each record for which historical data is collected#3
e: Size of the variable portion of each record for which historical data is collected#3
f: Number of instances in the record for which historical data is collected (1 for a single-instance record. See Table A-10 for multiple instances)#4
g: Number of saved records for which historical data is collected (the number of instances is not considered)#5
h: Number of retained records for which historical data of PD-type records and PL-type records is collected#6

#1
Truncate the computation result of {(e x f)/(65,250 - d) + 1} at the decimal point.

#2
Truncate the computation result of (h/f) at the decimal point.

#3
For details about the fixed and variable part size of each record, see Record size for each record in 6. Records.

#4
You can use the commands listed in the following table to estimate the number of instances in each record.

Table A-10 Number of instances in each record


Record name		 Command
Explanation
HP-UX Solaris AIX Linux
Application Summary (PD_APP) None None None None The number registered in the Application monitoring setting for the Agent Collector properties
CPU - Per Processor Detail (PI_CPUP) sar -u -M interval-count sar -u interval-count sar -w -P ALL interval-count top -c The number of CPUs returned by this command
Device Detail (PI_DEVD) ioscan -fnC disk iostat -x iostat -d interval-count iostat -d In HP-UX, Solaris, and AIX, the number of disk devices returned by this command.
In Linux, the number of disk devices, excluding partitions, returned by this command.
Device Summary (PI_DEVS) None None None None 1, since this is a single-instance record
File System Detail - Local (PD_FSL) df df df df The number of file systems returned by this command, which is the number of file systems that do not accompany the host name (If the mount command is executed with the bind option specified, the value returned by the df command differs from the number of PFM - Agent for Platform instances.)
File System Detail - Remote (PD_FSR) df df df df The number of file systems returned by this command, which is the number of file systems that accompany the host name
Logged Messages (PL_MESS) None None None None The number of lines written in the file specified in the Messages File property or event file.
In Linux, however, the number of instances cannot be obtained because this functionality is not supported.
Network Interface Detail (PI_NIND) lanscan netstat -in ifconfig -a netstat -ni In HP-UX, the number of physical interfaces returned by this command + 1.
In Solaris, AIX, and Linux, the number of physical interfaces returned by this command.
Network Interface Summary (PI_NINS) None None None None 1, since this is a single-instance record
Process Detail (PD) ps -ef ps -ef ps -A ps -ef The number of processes returned by this command
Process Detail Interval (PD_PDI) ps -ef ps -ef ps -A ps -ef The number of processes returned by this command
Process Summary (PD_PDS) None None None None 1, since this is a single-instance record
Program Summary (PD_PGM) ps -e ps -e ps -A ps -e The combined number of different CMDs displayed by this command
System Summary Overview (PI) None None None None 1, since this is a single-instance record
Terminal Summary (PD_TERM) ps -e ps -e ps -Af ps -e The sum of the number of different TTYs displayed by this command
User Data Detail (PD_UPD) None None None None The number of user-defined data items converted by the jpcuser command
User Data Detail - Extended (PD_UPDB) None None None None The number of user-defined data items converted by the jpcuser command
User Data Interval (PI_UPI) None None None None The number of user-defined data items converted by the jpcuser command
User Data Interval - Extended (PI_UPIB) None None None None The number of user-defined data items converted by the jpcuser command
User Summary (PD_USER) ps -ef ps -ef ps -ef ps -ef The sum of the number of different RUIDs displayed by this command
Workgroup Summary (PI_WGRP) None None None None The number of workgroups specified in the workgroup file + 1

#5
For PI-type records, because collected data is automatically summarized by certain segments (hour, day, week, month, and year basis), you need to calculate the number of instances by taking into consideration the number of saved records in terms of minutes, hours, days, weeks, months, and years. The following table shows the default retention period and number of saved records.

Table A-11 Default retention period and the default number of records saved

Data type Retention period Number of records#6 saved (when the collection interval is 1 minute)
Minute-by-minute 1 day 1,440
Hourly 7 days 168
Daily 1 year 366
Weekly 1 year 52
Monthly 1 year 12
Yearly No limit (number-of-years-collected) x 1

#6
For details about the number of saved records, see F.1 Agent Store service properties.

(b) Estimation examples (Store database free space)

The following provides an example of estimating the disk space requirements of the Store database (Store 1.0).

Estimation example 1
On HP-UX, for the PI record type CPU - Per Processor Detail (PI_CPUP), if PI record types other than PI_CPUP are not set to be saved, assume that variables a to g shown in Table A-9 have the following values:
a = 1
d = 681
e = 376
f = 2
g = 2,039

f is computed as follows:
Execute the sar -u -M interval-count command to check the result. If the result is 2 (see Table A-10):
f = 2

g is computed as follows:
For PI_CPUP, when the collection interval is one minute, the yearly collection period is one year, and the retention period is set as shown in #5 of Table A-10, g is computed as follows:
1,440 + 168 + 366 + 52 + 12 + 1 = 2,039 records
g = 2,039

X is computed as follows:
X = {e x f + (d + 1,900) x {e x f/(65,250 - d) + 1}} x g x 1.5
X = {376 x 2 + (681 + 1,900) x {376 x 2/(65,250-681) + 1}} x 2,039 x 1.5
 = {752 + (2,581) x {752/64,569 + 1}} x 3,058.5
 = {752 + 2,581 x 1} x 3,058.5
 = 3,333 x 3,058.5
 = 10,285,917 (bytes)
[Figure] 9.8 (MB)

Estimation example 2
On HP-UX, for the PD record type File System Detail - Local (PD_FSL) if PD record types other than PD_FSL are not set to be saved, assume that variables b to h shown in Table A-9 have the following values:
b = 1
d = 681
e = 1,216
f = 3
h = 2,232

f is computed as follows:
Execute the df command. If the result is 3 (see Table A-10):
f = 3

h is computed as follows:
The default number of records saved for the retention period is 10,000.
To save month data by setting the collection interval to 3,600 seconds:
h = 24 records (for one day) x 31 (for one month) x 3 (f value) = 2,232 records
h = 2,232 records

Y is computed as follows:
Y = {e x h + (d + 1,900) x {e x f/(65,250 - d) + 1} x (h/f)} x 1.5
Y = {1,216 x 2,232 + (681 + 1,900)}
x {1,216 x 3/(65,250 - 681) + 1 x (2,232/3)} x 1.5
= {1,216 x 2,232 + 2,581 x {3,648/64,569 + 1} x 744} x 1.5
= {2,714,112 + 2,581 x 1 x 744} x 1.5
= {2,714,112 + 1,920,264} x 1.5
= 4,634,376 x 1.5
= 6,951,564 (bytes)
[Figure] 7 (MB)

(3) Disk space requirements of the Store database (Store 2.0)

The following explains the disk space requirements of the Store database (Store 2.0).

(a) Formula for estimating disk space requirements, number of files, and number of directories

The following explains how to estimate the disk space requirements, the number of files, and the number of directories.

n Disk space requirements

The disk space requirements of the Store database are the sum of the disk space requirements for each disk type. For the PI record type, the disk space requirements are also the sum of the disk space requirements for each summarization category.

Note:
When performance data is stored in the Store database, several fields are added. Because the added fields are included in the disk space requirements, there is no need to make a new estimate. The fields added to all records are the same as the fields in Store 1.0. For details, see (2) Disk space requirements of the Store database (Store 1.0).

Formula for estimating disk space requirement X by record type (units: bytes)
X = {(e + 2) x f + (d + 60) x {((e + 2) x f)/(65,250 - d) + 1}#1} x a/b x (c + 1) x 1.1
a: This value varies depending on the record type and the summarization category. See Table A-12.
b: This value varies depending on the record type and the summarization category. See Table A-12.#2
c: Historical-data retention period setting.#3 The unit to be specified varies depending on the record type and the summarization category. For details about the units, see Table A-12.
d: Size of the fixed portion of each record for which historical data is collected.#4
e: Size of the variable portion of each record for which historical data is collected.#4
f: Number of instances in the record for which historical data is collected (1 for a single-instance record).#5 When the number of instances is 2 or greater, the number is rounded to the nearest multiple of 4. For example, if the number of instances is 2, the value of f is 4. If the number of instances is 13, the value of f is 16. If the number of instances is 1, the value of f is 1.

Table A-12 Values set in a, b, and c

Record type Summarization category a b c
PI Minute 1,440 1 + (g - 1)/60#2 Retention period (units: day)
Hour 24 1 + (g - 1)/3,600#2 Retention period (units: day)
Day 7 1 + (g - 1)/86,400#2 Retention period (units: week)
Week 1 1 + (g - 1)/604,800#2 Retention period (units: week)
Month 1 1 + (g - 1)/2,592,000#2 Retention period (units: month)
Year 1 1 + (g - 1)/31,622,400#2 Retention period (units: year)
PD -- 1,440 g/60 Retention period (units: day)
PL -- 1,440 g/60 Retention period (units: day)

Legend:
g: Setting of the historical data collection interval (units: second)
--: Not applicable

#1
Truncate the computation result of {((e + 2) x f)/(65,250 - d) + 1} at the decimal point.

#2
For PI-type records, truncate the computation result of b at the decimal point.

#3
Tables A-13 to A-15 show the default retention periods for Store 2.0.

#4
For details about the size of the fixed portion and variable portion of each record, see the description about record size in 6. Records.

#5
For details about the number of instances for each record, see (2) Disk space requirements of the Store database (Store 1.0).

Table A-13 Default retention period for the PI record type

Data type Retention period
By the minute 1 day
Hourly 7 days
Daily 54 weeks
Weekly 54 weeks
Monthly 12 months
Yearly No limit

Table A-14 Default retention period for the PD record type

Record name Retention period (units: day)
PD 2
PD_FSL 31
PD_FSR 31
PD_IPCS 366
PD_MSQD 366
PD_PDI 2
PD_PDS 2
PD_PGM 2
PD_SEMD 366
PD_SHMD 366
PD_TERM 2
PD_UFSQ 366
PD_UFSS 366
PD_UPD 10
PD_UPDB 10
PD_USER 10
PD_APP 10

Table A-15 Default retention period for the PL record type

Record name Retention period (units: day)
PL_MESS 10

n Number of files

The following shows the formula for estimating the number of files N that are created in the Store database:

N = 20 + 2 x (
  (A11 + A12 + ... + A1m + m) +
  (A21 + A22 + ... + A2m + m) +
  (A31 + A32 + ... + A3m + m) +
  (A41 + A42 + ... + A4m + m) +
  (A51 + A52 + ... + A5m + m) +
  (11 x m) + 
  (B1 + B2 + ... + Bn + n) +
  (C1 + C2 + ... + Co + o)
  )

m: Number of records collected as PI-type records

n: Number of records collected as PD-type records

o: Number of records collected as PL-type records

A11 to A1m: Minute-by-minute record retention period setting for each PI-type record (units: day)

A21 to A2m: Hourly record retention period setting for each PI-type record (units: day)

A31 to A3m: Daily record retention period setting for each PI-type record (units: week)

A41 to A4m: Weekly record retention period setting for each PI-type record (units: week)

A51 to A5m: Monthly record retention period setting for each PI-type record (units: month)

B1 to Bn: Retention period setting for each PD-type record (units: day)

C1 to Co: Retention period setting for each PL-type record (units: day)

n Number of directories

The following shows the formula for estimating the number of directories N that are created in the Store database.

N = 25 + 2 x ((A1max) + (A2max) + (A3max) + (A4max) + (A5max) + 11 + (Bmax) + (Cmax))

A1max: Maximum retention period setting for the data of the records which are collected as PI-type records and whose summarization category is Minute (units: day)

A2max: Maximum retention period setting for the data of the records which are collected as PI-type records and whose summarization category is Hour (units: day)

A3max: Maximum retention period setting for the data of the records which are collected as PI-type records and whose summarization category is Day (units: week)

A4max: Maximum retention period setting for the data of the records which are collected as PI-type records and whose summarization category is Week (units: week)

A5max: Maximum retention period setting for the data of the records which are collected as PI-type records and whose summarization category is Month (units: month)

Bmax: Maximum retention period setting for each PD-type record (units: day)

Cmax: Maximum retention period setting for each PL-type record (units: day)

n Number of files that the Store service opens

The following shows the formula for estimating the number of files N that the Store service opens:

N = 20 + 2 x (6 x l + m + n)

l: Number of records collected as PI-type records

m: Number of records collected as PD-type records

n: Number of records collected as PL-type records

(b) Examples of estimating disk space requirements

The following provides an example of estimating the disk space requirements of the Store database (Store 2.0) of PFM - Agent for Platform.

n Disk space requirements

This example shows how to estimate the disk space requirements when collection of the PI_DEVD and PD_PDI records is specified.

The following explains how to estimate the disk space requirements of the PI_DEVD record. The variables shown in the formula in (a) Formula for estimating disk space requirements, number of files, and number of directories have the following values: 

d = 681 (bytes)
e = 405 (bytes)
f = 4
g = 60 (seconds)

The following shows how to calculate the disk space requirements by record type, such as a record collected by the minute or hourly.

Minute-by-minute record
The variables have the following values:
a = 1,440
b = 1 + (60-1)/60
  = 1.98... 
  = 1 (Digits after the decimal point are truncated.)
c = 3 (days)
The formula is as follows:
X (minute) = {(405 + 2) x 4 + (681 + 60) x {((405 + 2) x 4)/(65,250 - 681) + 1}} x 1,440/1 x (3 + 1) x 1.1
      = {1,628 + 741 x 1} x 6,336
      = 2,369 x 6,336
      = 15,009,984 (bytes) = Approximately 15 (MB)

Hourly record
The variables have the following values:
a = 24
b = 1 + (60-1)/3,600
  = 1.01...
  = 1 (Digits after the decimal point are truncated.)
c = 3 (days)
The formula is as follows:
X (hour) = {(405 + 2) x 4 + (681 + 60) x {((405 + 2) x 4)/(65,250 - 681) + 1}} x 24/1 x (3 + 1) x 1.1
      = {1,628 + 741 x 1} x 105.6
      = 2,369 x 105.6
      = 250,166.4 (bytes) = Approximately 0.3 (MB)

Daily record
The variables have the following values:
a = 7
b = 1 + (60 - 1)/86,400
  = 1.00...
  = 1 (Digits after the decimal point are truncated.)
c = 1 (week)
The formula is as follows:
X (day) = {(405 + 2) x 4 + (681 + 60) x {((405 + 2) x 4)/(65,250 - 681) + 1}} x 7/1 x (1 + 1) x 1.1
      = {1,628 + 741 x 1} x 15.4
      = 2,369 x 15.4
      = 36,482.6 (bytes) = Approximately 0.04 (MB)

Weekly record
The variables have the following values:
a = 1
b = 1 + (60 - 1)/604,800
  = 1.00...
  = 1 (Digits after the decimal point are truncated.)
c = 1 (week)
The formula is as follows:
X (week) = {(405 + 2) x 4 + (681 + 60) x {((405 + 2) x 4)/(65,250 - 681) + 1}} x 1/1 x (1 + 1) x 1.1
      = {1,628 + 741 x 1} x 2.2
      = 2,369 x 2.2
      = 5,211.8 (bytes) = Approximately 0.005 (MB)

Monthly record
The variables have the following values:
a = 1
b = 1 + (60 - 1)/2,592,000
  = 1.00...
  = 1 (Digits after the decimal point are truncated.)
c = 1 (month)
The formula is as follows:
X (month) = {(405 + 2) x 4 + (681 + 60) x {((405 + 2) x 4)/(65,250 - 681) + 1}} x 1/1 x (1 + 1) x 1.1
      = {1,628 + 741 x 1} x 2.2
      = 2,369 x 2.2
      = 5,211.8 (bytes) = Approximately 0.005 (MB)

Yearly record
The variables have the following values:
a = 1
b = 1 + (60 - 1)/31,622,400
  = 1.00...
  = 1 (Digits after the decimal point are truncated.)
c = 10 (fixed)
The formula is as follows:
X (year) = {(405 + 2) x 4 + (681 + 60) x {((405 + 2) x 4)/(65,250 - 681) + 1}} x 1/1 x (10 + 1) x 1.1
      = {1,628 + 741 x 1} x 12.1
      = 2,369 x 12.1
      = 28,664.9 (bytes) = Approximately 0.03 (MB)

From the above calculations, the disk space requirements of the PI_DEVD record are obtained as follows:

X (total) = X (minute) + X (hour) + X (day) + X (week) + X (month) + X (year)
         = 15.38 (MB)
         = Approximately 15 (MB)

The following explains how to estimate the disk space requirements of the PD_PDI record.

The variables have the following values:

a = 1,400
b = 60/60 = 1
c = 10 (days)
d = 681 (bytes)
e = 966 (bytes)
f = 12
g = 60 (seconds)

The formula is as follows:

X = {(966 + 2) x 12 + (681 + 60) x {((966 + 2) x 12)/(65,250 - 681) + 1} x 1,400/1 x (10 + 1) x 1.1
 = {11,616 + 741 x 1}} x 17,424
 = 12,357 x 17,424
 = 215,308,368 (bytes) = Approximately 215 (MB)

The disk space requirements are therefore PI_DEVD + PD_PDI = 230 MB.

n Number of files

This example shows how to estimate the number of files when the PI, PI_DEVD, PD, and PD_PDI records are to be collected. The variables shown in the formula in (a) Formula for estimating disk space requirements, number of files, and number of directories have the following values:

m = 2
n = 2
o = None
A11 to A1m = 3 (days)
A21 to A2m = 3 (days)
A31 to A3m = 1 (week)
A41 to A4m = 1 (week)
A51 to A5m = 1 (month)
B1 to Bn = 10 (days)
C1 to Co = Not required

The following shows the formula for estimating the number of files N that are created in the Store database:

N = 20 + 2 x (
         (A11 + A12 + ... + A1m + m) +
         (A21 + A22 + ... + A2m + m) +
         (A31 + A32 + ... + A3m + m) +
         (A41 + A42 + ... + A4m + m) +
         (A51 + A52 + ... + A5m + m) +
         (11 x m) + 
         (B1 + B2 + ... + Bn + n) +
         (C1 + C2 + ... + Co + o)
         )
= 20 + 2 x {
         [3 (for PI) + 3 (for PI_DEVD) + 2] +
         [3 (for PI) + 3 (for PI_DEVD) + 2] +
         [1 (for PI) + 1 (for PI_DEVD) + 2] +
         [1 (for PI) + 1 (for PI_DEVD) + 2] +
         [1 (for PI) + 1 (for PI_DEVD) + 2] +
         [11 x 2] +
         [10 (for PD) + 10 (for PD_PDI) + 2]
         }
 = 20 + 2 x {8 + 8 + 4 + 4 + 4 + 22 + 22}
 = 164

n Number of directories

This example shows how to estimate the number of directories when the PI, PI_DEVD, PD, and PD_PDI records are to be collected.

The variables shown in the formula for the number of directories in (a) Formula for estimating disk space requirements, number of files, and number of directories have the following values:

A1max = 3 (days) (Principle: When the setting for PI is 2 days and the setting for PI_DEVD is 3 days, 3 days is used.)
A2max = 3 (days)
A3max = 1 (week)
A4max = 1 (week)
A5max = 1 (month)
Bmax = 10 (days) (Principle: When the setting for PD_PDI is 8 days and the setting for PD is 10 days, 10 days is used.)
Cmax = None

The following shows the formula for estimating the number of directories N that are created in the Store database:

N = 25 + 2 x ((A1max) + (A2max) + (A3max) + (A4max) + (A5max) + 11 + (Bmax) + (Cmax))
  = 25 + 2 x (3 + 3 + 1 + 1 + 1 + 11 + 10 + 0) = 85

n Number of files that the Store service opens

This example shows how to estimate the number of files that the Store service opens when the PI, PI_DEVD, PD, and PD_PDI records are to be collected.

The variables shown in the estimation formula in (a) Formula for estimating disk space requirements, number of files, and number of directories have the following values:

l = 2
m = 2
n = 0

The following shows the formula for estimating the number of files N that the Store service opens:

N = 20 + 2 x (6 x l + m + n)
  = 20 + 2 x (6 x 2 + 2 + 0) = 48

[Contents][Back][Next]

[Trademarks]

All Rights Reserved. Copyright (C) 2009, Hitachi, Ltd.