Hitachi

JP1 Version 13 JP1/Integrated Management 3 - Manager Configuration Guide


1.19.3 Setup When Using JP1/IM - Agent as an agent

Organization of this subsection

(1) Changing the settings of JP1/IM agent management base

(a) Common way to setup

■ To edit the configuration files (for Windows)

Configuration file is located in the following directories:

OS

Storage destination

Windows

Manager pass\conf\imdd\plugin\jp1pccs\

Manager pass\conf\imddimagent\

Linux

/etc/opt/JP1imm/conf/imdd/plugin/jp1pccs/

/etc/opt/JP1imm/conf/imdd/imagent/

There are two ways to change configuration file:

  • The way to use integrated operation viewer

  • The way to Login the host and Setup

For configuration file that can be edited when integrated operation viewer is used, refer to the notes of the definition File for JP1/IM - Manager in "List of Definition File" (2. Definition File) in the manual "JP1/Integrated Management 3 - Manager Command, Definition File and API Reference". If you want to Login and Setup the host, all configuration files can be edited.

The following are the steps for setting:

- How to use integrated operation viewer

  1. Download configuration file from integrated operation viewer.

    If you add File, it does not need to be downloaded.

  2. Edit the downloaded File.

  3. Use integrated operation viewer to upload the edited File.

    Setup is automatically reflected when uploaded.

- How to Login and Setup the Hosts

  1. Login to the Integration Manager host.

  2. Stop JP1/IM - Manager servicing.

    For details about how to stop the service, see "3.2 Stopping JP1/IM - Manager" in the manual JP1/Integrated Management 3 - Manager Administration Guide.

  3. To edit the configuration file

  4. Start the service.

    For details about how to start the service, see "3.1 Starting JP1/IM - Manager" in the manual JP1/Integrated Management 3 - Manager Administration Guide.

(b) Change settings of JP1/IM - Agent management base (for Windows)

The following describes how to change setup of JP1/IM - Agent management base (imbase,imbaseproxy).

■ Change configuration file of JP1/IM - Agent management base

JP1/IM - Agent management base's configuration file are imbase configuration file (jpc_imbase.json) and imbaseproxy configuration file (.json).

For configuration file editing procedure, see 1.19.3(1)(a) Common way to setup.

■ Changing JP1/IM - Agent management base ports

Perform the following steps:

  1. Stop JP1/IM - Manager.

  2. Change the listen port number of JP1/IM - Agent management base.

    The listen Port number is set to JP1/IM - Agent management base's imbase configuration file (jpc_imbase.json) and imbaseproxy configuration file (jpc_ imbaseproxy.json) port member. Change this to the new Port number.

    For Details on imbase configuration file and imbaseproxy configuration file, see "the appropriate File (2. Definition File)" in "JP1/Integrated Management 3 - Manager Command, Definition File and API Reference" manual.

  3. Starts JP1/IM - Manager.

■ Setup the certificate

Perform the following steps:

  1. Stop JP1/IM - Manager.

  2. Change Server certificate and keying File for JP1/IM - Agent management base.

    The listen port number is set to imbase configuration file (jpc_imbase.json) and imbaseproxy configuration file (jpc_imbaseproxy.json) cert_file or key_file member.

    Updates Setup Value of cert_file or key_file, or File that you set itself.

    For setails of imbase configuration file and imbaseproxy configuration file, refer to the explanation of appropriate File in "2. Definition File" in "JP1/Integrated Management 3 - Manager Command, Definition File and API Reference".

  3. Starts JP1/IM - Manager.

(c) Creation and import of IM management node tree data (for Windows) (mandatory)

Follow the steps below to create and import IM management node tree.

  1. Perform the steps in integrated agent host.

    Follow steps 1 to 4 in 1.21.2(10) Creation and import of IM management node tree data (for Windows) (mandatory).

  2. Run JP1/IM - Manager's jddcreatetree command/create IM managed node-related API.

    If the execution fails, follow the instructions in Message and execute again.

  3. When add-on program or user-defined Prometheus or Fluentd configuration is changed or deleted, IM management node-related files described in "Editing IM management node-related files" below is edited (it is not necessary to perform it when building a new system).

  4. Execute jddupdatetree command of JP1/IM - Manager (configuration change mode) or the import API of IM control node-related information.

    If the execution fails, follow the instructions in Message and execute again.

  5. Display integrated operation viewer and verify that IM management node is created correctly.

    If it is not created correctly, review settings in integrated agent, add-on program, user-defined Prometheus or Fluentd that was not created, and then repeat the procedure from step 2.

- Editing IM management node-related files

If add-on program, or user-defined Prometheus or Fluentd configuration changes (configuration changes or deletions) are made, a pre-configuration IM management node is created until those sample are removed from Trend data Management Database. For the timing when trend data is deleted, see 2.7.2 Trend data Management Database in JP1/Integrated Management 3 - Manager Overview and System Design Guide manual.

If you do not want to create a pre-configuration IM management node, you can modify IM management node file and IM management node tree file output by jddcreatetree command. For details on IM management node tree file, see "3.5.3 IM management node-related files" in JP1/Integrated Management 3 - Manager Overview and System Design Guide manual. Copy the file to make a backup before editing.

- Editing IM management node Files

Jddcreatetree command-generated IM management node file (filename: imdd_node_HITACHI_JP1_JPCCS_CONFINFO_JP1 hostname.json) also displays /IM-Manager's pre-configuration OOE. When the setting is changed, SID of the configuration information is the same before and after the change, and SID of the second and subsequent configuration information is output with the suffix "-xx"(xx are numbered from 01 to 99).

If you do not need IM management node prior to the configuration change, remove IM management node object from jddcreatetree before the configuration change by editing IM management node file. The format of IM management node file is shown below.

{
  "meta":{
    ...
  },
  "simtData": [
    Objects in IM management node,
    ...
  ]
}

An object of IM management node is an element of an array of simtData in the following format:

  • IM management node Object-Format

{
  "sid": "SID Configuration",
  "value": {
    ...
    "property": {
      Displayed in IM management node Properties,
    },
    "jp1im_TrendData_labels": {
      Values for identifying trend data
    },
    ...
  }
}

Review the values that you want to see in the properties of IM management node and the values to identify the trend data. Remove the objects in IM management node prior to the configuration change. For the values displayed in the properties of IM management node, see "9.5.1(1)(f) Property Display" and "12.5.1(1)(b) Property Display" in the manual JP1/Integrated Management 3 - Manager Overview and System Design Guide. The values shown in the following table are set as values for identifying trend data.

Key

Value Description

jp1_pc_prome_hostname

Hostname of Prometheus server

This is the setting for the jp1_pc_prome_hostname of Prometheus configuration file. For log-monitored SID, this key/value is not displayed.

job

Scrape job name

This is the setting for job_name in Prometheus configuration file. For log-monitored SID, or SID of kubernetes, this key/value is not printed.

instance

Instance Name

This is specified in targets of the discovery configuration file.

jp1_pc_nodelabel

Label-name of IM management node

This is the scrape_configs or metrics_scrape_configs of Prometheus configuration file or the jp1_pc_nodelabel tag for AWS resource.

When deleting an object of IM management node that does not have "-xx" at the end of SID of the configuration information and leaving an object of IM management node that has "-xx" at the end, delete and save the "-xx" at the end of SID of the configuration information to be left.

The following shows an example of editing when Node exporter port number is changed.

In this example, the port number before the change is 20716 and the port number after the change is 29999.

  • Sample Pre-Edit IM management node Files

{
  "meta":{
    ...
  },
  "simtData": [
    ...
    {
      "sid": "_JP1PC-IMB_MHOST/_JP1PC-M_AHOST/_JP1PC-AHOST_AHOST/_HOST_AHOST/_JP1PC-A_Linux%20metric%20collector%28Node%20exporter%29",
      "value": {
        "component": "/HITACHI/JP1/JPCCS/CONFINFO",
        "category": "platform",
        "visible": true,
        "label": "Linux metric collector(Node exporter)",
        "property": {
          "jp1_pc_prome_hostname": "ahost",
          "job": "jpc_node",
          "jp1_pc_exporter": "JPC Node exporter",
          "jp1_pc_trendname": "node_exporter"
        },
        "jp1im_TrendData_labels": {
          "jp1_pc_prome_hostname": "ahost",
          "job": "jpc_node",
          "instance": "ahost:20716",
          "jp1_pc_nodelabel": "Linux metric collector(Node exporter)"
        },
        "methods": [
          "__metricListGet",
          "__timeSeriesDataGet"
        ]
      }
    },
    {
      "sid": "_JP1PC-IMB_MHOST/_JP1PC-M_AHOST/_JP1PC-AHOST_AHOST/_HOST_AHOST/_JP1PC-A_Linux%20metric%20collector%28Node%20exporter%29-01",
      "value": {
        "component": "/HITACHI/JP1/JPCCS/CONFINFO",
        "category": "platform",
        "visible": true,
        "label": "Linux metric collector(Node exporter)",
        "property": {
          "jp1_pc_prome_hostname": "ahost",
          "job": "jpc_node",
          "jp1_pc_exporter": "JPC Node exporter",
          "jp1_pc_trendname": "node_exporter"
        },
        "jp1im_TrendData_labels": {
          "jp1_pc_prome_hostname": "ahost",
          "job": "jpc_node",
          "instance": "ahost:29999",
          "jp1_pc_nodelabel": "Linux metric collector(Node exporter)"
        },
        "methods": [
          "__metricListGet",
          "__timeSeriesDataGet"
        ]
      }
    },
    ...
  ]
}

Deletes IM management node object whose instance is set to ahost:20716, and removes-xx at the end of the configuration SID that you want to keep. The edited IM management node filename is shown below.

  • Sample IM management node Files After Editing

{
  "meta":{
    ...
  },
  "simtData": [
    ...
    {
      "sid": "_JP1PC-IMB_MHOST/_JP1PC-M_AHOST/_JP1PC-AHOST_AHOST/_HOST_AHOST/_JP1PC-A_Linux%20metric%20collector%28Node%20exporter%29",
      "value": {
        "component": "/HITACHI/JP1/JPCCS/CONFINFO",
        "category": "platform",
        "visible": true,
        "label": "Linux metric collector(Node exporter)",
        "property": {
          "jp1_pc_prome_hostname": "ahost",
          "job": "jpc_node",
          "jp1_pc_exporter": "JPC Node exporter",
          "jp1_pc_trendname": "node_exporter"
        },
        "jp1im_TrendData_labels": {
          "jp1_pc_prome_hostname": "ahost",
          "job": "jpc_node",
          "instance": "ahost:29999",
          "jp1_pc_nodelabel": "Linux metric collector(Node exporter)"
        },
        "methods": [
          "__metricListGet",
          "__timeSeriesDataGet"
        ]
      }
    },
    ...
  ]
}
- Editing IM management node tree file

IM management node tree file output by jddcreatetree command. is edited.

If you delete the configuration, delete the description of the tree object of the deleted IM management node.

When the setting is changed, the description of SID of the configuration information to which "-xx" is added at the end of SID of the configuration information is deleted from target array.

The following shows an example of editing when Node exporter setting is changed.

  • Pre-Edit IM management node tree file Sample

{
  "meta":{
    ...
  },
  "simtData": [
    ...
    {
      "sid": "_ROOT_AllSystems/_HOST_AHOST/_CATEGORY_platform/_OBJECT_JP1PC-ALinux%20metric%20collector%28Node%20exporter%29",
      "value": {
        "target": [
          "_JP1PC-IMB_MHOST/_JP1PC-M_AHOST/_JP1PC-AHOST_AHOST/_HOST_AHOST/_JP1PC-A_Linux%20metric%20collector%28Node%20exporter%29"
        ],
        "label": "Linux metric collector(Node exporter)"
      }
    },
    {
      "sid": "_ROOT_AllSystems/_HOST_AHOST/_CATEGORY_platform/_OBJECT_JP1PC-ALinux%20metric%20collector%28Node%20exporter%29-01",
      "value": {
        "target": [
          "_JP1PC-IMB_MHOST/_JP1PC-M_AHOST/_JP1PC-AHOST_AHOST/_HOST_AHOST/_JP1PC-A_Linux%20metric%20collector%28Node%20exporter%29-01"
        ],
        "label": "Linux metric collector(Node exporter)"
      }
    },
    ...
  ]
}
  • Sample IM management node tree file After Editing

{
  "meta":{
    ...
  },
  "simtData": [
    ...
    {
      "sid": "_ROOT_AllSystems/_HOST_AHOST/_CATEGORY_platform/_OBJECT_JP1PC-ALinux%20metric%20collector%28Node%20exporter%29",
      "value": {
        "target": [
          "_JP1PC-IMB_MHOST/_JP1PC-M_AHOST/_JP1PC-AHOST_AHOST/_HOST_AHOST/_JP1PC-A_Linux%20metric%20collector%28Node%20exporter%29"
        ],
        "label": "Linux metric collector(Node exporter)"
      }
    },
    ...
  ]
}
- What happens when IM management node-related files is not edited

If you do not edit IM management node-related files, IM management node are created until the old sample is removed from Trend data Management Database. For configuration changes, JP1 events issued by add-on program, or user-defined Prometheus and Fluentd are mapped to IM management node without "-xx" at the end of the configuration SID.

(d) Settings of product plugin (for Windows)

This section explains how to set product plugin.

■ Define metric to Trend (Optional)

Define metric to be displayed in the [Trend] tabbed page of integrated operation viewer in metric Defined File. The primary metric is initially Setup. See each metric Definition Files (2. Definition File) in "JP1/Integrated Management 3 - Manager Command, Definition File and API Reference" for information about metric Definition File.

■ Setup AWS definition file (Optional)

When monitoring with Yet another cloudwatch exporter, specify the mapping between the account ID of AWS that you want to use monitoring with Yet another cloudwatch exporter, and the account strings that Setup to SID and IM management node properties by editing AWS definition file.

For information on AWS definition file, see "AWS definition file (aws_settings.conf)" (2. Definition file) in "JP1/Integrated Management 3 - Manager Command, Definition File and API Reference".

■ Edit system node definition file (imdd_systemnode) (Required only when using Yet another cloudwatch exporter)

If you want to monitor using Yet another cloudwatch exporter of add-on program and create a system node, setup system node definition file (imdd_systemnode) of JP1/IM - Manager.

This Setup is mandatory if you want to monitor it using add-on program's Yet another cloudwatch exporter.

When creating system node shown in 9.5.1(1)(i) tree format in JP1/Integrated Management 3 - Manager Overview and System Design Guide manuals, specify the following settings by editing system node definition file (imdd_systemnode). For setting items not listed here, specify an arbitrary value.

Item nam

Description

displayName

Specifies the name# of the service that publishes Amazon CloudWatch metric.

type

The slash (/) must be changed to a hyphen (-).

name

Specify the following string:

[{".*":"regexp"}]

#

Indicates what is on Web of Amazon CloudWatch.

When configuring a system-managed node for AWS namespace monitored by Yet another cloudwatch exporter metric definition file (metrics_ya_cloudwatch_exporter).conf default settings, the following is a sample of the values to be set for the items in system node definition file.

displayName

type

name

Amazon Simple Storage Service

JP1PC-AWS-S3

[{".*":"regexp"}]

AWS Lambda

JP1PC-AWS-LAMBDA

Amazon DynamoDB

JP1PC-AWS-DYNAMODB

AWS Step Functions

JP1PC-AWS-STATES

Amazon Simple Queue Service

JP1PC-AWS-SQS

If you set the above content to system node definition file, it will be as follows.

{
  "meta":{
    "version":"2"
  },
  "allSystem":[
    {
      "id":"strageSystem",
      "displayName":"Amazon Simple Storage Service",
      "objectRoot":[
        {
          "type":"JP1PC-AWS-S3",
          "name":[{".*":"regexp"}]
        }
      ]
    },
    {
      "id":"lambda",
      "displayName":"AWS Lambda",
      "objectRoot":[
        {
          "type":"JP1PC-AWS-LAMBDA",
          "name":[{".*":"regexp"}]
        }
      ]
    },
    {
      "id":"dynamodb",
      "displayName":"Amazon DynamoDB",
      "objectRoot":[
        {
          "type":"JP1PC-AWS-DYNAMODB",
          "name":[{".*":"regexp"}]
        }
      ]
    },
    {
      "id":"states",
      "displayName":"AWS Step Functions",
      "objectRoot":[
        {
          "type":"JP1PC-AWS-STATES",
          "name":[{".*":"regexp"}]
        }
      ]
    },
    {
      "id":"sqs",
      "displayName":"Amazon Simple Queue Service",
      "objectRoot":[
        {
          "type":"JP1PC-AWS-SQS",
          "name":[{".*":"regexp"}]
        }
      ]
    }
  ]
}

After configuring system node definition file, if you run JP1/IM - Manager's jddcreatetree commandto create a CloudWatch other than EC2, JP1/IM - Manager displays IM managed node under system node in integrated operation viewer [Health] area, depending on AWS namespace name.

For more information about system node definition file, see system node definition file in the manual JP1/Integrated Management 3 - Manager Command, Definition File and API Reference (imdd_systemnode Definition File).