2.9.1 Supplementary notes on job execution in a cloud environment
- Organization of this subsection
(1) About components
A manager host, a relay agent, and a destination agent under the load balancer are required to use a flexible job.
Each of these components are explained below.
(a) Manager host
-
Destination for placement
The manager host can be placed in an on-premise environment and a non-auto-scaling environment of the cloud.
-
Cluster configuration
The manager host supports cluster configuration.
(b) Relay agent
-
Destination for placement
The relay agent can be placed in an on-premise environment and a non-auto-scaling environment of the cloud.
-
Cluster configuration
The relay agent supports cluster configuration.
If the manager host is running on Windows or Linux, you can run the ajsatsetup -m command on the manager host to use the manager host as a relay agent.
In situations shown below, a relay agent is required for a host that is neither a manager host nor a destination agent host.
-
If the manager host is running on an OS that is neither Windows nor Linux:
The OS of the manager host or agent host that a flexible job can specify as an execution host is only Windows or Linux.
Therefore, if the manager host is running on an OS that is neither Windows nor Linux, a relay agent is necessary.
-
If the manager host and the destination agent cannot communicate directly with each other:
As shown in Figure 2-64, a relay agent must be placed between the manager host and the destination agent to mediate communication.
(c) Destination agent under the load balancer
-
Destination for placement
Place the destination agent in an auto-scaling environment under the load balancer.
Note that Network Load Balancer and Classic Load Balancer are supported as load balancers (Elastic Load Balancing) for Amazon Web Service, but Application Load Balancer is not supported. In addition, Azure Load Balancer and other load balancers for use with services other than Amazon Web Service are not supported.
-
Cluster configuration
The destination agent does not support cluster configuration. For that reason, by deploying a destination agent in an auto-scaling environment in a cloud, availability in the auto-scaling environment is ensured. Similarly, consider preparing an auto-scaling environment at the remote site as needed.
- Cautionary note
-
Scale-in and scale-out actions in an auto-scaling environment in a cloud are managed on the side of the cloud. Thus, the time before startup of the destination agent by scaling-out in an auto-scaling environment finishes and the deletion of destination agents by scaling-in cannot be detected by JP1/AJS3. At that timing, if a flexible job is executed, it might fail. For that reason, regarding the execution of flexible jobs, we recommend using jobs that can be re-executed.
(2) About the communication environment
-
If a load balancer is used, it is assumed that the load balancer can distribute TCP packets.
-
For details about working through a firewall, see 2.3.2 Firewall and communication basics.
-
If you execute a job defined in an on-premise environment on a public cloud environment, connect the relay agent and cloud environment with VPN.
-
For communications between the relay agent and the cloud environment, use a communication environment in which safety and stability is ensured. For details, see 2.3.7 Communications used in a WAN.
(3) Other information
-
The relaying function of a flexible job is executed as a job on a relay agent. Therefore, if a relay agent and an execution agent for other jobs is the same, execution of a flexible job might affect execution of other jobs, for example in terms of the number of concurrently executable jobs. Consider deploying the relay agent for a flexible job separately from execution agents for other jobs.
-
For cautionary notes on flexible jobs, see 7.8 Notes on using flexible jobs in the JP1/Automatic Job Management System 3 System Design (Work Tasks) Guide.