HiRDB Datareplicator Version 8

Description, User's Guide and Operator's Guide

3020-6-360-50(E)


Contents

Notices
Preface

1. Overview
1.1 Features
1.1.1 Purpose of Datareplicator
1.1.2 Data linkage system
1.2 Data linkage
1.2.1 Combinations for a data linkage system
1.2.2 Mechanism of data linkage
1.2.3 Correspondence between source and target databases
1.2.4 Databases supported for data linkage
1.2.5 Correspondence of database terminology
1.3 Tables supported for data linkage
1.4 Data types for tables supported for data linkage
1.4.1 Data types supported by Datareplicator
1.4.2 Data linkage for a table using an abstract data type
1.4.3 Data linkage for a table containing repetition columns
1.4.4 Data linkage for tables using BLOB and BINARY type columns
1.5 SQL statements supported for data linkage
1.6 Software configuration
1.6.1 Software configuration for linking data from one HiRDB to another HiRDB
1.6.2 Software configuration for linking data from a HiRDB to a mainframe database
1.6.3 Software configuration for linking data from a mainframe database to a HiRDB
1.6.4 Software configuration for linking data from a mainframe database to a HiRDB using a SAM file
1.7 Data linkage system construction procedure

2. Environment Setup
2.1 Products associated with Datareplicator
2.1.1 Products required for Datareplicator
2.1.2 Products required for a source system
2.1.3 Products required for a target system
2.2 Installing Datareplicator (UNIX)
2.2.1 Preparations before installation
2.2.2 Server machines where Datareplicator is installed
2.2.3 Installing Datareplicator
2.2.4 Uninstalling Datareplicator
2.3 Directory structure (UNIX)
2.3.1 Directories created when Datareplicator is installed
2.3.2 Directory structure of a source Datareplicator
2.3.3 Directory structure of a target Datareplicator
2.4 Specifying environment variables (UNIX)
2.4.1 Environment variables for a source Datareplicator
2.4.2 Environment variables for a target Datareplicator
2.5 Setting up the communications environment (UNIX)
2.5.1 Setting up a source Datareplicator's communications environment
2.5.2 Setting up a target Datareplicator's communications environment
2.6 Installing Datareplicator (Windows)
2.6.1 Preparations before installation
2.6.2 Server machines where Datareplicator is installed
2.6.3 Installing Datareplicator
2.6.4 Information registered during installation
2.6.5 Post-installation procedure
2.6.6 Uninstalling Datareplicator
2.7 Directory structure (Windows)
2.7.1 Directories created when Datareplicator is installed
2.7.2 Directory structure of a source Datareplicator
2.7.3 Directory structure of a target Datareplicator
2.8 Specifying environment variables (Windows)
2.8.1 Environment variables for a source Datareplicator
2.8.2 Environment variables for a target Datareplicator
2.9 Setting up the communications environment (Windows)
2.9.1 Registering the service name
2.9.2 Registering the host name
2.9.3 Using Windows Terminal Service
2.10 Operating environment in Windows Vista and Windows Server 2008
2.10.1 Executing commands
2.10.2 Renamed commands
2.10.3 Support of JIS standard level 3 and level 4 character sets
2.11 Upgrading Datareplicator
2.11.1 Notes about upgrading
2.11.2 How to upgrade
2.11.3 Notes on upgrading
2.12 Improving the reliability of syslogfile and character encoding conversion (Linux only)
2.12.1 Improving the reliability of syslogfile
2.12.2 Character encoding conversion on syslogfile
2.12.3 Notes

3. Data Linkage Facilities
3.1 Linkage patterns
3.1.1 Linking data to a table with the same format
3.1.2 Linking data to a table with a different format
3.1.3 Linking data from one table to n tables
3.1.4 Linking data from n tables to one table
3.1.5 Linking data by selecting the rows to be sent
3.1.6 Linking data by using a user own coding routine
3.1.7 Obtaining a record of updates in chronological order
3.2 Source Datareplicator's extraction processing
3.2.1 Overview of extraction processing
3.2.2 Files and processes used during extraction processing
3.2.3 Units of extraction processing
3.2.4 Collecting information about the source Datareplicator
3.2.5 Controlling the number of transmission processes
3.2.6 Processing update information with a user own coding routine
3.2.7 Suppressing message output
3.2.8 Linking update data for concatenation operations
3.2.9 Data linkage for RDAREAs using the inner replica facility
3.3 Target Datareplicator's import processing
3.3.1 Overview of import processing
3.3.2 Files and processes used during import processing
3.3.3 Import methods
3.3.4 Import method for the multi-FES facility
3.3.5 Units of import processing
3.3.6 Data linkage for a table with a trigger set
3.3.7 Collecting time-ordered information
3.3.8 Collecting information about the target Datareplicator
3.3.9 Processing update information with a user own coding routine
3.3.10 Skipping import errors
3.3.11 Creating a merge table
3.3.12 Specifying the synchronization point processing for import processing
3.3.13 Suppressing message output
3.3.14 Processing in the event of a lock error
3.4 Using JP1/Cm2 for operations management
3.4.1 Overview of using JP1/Cm2 for operations management
3.4.2 Status monitoring
3.4.3 Information collection
3.4.4 Remote control
3.4.5 Files and processes used for operations management
3.4.6 Initializing operations management
3.4.7 Operation of the supervisor machine
3.4.8 Operation of a supervised machine
3.4.9 MIB file
3.5 Datareplicator file system areas
3.5.1 Purpose of a Datareplicator file system area
3.5.2 Creating a Datareplicator file system area
3.5.3 Structure of a Datareplicator file system area
3.5.4 Notes on using Datareplicator file system areas
3.6 Delay monitoring facility
3.6.1 Overview of the delay monitoring facility
3.6.2 Using the delay monitoring facility
3.6.3 Notes
3.7 Import transaction synchronization facility
3.7.1 Overview of the import transaction synchronization facility
3.7.2 Preparations for the import transaction synchronization facility
3.7.3 Flow of processing by the import transaction synchronization facility
3.7.4 Transaction branch information
3.7.5 Synchronous import group
3.7.6 How to check the extraction and import status
3.7.7 Error handling
3.7.8 Notes
3.7.9 Examples
3.8 Event facility
3.8.1 Issuing events
3.8.2 Types of events
3.8.3 Defining event codes
3.8.4 Event detection timing and action
3.8.5 Notes
3.9 Duplexing files
3.9.1 Files that can be duplexed
3.9.2 Files associated with duplexing
3.9.3 Notes about duplexing

4. System Design
4.1 System design items
4.2 Designing a linkage pattern
4.2.1 Data linkage to a table with the same format
4.2.2 Data linkage to a table with a different format
4.2.3 Data linkage from one table to n tables
4.2.4 Data linkage from n tables to one table
4.2.5 Data linkage by selecting rows to be sent
4.2.6 Data linkage using a UOC routine
4.2.7 Acquisition of a record of update information over time
4.3 Designing the correspondence between source and target databases
4.3.1 Conditions for the source database
4.3.2 Creating a table subject to import processing
4.3.3 Designing the correspondence of mapping keys
4.3.4 Designing for the supported data types
4.3.5 Designing for character code sets
4.3.6 Designing repetition columns
4.3.7 Creating a time-ordered information table
4.4 Designing the correspondence between source and target systems
4.4.1 Designing data linkage from one HiRDB to another HiRDB
4.4.2 Designing data linkage from a HiRDB to a mainframe database
4.4.3 Designing data linkage from a mainframe database to a HiRDB
4.4.4 Designing data linkage from a mainframe database to a HiRDB using SAM files
4.5 Designing the data linkage system mode
4.5.1 Data linkage system modes
4.5.2 Designing a data linkage system for application to a hierarchical system
4.5.3 Notes on a data linkage system that links multiple systems
4.6 Designing a source Datareplicator
4.6.1 Source Datareplicator's file organization
4.6.2 Preparation of the files used with the source Datareplicator
4.6.3 Designing the extraction procedure
4.6.4 Designing the transmission procedure
4.6.5 Designing the extraction processing start method
4.6.6 Designing the extraction processing stop method
4.6.7 Designing the event control table
4.6.8 Designing the source Datareplicator's resources
4.7 Designing a target Datareplicator
4.7.1 Target Datareplicator's file organization
4.7.2 Preparation of the files used with the target Datareplicator
4.7.3 Designing the import procedure
4.7.4 Designing the import processing start method
4.7.5 Designing the import processing stop method
4.7.6 Designing the switching of import processing methods
4.7.7 Designing the target Datareplicator's resources
4.8 Designing the source HiRDB

5. Definitions
5.1 Overview of Datareplicator definitions
5.1.1 Organization of the Datareplicator definitions
5.1.2 Definition rules
5.2 Extraction system definition
5.2.1 Format
5.2.2 Modifying defined information
5.2.3 Explanation of the operands
5.3 Extraction environment definition
5.3.1 Format
5.3.2 Modifying defined information
5.3.3 Explanation of the operands
5.4 Transmission environment definition
5.4.1 Format
5.4.2 Modifying defined information
5.4.3 Explanation of the operands
5.5 Extraction definition
5.5.1 Structure and format
5.5.2 Modifying defined information
5.5.3 Extraction definition statement
5.5.4 Transmission definition statement
5.6 Source HiRDB definition
5.6.1 System common definition
5.6.2 Unit control information definition
5.7 Duplexing definition (source)
5.8 Import system definition
5.8.1 Format
5.8.2 Modifying defined information
5.8.3 Explanation of the operands
5.9 Import environment definition
5.9.1 Format
5.9.2 Modifying defined information
5.9.3 Explanation of the operands
5.10 Import definition
5.10.1 Definition rules
5.10.2 Structure and format
5.10.3 Modifying defined information
5.10.4 Update information field definition
5.10.5 Import table definition
5.10.6 Import group definition
5.11 Update information definition
5.11.1 Structure and format
5.11.2 Operating environment definition statement
5.11.3 Extraction redefinition statement
5.11.4 Extraction statement
5.12 Duplexing definition (target)
5.13 Examples of Datareplicator definitions
5.13.1 Examples of system configuration and file organization
5.13.2 Examples of source Datareplicator definitions
5.13.3 Examples of target Datareplicator definitions
5.13.4 Examples of source and target definitions
5.13.5 Examples of import group definitions when the multi-FES facility is used

6. Operation
6.1 Overview of data linkage systems
6.1.1 Normal data linkage system operating procedure
6.1.2 Data linkage from a mainframe database to a HiRDB using SAM files
6.2 Initialization procedure at the environment configuration stage
6.3 Startup and termination of the source Datareplicator
6.3.1 Starting the source Datareplicator
6.3.2 Terminate the source Datareplicator
6.4 Operation of the source Datareplicator
6.4.1 Handling of extraction processing
6.4.2 Handling of the files used with the source Datareplicator
6.4.3 Notes on handling the source Datareplicator
6.5 Handling of the source HiRDB
6.5.1 Starting, stopping, and cancelling HiRDB Datareplicator linkage
6.5.2 Data linkage file
6.5.3 Handling of the system log file
6.5.4 Processing at the source HiRDB and source Datareplicator depending on the specification of extsuppress in the extraction environment definition
6.5.5 Checking the execution status of HiRDB Datareplicator linkage
6.5.6 Source HiRDB handling procedure
6.5.7 Notes on handling when syncterm=true is specified
6.5.8 Notes on handling when sendcontrol=sendmst is specified
6.6 Startup and termination of the target Datareplicator
6.6.1 Starting the target Datareplicator
6.6.2 Terminate the target Datareplicator
6.7 Operation of the target Datareplicator
6.7.1 Handling of import processing
6.7.2 Handling of the files used with the target Datareplicator
6.7.3 Notes on handling the target Datareplicator
6.8 Changing the configuration of HiRDB and Datareplicator
6.8.1 Changing the definition of tables subject to linkage
6.8.2 Changing the configuration of the source system
6.8.3 Changing the configuration of the target system
6.8.4 Changing the configuration when the import transaction synchronization facility is used
6.9 Using the system switchover facility
6.9.1 System switchover facility modes
6.9.2 Preparations for using the system switchover facility (for HA monitor)
6.9.3 Preparations for using the system switchover facility (for Microsoft Cluster Server)
6.9.4 Handling procedure when the system switchover facility is used (for HA monitor)
6.9.5 Notes on using the system switchover facility
6.9.6 Using the standby-less system switchover (effects distributed) facility
6.10 Using the file duplexing function
6.10.1 Changing the file organization from non-duplexing to duplexing
6.10.2 Changing the files to be duplexed
6.10.3 Changing the file organization from duplexing to non-duplexing
6.11 Handling of large files
6.11.1 Preparations for handling large files (UNIX edition only)
6.11.2 Estimating the command execution time when large files are used
6.12 Tuning
6.12.1 Whether tuning is needed
6.12.2 How to tune
6.13 Notes about operation
6.13.1 Notes about changing the OS time

7. Command Syntax
Overview of commands
hdechgstatus (change the status of the source Datareplicator)
hdeevent (issue an event at the source Datareplicator)
hdefcopy (copy the current source file)
hdefstate (display the status of duplexed source files)
hdemodq (modify the organization of extraction information queue files)
hdeprep (create an extraction definition preprocessing file)
hdeshmclean (delete the source Datareplicator's shared resources)
hdestart (start the source Datareplicator)
hdestart_n (partially start the source Datareplicator)
hdestate (collect source Datareplicator status information)
hdestop (terminate the source Datareplicator)
hdestop_n (partially terminate the source Datareplicator)
hdsagtopt (manipulate Datareplicator agent settings)
hdsagtstart (start the Datareplicator agent)
hdsagtstatus (display the Datareplicator agent status)
hdsagtstop (terminate the Datareplicator agent)
hdsccnvedt (edit a mapping table for converting character codes)
hdschgstatus (change the status of the target Datareplicator)
hdsfcopy (copy the current target file)
hdsfmkfs (initialize a Datareplicator file system area)
hdsfstate (display the status of duplexed target files)
hdsfstatfs (display the status of a Datareplicator file system area)
hdspathlist (specify a directory to be monitored)
hdsrefinfm (check update information)
hdsrfctl (control import processing)
hdssamqin (extract update information from a SAM file)
hdsshmclean (delete the target Datareplicator's shared resources)
hdsstart (start the target Datareplicator)
hdsstate (collect target Datareplicator status information)
hdsstop (terminate the target Datareplicator)
hdstrcedit (edit an activity trace file)
pdlogchg (modify the status of log-related files)
pdls (display the HiRDB system status)
pdrplstart (start HiRDB Datareplicator linkage)
pdrplstop (cancel HiRDB Datareplicator linkage)

8. User Own Coding Routines
8.1 Import information editing UOC routine
8.1.1 Overview of an import information editing UOC routine
8.1.2 Creating an import information editing UOC routine (UNIX)
8.1.3 Creating an import information editing UOC routine (Windows)
8.1.4 Syntax for the functions used with an import information editing UOC routine
8.1.5 Handling of abstract data types by an import information editing UOC routine
8.1.6 Notes on creating an import information editing UOC routine
8.1.7 Sample import information editing UOC routine
8.2 Column data editing UOC routine
8.2.1 Overview of a column data editing UOC routine
8.2.2 Column data editing UOC routine creation procedure (UNIX)
8.2.3 Column data editing UOC routine creation procedure (Windows)
8.2.4 Syntax for the function used with a column data editing UOC routine
8.2.5 Notes on creating a column data editing UOC routine
8.2.6 Sample column data editing UOC routine
8.3 Send data UOC routine
8.3.1 Overview of a send data UOC routine
8.3.2 Send data UOC routine creation procedure (UNIX)
8.3.3 Send data UOC routine creation procedure (Windows)
8.3.4 Syntax for the function used with a send data UOC routine
8.3.5 Notes on creating a send data UOC routine
8.3.6 Sample send data UOC routine

9. Error Handling Procedures
9.1 Error handling procedures for the source Datareplicator
9.1.1 Error handling procedures
9.1.2 Error handling methods
9.1.3 Actions after correcting an error
9.1.4 Procedures for handling errors at the target system
9.1.5 User own coding routine error handling procedure
9.1.6 Handling of file errors during file-duplexed operation
9.2 Error handling procedures for the target Datareplicator
9.2.1 Error handling procedures
9.2.2 Error handling methods
9.2.3 Actions after correcting an error
9.2.4 Procedures for handling errors at the source system
9.2.5 User own coding routine error handling procedure
9.3 Error recovery method selection criteria
9.4 Initialization procedure during error recovery
9.4.1 Errors that require initialization of Datareplicators
9.4.2 Datareplicator initialization procedure during error recovery
9.5 Data linkage recovery via the system log file
9.5.1 Overview of data linkage recovery via the system log file
9.5.2 Prerequisites for data linkage recovery via the system log file
9.5.3 Overview of the recovery procedure using the system log file
9.6 Data linkage recovery via unload log files
9.6.1 Overview of data linkage recovery via unload log files
9.6.2 Prerequisites for data linkage recovery via unload log files
9.6.3 Preparing for data linkage recovery via unload log files
9.6.4 Overview of the recovery procedure using unload log files
9.6.5 Details of data linkage recovery using unload log files
9.6.6 Commands provided by the data linkage recovery facility
9.6.7 Procedure after execution of data linkage recovery facility
9.6.8 How to suppress import when the table-based import method is used for import processing at the target system
9.7 Facility for recovering the extraction information queue file
9.7.1 Overview of the facility for recovering the extraction information queue file
9.7.2 Prerequisites for the facility for recovering the extraction information queue file
9.7.3 Recovery procedure using the facility for recovering the extraction information queue file
9.8 Acquisition of untransmitted information due to import errors (update-SQL output facility)

10. Messages
10.1 Overview of messages
10.1.1 Message output destination
10.1.2 Message output format
10.1.3 Message descriptive format
10.2 Details about messages
10.3 List of system call errors
10.4 List of cause codes

Appendixes
A. Detailed Information About HiRDB-Related Datareplicator Support
A.1 OSs supported for HiRDB and the versions of Datareplicator that can be used on those OSs
A.2 HiRDB facilities and their support by Datareplicator
B. Datareplicator Reserved Words
C. Functional Differences Between the UNIX and Windows Editions of Datareplicator
D. Downgrading Datareplicator
D.1 Differences in downgrading procedures between product models
D.2 Downgrading procedure
D.3 Notes after downgrading
E. Glossary

Index