The adaptors provided by Stream Data Platform - AF are called the standard adaptors. The actions that a standard adaptor performs in order to correctly pass data are defined in an adaptor definition file. For details about the adaptor definition file, see the uCosminexus Stream Data Platform - Application Framework Setup and Operation Guide.
Using a standard adaptor, you can input the following types of data into the stream data processing engine:
A standard adaptor can also output the results of the stream data processing engine to the following destinations:
To input data from a data source other than the above, or to output results to an output destination other than the above, you need to use a custom adaptor. For details about custom adaptors, see 3.1.2 Custom adaptors.
The standard adaptors function using units of processing called callbacks. Functions in the adaptor definition file are defined in terms of these callback units.
The standard adaptor callbacks are executed on input data one line (or row) at a time (for HTTP packets, they are executed by request message or by response message). This single line or message unit is called a record.
The following figure shows the organization of the callbacks in an input adaptor.
Figure 3-1 Organization of the callbacks in an input adaptor
The following figure shows the organization of the callbacks in an output adaptor.
Figure 3-2 Organization of the callbacks in an output adaptor
The following table lists and describes the functions of the standard adaptors.
Table 3-1 Functions of the standard adaptors
No. | Callback | Type | Function | Description |
---|---|---|---|---|
1 | File input connector | Input callback | Inputs a file | Used for inputting a file. |
2 | HTTP packet input connector | Inputs HTTP packets | Used for inputting HTTP packets over a network. | |
3 | Format conversion | Data editing callback | Converts the format of records during file input or output | Used only when the file input connector or file output connector is specified. There are two types of format conversion callbacks: one for the input adaptor and one for the output adaptor.
|
4 | Filter | Filters records | Used to selectively extract records. When you use a filter callback, the adaptor can perform processing like that executed in the CQL code described in 2.3.2 Retrieving data that satisfies a condition. To improve performance, we recommend that you use the adaptor to perform this kind of processing. | |
5 | Record extraction | Extracts records | Used only with the input adaptor. This callback allows you to extract only the selected records that will then be joined to generate new records. When you use a record extraction callback, the adaptor can perform processing like that executed in the CQL code described in 2.3.6 Joining data streams. To improve performance, we recommend that you use the adaptor to perform this kind of processing. | |
6 | Mapping | Maps records | There are two types of record mapping callbacks: one for the input adaptor and one for the output adaptor.
| |
7 | Tuple transmission | Tuple exchange callback | Sends tuples to the stream data processing engine | Used by the input adaptor to send tuples to the stream data processing engine. |
8 | Tuple reception | Receives tuples processed by the stream data processing engine | Used by the output adaptor to receive tuples processed by the stream data processing engine. | |
9 | File output connector | Output callback | Outputs a file | Used to output the results of the stream data processing engine to a file. |
10 | Dashboard output connector | Outputs to the dashboard | Used to output and display the results of the stream data processing engine to the dashboard. |
For more details about callbacks, see the uCosminexus Stream Data Platform - Application Framework Setup and Operation Guide.
Beginning in section 3.2 Inputting files, this manual provides an overview of the following callbacks:
The callbacks listed in the table are used in combination with one another. The following example describes a callback configuration.
Figure 3-3 Example of positioning and processing of the input adaptor callbacks
Figure 3-4 Example of positioning and processing of the output adaptor callbacks