10.4.1 Overview of record filtering

When you wish to process only specific records during stream data processing, you can use a filter as an editing callback.

The following figure provides an overview of record filtering.

Figure 10-11 Overview of record filtering

[Figure]

Record filtering involves evaluating the input records against the information specified in the filter definition in the adaptor configuration definition file in order to determine the records that satisfy the specified conditions. The target records are selected and output based on the record format and field values in the records. For details about record filtering processing, see 10.4.2 Flow of data processing during record filtering.

Format of input and output data for filtering
The format of the input and output data for record filtering is the common record.
Timing of filtering
Filtering is performed as an editing callback in the input or output adaptor.
In the input adaptor, filtering is performed after data input or format conversion by the HTTP packet input connector. In the output adaptor, filtering is performed after the mapping that follows tuple reception.
For the timing for performing the editing callback, see 2.5.2 Evaluating the data editing methods.