10.3.1 Overview of HTTP packet input

HTTP packet input processing involves receiving HTTP packet data with the standard input, converting the data into a format that can be processed by the stream data processing engine, and then sending the data to the stream data processing engine.

An input adaptor is used to perform HTTP packet input processing.

The following figure provides an overview of HTTP packet input.

Figure 10-7 Overview of HTTP packet input

[Figure]

  1. Reads data
    Uses a packet input connector to read data obtained from the packet analyzer with the standard output, analyzes the obtained HTTP packet data, then converts the data.
  2. Edits data
    Edits the data (performs mapping).
  3. Sends tuples
    Converts the edited data to tuples and sends them to the SDP server.

To input HTTP packets, you require a packet analyzer (WinDump) that can output packets in Pcap format. For details about the WinDump version, see the Release Notes for Stream Data Platform - AF.

The HTTP packet input function can handle only HTTP packets output in Pcap format, which is shown in the figure below.

Figure 10-8 Pcap format

[Figure]

In the Pcap format, a Pcap header is added to the packet part that flows in the network. In the Pcap header, the first header created is the global header created after WinDump starts. After the global header is created, repeated sets of a Pcap packet header (packet header) and Pcap packet data (packet data) are created.

You specify information about the Pcap format or about some other HTTP packet format in the HTTP packet input connector definition in the adaptor configuration definition file.