| 主权项 |
1. A method, in a data processing system, for accelerating data exchange language parsing, the method comprising:
loading, by a processor, an input data stream into a first in, first out (FIFO) memory; extracting, by the processor, a tokenization bit corresponding to a next byte to be read from the FIFO; determining, by the processor, whether the tokenization bit corresponding to the next byte to be read from the FIFO indicates a control character or a non-control character located in an associated FIFO memory location in the FIFO; responsive to the tokenization bit indicating the control character located in the associated FIFO memory location in the FIFO, processing, by the processor, the control character, wherein the control character causes a state change in a state machine and wherein processing the control character increments the FIFO read pointer by one space; and responsive to the tokenization bit indicating the non-control character located in the associated FIFO memory location in the FIFO, identifying, by the processor, a length associated with the tokenized bit and processing, by the processor, a set of non-control characters based on the length associated with the tokenized bit, wherein processing the set of control characters increments the FIFO read pointer based on the length associated with the tokenized bit and wherein the set of non-control characters do not cause a state change in the state machine. |
