State Management

Many data integration scenarios cannot simply transfer data from A to B in a stateless and synchronous manner. Very often, the received data must go through a technical or business process before an incoming data record can be marked as successfully processed. In addition, data records are often delivered as a batch or as a CSV file, and each individual data record then has its own status. Last but not least, the Customer wants to know about the success or failure of each record to be able to fix and resend records which not reach the target.

Transfer data from A to B in multiple steps, maintaining a State

The status of each record must be tracked so that the state of the processing can be seen at all times.

State vs. Status

I distinguish between State and Status.

State refers to a record's state, where Status may contain additional information about a specific State: Status = State Reason.

For example: State = DELETED, Status=MANUAL | BY_SOFTWARE.

Example Scenario