Bulk Storage

The Streaming Integration Platform operates around snapshots of the system of record’s data, and those snapshots are generally stored in some type of network storage. The preferred solution for snapshot storage is to use an Amazon S3–compatible storage server hosted on your local network. There are several ways to achieve this, typically using third-party storage providers such as MinIO, RustFS, or SeaweedFS.

When replicating data using the ISAM Agent, another option is to use an S3 storage provider embedded within that agent. Of course, it's also possible to use Amazon S3 cloud storage; however, doing so introduces significant overhead due to the additional latency of Internet-based communication.