Skip to content

Installing a Storage Server

The Streaming Integration Platform relies on taking periodic snapshots of your application data, and those snapshots are usually stored on a network-based storage server. The preferred solution is to use a storage server compatible with Amazon S3 (Simple Storage Service).

Synergex has tested the following S3-compatible storage server solutions:

Product Documentation
MinIO AIStor https://docs.min.io/enterprise/aistor-object-store
RustFS https://docs.rustfs.com/installation
SeaweedFS https://github.com/seaweedfs/seaweedfs/wiki

Once you've selected and deployed your chosen S3 storage server, you'll need to document and provide the following information to permit the necessary configuration of the various Streaming Integration Platform components that will interact with the storage server:

  • The name of the S3 storage server being used
  • The DNS name or IP address of the storage server
  • The IP port number of the storage server (many storage servers use port 9000 by default)
  • The name of the S3 storage bucket to be used to store snapshot data
  • Access credentials (username and password) to be used to access the storage server. The credentials must be to a user account that has both read and write permissions to the storage bucket.
  • Whether TLS (HTTPS) is used when accessing the storage server. If it is, the storage server’s TLS certifiate must be trusted by all systems that host Streaming Integration Platform components.
  • Some S3-compatible servers (for example MinIO) can be optionally configured to operate as if they're located in a particular AWS region (e.g., us-east-1) and will fail if clients specify a different region code. If your server is configured in this way, you must specify the region code in use.
  • Some S3-compatible servers require that a path (e.g., /s3) be specified between the host name or address and the bucket name. If your S3 server is configured in this way, you must provide the path to be used.
  • Many S3-compatible storage servers present a browser-based user interface on an alternate port number. If your storage server is configured in this way, you must provide the port number used to access the UI and also indicate whether TLS (HTTPS) is used when accessing the UI.