S3FileSink

Behavior

S3FileSink is embedding local file sink. It writes messages to the local file sink and when its local file sink rotates the file, it uploads to S3. When the local file sink rotates the file, its Notice would have the list of files to upload. S3FileSink can get the list of files by Notice.recv().

Properties

If the default value is not specified, it's required.

Property	Description	Type	Default value
localFileSink	local file sink configuration	String
bucket	S3 bucket name	String
s3Endpoint	S3 bucket end point	s3.amazonaws.com
maxPartSize	S3 multiple upload max partition size	long	20971520
concurrentUpload	number of uploading threads	int	5
notice	It describes Notice interface for how to notify its progress.	Notice	QueueNotice
prefixFormatter	It describes RemotePrefixFormatter for how to create a file name.	RemotePrefixFormatter	SimpleDateFormatter