Class S3Options.S3UploadBufferSizeBytesFactory

  • All Implemented Interfaces:
    org.apache.beam.sdk.options.DefaultValueFactory<java.lang.Integer>
    Enclosing interface:
    S3Options

    public static class S3Options.S3UploadBufferSizeBytesFactory
    extends java.lang.Object
    implements org.apache.beam.sdk.options.DefaultValueFactory<java.lang.Integer>
    Provide the default s3 upload buffer size in bytes: 64MB if more than 512MB in RAM are available and 5MB otherwise.
    • Field Detail

      • REQUIRED_MEMORY_FOR_DEFAULT_BUFFER_BYTES

        public static final int REQUIRED_MEMORY_FOR_DEFAULT_BUFFER_BYTES
        See Also:
        Constant Field Values
      • MINIMUM_UPLOAD_BUFFER_SIZE_BYTES

        public static final int MINIMUM_UPLOAD_BUFFER_SIZE_BYTES
        See Also:
        Constant Field Values
      • DEFAULT_UPLOAD_BUFFER_SIZE_BYTES

        public static final int DEFAULT_UPLOAD_BUFFER_SIZE_BYTES
        See Also:
        Constant Field Values
    • Constructor Detail

      • S3UploadBufferSizeBytesFactory

        public S3UploadBufferSizeBytesFactory()
    • Method Detail

      • create

        public java.lang.Integer create​(org.apache.beam.sdk.options.PipelineOptions options)
        Specified by:
        create in interface org.apache.beam.sdk.options.DefaultValueFactory<java.lang.Integer>