org.apache.pulsar.common.policies.data

Class OffloadPolicies

java.lang.Object

org.apache.pulsar.common.policies.data.OffloadPolicies

All Implemented Interfaces:

Serializable

public class OffloadPolicies
extends Object
implements Serializable

Definition of the offload policies.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	OffloadPolicies.OffloadedReadPriority

Field Summary

Fields

Modifier and Type	Field and Description
static int	DEFAULT_MAX_BLOCK_SIZE_IN_BYTES
static Long	DEFAULT_OFFLOAD_DELETION_LAG_IN_MILLIS
static int	DEFAULT_OFFLOAD_MAX_PREFETCH_ROUNDS
static int	DEFAULT_OFFLOAD_MAX_THREADS
static Long	DEFAULT_OFFLOAD_THRESHOLD_IN_BYTES
static OffloadPolicies.OffloadedReadPriority	DEFAULT_OFFLOADED_READ_PRIORITY
static String	DEFAULT_OFFLOADER_DIRECTORY
static int	DEFAULT_READ_BUFFER_SIZE_IN_BYTES
static String	DELETION_LAG_NAME_IN_CONF_FILE
static com.google.common.collect.ImmutableList<String>	DRIVER_NAMES
static String	OFFLOAD_THRESHOLD_NAME_IN_CONF_FILE

Constructor Summary

Constructors

Constructor and Description
OffloadPolicies()

Method Summary

Modifier and Type	Method and Description
boolean	bucketValid()
static OffloadPolicies	create(Properties properties)
static OffloadPolicies	create(String driver, String region, String bucket, String endpoint, String credentialId, String credentialSecret, Integer maxBlockSizeInBytes, Integer readBufferSizeInBytes, Long offloadThresholdInBytes, Long offloadDeletionLagInMillis, OffloadPolicies.OffloadedReadPriority readPriority)
boolean	driverSupported()
boolean	equals(Object obj)
static String	getSupportedDriverNames()
int	hashCode()
boolean	isFileSystemDriver()
boolean	isGcsDriver()
boolean	isS3Driver()
static OffloadPolicies	mergeConfiguration(OffloadPolicies topicLevelPolicies, OffloadPolicies nsLevelPolicies, Properties brokerProperties) Merge different level offload policies.
static OffloadPolicies	oldPoliciesCompatible(OffloadPolicies nsLevelPolicies, Policies policies) This method is used to make a compatible with old policies.
Properties	toProperties()
String	toString()

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

DEFAULT_MAX_BLOCK_SIZE_IN_BYTES

public static final int DEFAULT_MAX_BLOCK_SIZE_IN_BYTES

See Also:

Constant Field Values

DEFAULT_READ_BUFFER_SIZE_IN_BYTES

public static final int DEFAULT_READ_BUFFER_SIZE_IN_BYTES

See Also:

Constant Field Values

DEFAULT_OFFLOAD_MAX_THREADS

public static final int DEFAULT_OFFLOAD_MAX_THREADS

See Also:

Constant Field Values

DEFAULT_OFFLOAD_MAX_PREFETCH_ROUNDS

public static final int DEFAULT_OFFLOAD_MAX_PREFETCH_ROUNDS

See Also:

Constant Field Values

DRIVER_NAMES

public static final com.google.common.collect.ImmutableList<String> DRIVER_NAMES

DEFAULT_OFFLOADER_DIRECTORY

public static final String DEFAULT_OFFLOADER_DIRECTORY

See Also:

Constant Field Values

DEFAULT_OFFLOAD_THRESHOLD_IN_BYTES

public static final Long DEFAULT_OFFLOAD_THRESHOLD_IN_BYTES

DEFAULT_OFFLOAD_DELETION_LAG_IN_MILLIS

public static final Long DEFAULT_OFFLOAD_DELETION_LAG_IN_MILLIS

OFFLOAD_THRESHOLD_NAME_IN_CONF_FILE

public static final String OFFLOAD_THRESHOLD_NAME_IN_CONF_FILE

See Also:

Constant Field Values

DELETION_LAG_NAME_IN_CONF_FILE

public static final String DELETION_LAG_NAME_IN_CONF_FILE

See Also:

Constant Field Values

DEFAULT_OFFLOADED_READ_PRIORITY

public static final OffloadPolicies.OffloadedReadPriority DEFAULT_OFFLOADED_READ_PRIORITY

Constructor Detail

OffloadPolicies

public OffloadPolicies()

Method Detail

create

public static OffloadPolicies create(String driver,
                                     String region,
                                     String bucket,
                                     String endpoint,
                                     String credentialId,
                                     String credentialSecret,
                                     Integer maxBlockSizeInBytes,
                                     Integer readBufferSizeInBytes,
                                     Long offloadThresholdInBytes,
                                     Long offloadDeletionLagInMillis,
                                     OffloadPolicies.OffloadedReadPriority readPriority)

create

public static OffloadPolicies create(Properties properties)

driverSupported

public boolean driverSupported()

getSupportedDriverNames

public static String getSupportedDriverNames()

isS3Driver

public boolean isS3Driver()

isGcsDriver

public boolean isGcsDriver()

isFileSystemDriver

public boolean isFileSystemDriver()

bucketValid

public boolean bucketValid()

hashCode

public int hashCode()

Overrides:

hashCode in class Object

equals

public boolean equals(Object obj)

Overrides:

equals in class Object

toString

public String toString()

Overrides:

toString in class Object

toProperties

public Properties toProperties()

oldPoliciesCompatible

public static OffloadPolicies oldPoliciesCompatible(OffloadPolicies nsLevelPolicies,
                                                    Policies policies)

This method is used to make a compatible with old policies.

The filed Policies.offload_threshold is primitive, so it can't be known whether it had been set. In the old logic, if the field value is -1, it could be thought that the field had not been set.

Parameters:

nsLevelPolicies - namespace level offload policies

policies - namespace policies

Returns:

offload policies

mergeConfiguration

public static OffloadPolicies mergeConfiguration(OffloadPolicies topicLevelPolicies,
                                                 OffloadPolicies nsLevelPolicies,
                                                 Properties brokerProperties)

Merge different level offload policies.

policies level priority: topic > namespace > broker

Parameters:

topicLevelPolicies - topic level offload policies

nsLevelPolicies - namespace level offload policies

brokerProperties - broker level offload configuration

Returns:

offload policies