Skip navigation links
A C E F G I L M N P R S U W 

A

AbstractFileBasedConnector - Class in com.datastax.oss.dsbulk.connectors.commons
A parent class for connectors that read from and write to text-based files.
AbstractFileBasedConnector() - Constructor for class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
AbstractFileBasedConnector.RecordReader - Interface in com.datastax.oss.dsbulk.connectors.commons
A reader for Records.
AbstractFileBasedConnector.RecordWriter - Interface in com.datastax.oss.dsbulk.connectors.commons
A writer for Records.
applyPerFileLimits(Flux<Record>) - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
Applies per-file limits to a stream of records coming from AbstractFileBasedConnector.readSingleFile(java.net.URL, URI).

C

close() - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
close() - Method in interface com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector.RecordReader
Closes the underlying file being read.
close() - Method in interface com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector.RecordWriter
Closes the underlying file being written.
com.datastax.oss.dsbulk.connectors.commons - package com.datastax.oss.dsbulk.connectors.commons
 
COMPRESSION - Static variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
compression - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
configure(Config, boolean, boolean) - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 

E

ENCODING - Static variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
encoding - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 

F

FILE_NAME_FORMAT - Static variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
FILE_NAME_PATTERN - Static variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
fileCounter - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
fileNameFormat - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
files - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
flush() - Method in interface com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector.RecordWriter
Flushes all pending writes.

G

getConnectorName() - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
Returns the connector name, e.g.
getOrCreateDestinationURL() - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
Returns the URL that the connector should write to.

I

init() - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
isDataSizeSamplingAvailable() - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
Checks whether it is safe to perform data size sampling on this connector's data source.

L

loadURLs(Config) - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
Validates and computes the list of URLs to be read or written.

M

MAX_CONCURRENT_FILES - Static variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
MAX_RECORDS - Static variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
maxConcurrentFiles - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
maxRecords - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 

N

newSingleFileReader(URL, URI) - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
Returns a new AbstractFileBasedConnector.RecordReader instance; cannot be null.
newSingleFileWriter() - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
Returns a new AbstractFileBasedConnector.RecordWriter instance; cannot be null.
nextWriterIndex - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 

P

pattern - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
processURLsForRead() - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
Inspects the list or URLs as loaded by AbstractFileBasedConnector.loadURLs(Config) and determines exactly what files and folders need to be read.
processURLsForWrite() - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
Inspects the list or URLs as loaded by AbstractFileBasedConnector.loadURLs(Config) and determines if the connector should write to a single file, or to a directory of files.

R

read - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
read() - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
readConcurrency() - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
readNext(SynchronousSink<Record>) - Method in interface com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector.RecordReader
Reads the next record and emits the record to the sink, if any.
readSingleFile(URL, URI) - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
Reads a single text file accessible through the given URL.
RECURSIVE - Static variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
recursive - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
resourceCount - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
retainRecordSources - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
roots - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 

S

scanRootDirectory(Path) - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
Scans a directory for readable files and returns the files found as a stream.
singleWriter - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
SKIP_RECORDS - Static variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
skipRecords - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 

U

URL - Static variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
URLFILE - Static variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
urls - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 

W

write(Record) - Method in interface com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector.RecordWriter
Writes the record to the destination file, in a thread-safe manner (i.e., this method is never called concurrently).
write() - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
writeConcurrency() - Method in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
writers - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
writersToClose - Variable in class com.datastax.oss.dsbulk.connectors.commons.AbstractFileBasedConnector
 
A C E F G I L M N P R S U W 
Skip navigation links

Copyright © 2017–2023 DataStax. All rights reserved.