public static class
RecordInput.Options
Optional attributes for RecordInput
Public Methods
RecordInput.Options |
batchSize(Long batchSize)
|
RecordInput.Options |
compressionType(String compressionType)
|
RecordInput.Options |
fileBufferSize(Long fileBufferSize)
|
RecordInput.Options |
fileParallelism(Long fileParallelism)
|
RecordInput.Options |
fileRandomSeed(Long fileRandomSeed)
|
RecordInput.Options |
fileShuffleShiftRatio(Float fileShuffleShiftRatio)
|
Inherited Methods
Public Methods
public RecordInput.Options compressionType (String compressionType)
Parameters
compressionType | The type of compression for the file. Currently ZLIB and GZIP are supported. Defaults to none. |
---|
public RecordInput.Options fileBufferSize (Long fileBufferSize)
Parameters
fileBufferSize | The randomization shuffling buffer. |
---|
public RecordInput.Options fileParallelism (Long fileParallelism)
Parameters
fileParallelism | How many sstables are opened and concurrently iterated over. |
---|
public RecordInput.Options fileRandomSeed (Long fileRandomSeed)
Parameters
fileRandomSeed | Random seeds used to produce randomized records. |
---|
public RecordInput.Options fileShuffleShiftRatio (Float fileShuffleShiftRatio)
Parameters
fileShuffleShiftRatio | Shifts the list of files after the list is randomly shuffled. |
---|