pyspark.SparkContext.binaryRecords

SparkContext.binaryRecords(path, recordLength)[source]

Load data from a flat binary file, assuming each record is a set of numbers with the specified numerical format (see ByteBuffer), and the number of bytes per record is constant.

Parameters:
pathstr

Directory to the input data files

recordLengthint

The length at which to split the records

pyspark.SparkContext.binaryFiles pyspark.SparkContext.broadcast