GeneralMLWriter#

class pyspark.ml.util.GeneralMLWriter[source]#

Utility class that can save ML instances in different formats.

New in version 2.4.0.

Methods

`format`(source)	Specifies the format of ML export ("pmml", "internal", or the fully qualified class name for export).
`option`(key, value)	Adds an option to the underlying MLWriter.
`overwrite`()	Overwrites if the output path already exists.
`save`(path)	Save the ML instance to the input path.
`saveImpl`(path)	save() handles overwriting and then calls this method.
`session`(sparkSession)	Sets the Spark Session to use for saving/loading.

Attributes

`sc`	Returns the underlying SparkContext.
`sparkSession`	Returns the user-specified Spark Session or the default.

Methods Documentation

format(source)[source]#: Specifies the format of ML export (“pmml”, “internal”, or the fully qualified class name for export).

option(key, value)#: Adds an option to the underlying MLWriter. See the documentation for the specific model’s writer for possible options. The option name (key) is case-insensitive.

overwrite()#: Overwrites if the output path already exists.

save(path)#: Save the ML instance to the input path.

saveImpl(path)#: save() handles overwriting and then calls this method. Subclasses should override this method to implement the actual saving of the instance.

session(sparkSession)#: Sets the Spark Session to use for saving/loading.

Attributes Documentation

sc#: Returns the underlying SparkContext.

sparkSession#: Returns the user-specified Spark Session or the default.