StreamingLogisticRegressionWithSGD

class pyspark.mllib.classification.StreamingLogisticRegressionWithSGD(stepSize=0.1, numIterations=50, miniBatchFraction=1.0, regParam=0.0, convergenceTol=0.001)

Train or predict a logistic regression model on streaming data. Training uses Stochastic Gradient Descent to update the model based on each new batch of incoming data from a DStream.

Each batch of data is assumed to be an RDD of LabeledPoints. The number of data points per batch can vary, but the number of features must be constant. An initial weight vector must be provided.

New in version 1.5.0.

Parameters:

stepSizefloat, optional

Step size for each iteration of gradient descent. (default: 0.1)

numIterationsint, optional

Number of iterations run for each batch of data. (default: 50)

miniBatchFractionfloat, optional

Fraction of each batch of data to use for updates. (default: 1.0)

regParamfloat, optional

L2 Regularization parameter. (default: 0.0)

convergenceTolfloat, optional

Value used to determine when to terminate iterations. (default: 0.001)

Methods

latestModel()	Returns the latest model.
predictOn(dstream)	Use the model to make predictions on batches of data from a DStream.
predictOnValues(dstream)	Use the model to make predictions on the values of a DStream and carry over its keys.
setInitialWeights(initialWeights)	Set the initial value of weights.
trainOn(dstream)	Train the model on the incoming dstream.

Methods Documentation

latestModel()

Returns the latest model.

New in version 1.5.0.

predictOn(dstream)

Use the model to make predictions on batches of data from a DStream.

New in version 1.5.0.

Returns:

pyspark.streaming.DStream

DStream containing predictions.

predictOnValues(dstream)

Use the model to make predictions on the values of a DStream and carry over its keys.

New in version 1.5.0.

Returns:

pyspark.streaming.DStream

DStream containing predictions.

setInitialWeights(initialWeights)

Set the initial value of weights.

This must be set before running trainOn and predictOn.

New in version 1.5.0.

trainOn(dstream)

Train the model on the incoming dstream.

New in version 1.5.0.

NaiveBayes BisectingKMeansModel