org.apache.spark.scheduler

Class AccumulableInfo

Object

org.apache.spark.scheduler.AccumulableInfo

All Implemented Interfaces:

java.io.Serializable, scala.Equals, scala.Product

public class AccumulableInfo
extends Object
implements scala.Product, scala.Serializable

:: DeveloperApi :: Information about an Accumulable modified during a task or stage.

param: id accumulator ID param: name accumulator name param: update partial value from a task, may be None if used on driver to describe a stage param: value total accumulated value so far, maybe None if used on executors to describe a task param: internal whether this accumulator was internal param: countFailedValues whether to count this accumulator's partial value if the task failed param: metadata internal metadata associated with this accumulator, if any

See Also:

Serialized Form

Note:

Once this is JSON serialized the types of update and value will be lost and be cast to strings. This is because the user can define an accumulator of any type and it will be difficult to preserve the type in consumers of the event log. This does not apply to internal accumulators that represent task level metrics.

Method Summary

Modifier and Type	Method and Description
static AccumulableInfo	apply(long id, String name, scala.Option<String> update, String value) Deprecated. do not create AccumulableInfo. Since 2.0.0.
static AccumulableInfo	apply(long id, String name, scala.Option<String> update, String value, boolean internal) Deprecated. do not create AccumulableInfo. Since 2.0.0.
static AccumulableInfo	apply(long id, String name, String value) Deprecated. do not create AccumulableInfo. Since 2.0.0.
abstract static boolean	canEqual(Object that)
abstract static boolean	equals(Object that)
long	id()
scala.Option<String>	name()
abstract static int	productArity()
abstract static Object	productElement(int n)
static scala.collection.Iterator<Object>	productIterator()
static String	productPrefix()
scala.Option<Object>	update()
scala.Option<Object>	value()

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Method Detail

apply

public static AccumulableInfo apply(long id,
                                    String name,
                                    scala.Option<String> update,
                                    String value,
                                    boolean internal)

Deprecated. do not create AccumulableInfo. Since 2.0.0.

apply

public static AccumulableInfo apply(long id,
                                    String name,
                                    scala.Option<String> update,
                                    String value)

Deprecated. do not create AccumulableInfo. Since 2.0.0.

apply

public static AccumulableInfo apply(long id,
                                    String name,
                                    String value)

Deprecated. do not create AccumulableInfo. Since 2.0.0.

canEqual

public abstract static boolean canEqual(Object that)

equals

public abstract static boolean equals(Object that)

productElement

public abstract static Object productElement(int n)

productArity

public abstract static int productArity()

productIterator

public static scala.collection.Iterator<Object> productIterator()

productPrefix

public static String productPrefix()

id

public long id()

name

public scala.Option<String> name()

update

public scala.Option<Object> update()

value

public scala.Option<Object> value()