pyspark.sql.functions.last

pyspark.sql.functions.last(col: ColumnOrName, ignorenulls: bool = False) → pyspark.sql.column.Column

Aggregate function: returns the last value in a group.

The function by default returns the last values it sees. It will return the last non-null value it sees when ignoreNulls is set to true. If all values are null, then null is returned.

New in version 1.3.0.

Notes

The function is non-deterministic because its results depends on the order of the rows which may be non-deterministic after a shuffle.

pyspark.sql.functions.kurtosis pyspark.sql.functions.max