pyspark.sql.functions.date_diff#

pyspark.sql.functions.date_diff(end, start)[source]#

Returns the number of days from start to end.

New in version 3.5.0.

Parameters

endColumn or column name: to date column to work on.
startColumn or column name: from date column to work on.

Returns

Column: difference in days between two dates.

See also

pyspark.sql.functions.dateadd()
pyspark.sql.functions.date_add()
pyspark.sql.functions.date_sub()
pyspark.sql.functions.datediff()
pyspark.sql.functions.timestamp_diff()

Examples

>>> import pyspark.sql.functions as sf
>>> df = spark.createDataFrame([('2015-04-08','2015-05-10')], ['d1', 'd2'])
>>> df.select('*', sf.date_diff('d1', 'd2')).show()
+----------+----------+-----------------+
|        d1|        d2|date_diff(d1, d2)|
+----------+----------+-----------------+
|2015-04-08|2015-05-10|              -32|
+----------+----------+-----------------+

>>> df.select('*', sf.date_diff(df.d2, df.d1)).show()
+----------+----------+-----------------+
|        d1|        d2|date_diff(d2, d1)|
+----------+----------+-----------------+
|2015-04-08|2015-05-10|               32|
+----------+----------+-----------------+