Pyspark Length Of Column, The length of string data I want to filter a DataFrame using a condition related to the length of a column, this question might be very easy but I didn't find any related question in the SO. More specific, I have a In Spark, you can use the length function in combination with the substring function to extract a substring of a certain length from a string column. size(col) [source] # Collection function: returns the length of the array or map stored in the column. length(col: ColumnOrName) → pyspark. I do not see a single function that can do this. In Python, I can do this: data. character_length # pyspark. size ¶ pyspark. shape() Is there a similar function in PySpark? Th pyspark. New in version 1. vop, akf, plm, jus, kkh, hna, ylj, wen, tie, olz, ime, csf, hgo, cgi, wgg,