Tudor Lapusan's Blog

Post info:

Spark 2.3.0 implementes vertical display row for Dataframe/Dataset

When you have a large number of columns in your Dataframe/Dataset and you want to display all, the result is not very¬†pretty printed.¬†In this short post, I will use Spark 2.3.0(pyspark) and Apache Zeppelin. As you can see in the above image, it’s kind of hard to see whose column each value belongs. Imagine you have way more columns, it’s even harder to understand the results. Until Spark 2.3.0, the single solution I’m aware of is to select fewer columns

Read the full post