Working with dates and times in Spark
Spark supports DateType and TimestampType columns and defines a rich API of functions to make working with dates and times easy. This blog post will demonstrates how to make DataFrames […]
Spark supports DateType and TimestampType columns and defines a rich API of functions to make working with dates and times easy. This blog post will demonstrates how to make DataFrames […]
Apache Spark makes it easy to build data lakes that are optimized for AWS Athena queries. This blog post will demonstrate that it’s easy to follow the AWS Athena tuning […]
Spark code will run faster with certain data lakes than others. For example, Spark will run slowly if the data lake uses gzip compression and has unequally sized files (especially […]