Calculating Week Start and Week End Dates with Spark
You can use native Spark functions to compute the beginning and end dates for a week, but the code isn’t intuitive. This blog post demonstrates how to wrap the complex […]
December 2020
Wrapping Java Code with Clean Scala Interfaces
This post explains how to wrap a Java library with a Scala interface. You can instantiate Java classes directly in Scala, but it’s best to wrap the Java code, so […]
Serializing and Deserializing Scala Case Classes with JSON
This blog post shows how to serialize and deserialize Scala case classes with the JSON file format. Serialization is important when persisting data to disk or transferring data over the […]
Reading and writing JSON with Scala
This blog post explains how to read and write JSON with Scala using the uPickle / uJSON library. This library makes it easy to work with JSON files in Scala. […]
Creating open source software is a delight
Writing open source software gives you the opportunity to collaborate with highly motivated developers and build awesome code that’s used by folks around the world. You can influence community best […]
Scala Filesystem Operations (paths, move, copy, list, delete)
Basic filesystem operations have traditionally been complex in Scala. A simple operation like copying a file is a one-liner in some languages like Ruby, but a multi-line / multi-import mess […]
Migrating Scala Projects to Spark 3
This post explains how to migrate your Scala projects to Spark 3. It covers the high level steps and doesn’t get into all the details. Migrating PySpark projects is easier. […]