Calculating Week Start and Week End Dates with Spark
You can use native Spark functions to compute the beginning and end dates for a week, but the code isn’t intuitive. This blog post demonstrates how to wrap the complex […]
2020
Wrapping Java Code with Clean Scala Interfaces
This post explains how to wrap a Java library with a Scala interface. You can instantiate Java classes directly in Scala, but it’s best to wrap the Java code, so […]
Serializing and Deserializing Scala Case Classes with JSON
This blog post shows how to serialize and deserialize Scala case classes with the JSON file format. Serialization is important when persisting data to disk or transferring data over the […]
Reading and writing JSON with Scala
This blog post explains how to read and write JSON with Scala using the uPickle / uJSON library. This library makes it easy to work with JSON files in Scala. […]
Creating open source software is a delight
Writing open source software gives you the opportunity to collaborate with highly motivated developers and build awesome code that’s used by folks around the world. You can influence community best […]
Scala Filesystem Operations (paths, move, copy, list, delete)
Basic filesystem operations have traditionally been complex in Scala. A simple operation like copying a file is a one-liner in some languages like Ruby, but a multi-line / multi-import mess […]
Migrating Scala Projects to Spark 3
This post explains how to migrate your Scala projects to Spark 3. It covers the high level steps and doesn’t get into all the details. Migrating PySpark projects is easier. […]
Reading data from Google Sheets to Spark DataFrames
This blog post explains how to read a Google Sheet into a Spark DataFrame with the spark-google-spreadsheets library. Google Sheets is not a good place to store a lot of […]
Managing Multiple Java, SBT, and Scala Versions with SDKMAN
SDKMAN is an amazing project that makes it easy to manage multiple versions of Java and Scala on a single computer. It also provides support for other Java ecosystem projects […]
Running Multiple Versions of Java on MacOS with jenv
jenv makes it easy to run multiple versions of Java on a Mac computer. It also makes it easy to seamlessly switch between Java versions when you switch projects. Running […]