Setup

kontextfrei is currently divided into two separate modules:

  • kontextfrei-core: The main artifact to depend on when using kontextfrei
  • kontextfrei-scalatest: An optional artifact that provides some helpers for using kontextfrei with ScalaTest.

kontextfrei-core assumes that the Spark dependency is provided by your application, so you have to explicitly add a dependency to Spark in your build definition. This is because you usually want to depend on Spark in provided scope anyway in your applications.

Currently, kontextfrei binary releases are built against Spark 1.4.1, 2.0.0, 2.1.0, and 2.2.0, each of them both for Scala 2.11 and 2.10.

Here is what you need to add to your build.sbt file in order to use kontextfrei-core and kontextfrei-scalatest in your SBT project:

Spark 1.4.1

resolvers += "dwestheide" at "https://dl.bintray.com/dwestheide/maven"
libraryDependencies += "com.danielwestheide" %% "kontextfrei-core-spark-1.4.1" % "0.6.0"
libraryDependencies += "com.danielwestheide" %% "kontextfrei-scalatest-spark-1.4.1" % "0.6.0"
libraryDependencies += "org.apache.spark" %% "spark-core" % "1.4.1" % "provided"

Spark 2.0

resolvers += "dwestheide" at "https://dl.bintray.com/dwestheide/maven"
libraryDependencies += "com.danielwestheide" %% "kontextfrei-core-spark-2.0.0" % "0.6.0"
libraryDependencies += "com.danielwestheide" %% "kontextfrei-scalatest-spark-2.0.0" % "0.6.0"
libraryDependencies += "org.apache.spark" %% "spark-core" % "2.0.0" % "provided"

Spark 2.1.0

resolvers += "dwestheide" at "https://dl.bintray.com/dwestheide/maven"
libraryDependencies += "com.danielwestheide" %% "kontextfrei-core-spark-2.1.0" % "0.6.0"
libraryDependencies += "com.danielwestheide" %% "kontextfrei-scalatest-spark-2.1.0" % "0.6.0"
libraryDependencies += "org.apache.spark" %% "spark-core" % "2.1.0" % "provided"

Spark 2.2.0

resolvers += "dwestheide" at "https://dl.bintray.com/dwestheide/maven"
libraryDependencies += "com.danielwestheide" %% "kontextfrei-core-spark-2.2.0" % "0.6.0"
libraryDependencies += "com.danielwestheide" %% "kontextfrei-scalatest-spark-2.2.0" % "0.6.0"
libraryDependencies += "org.apache.spark" %% "spark-core" % "2.2.0" % "provided"