From 0273f2e65d97374ed20813c952ca18666d876626 Mon Sep 17 00:00:00 2001 From: Raymond Xu <2701446+xushiyan@users.noreply.github.com> Date: Sun, 2 Jan 2022 20:34:37 -0800 Subject: [PATCH] [MINOR] Update README.md (#4492) Update Spark 3 build instructions --- README.md | 11 +++++++++-- 1 file changed, 9 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index f20ec82dd..4f48fc6c7 100644 --- a/README.md +++ b/README.md @@ -78,12 +78,19 @@ The default Scala version supported is 2.11. To build for Scala 2.12 version, bu mvn clean package -DskipTests -Dscala-2.12 ``` -### Build with Spark 3.0.0 +### Build with Spark 3 -The default Spark version supported is 2.4.4. To build for Spark 3.0.0 version, build using `spark3` profile +The default Spark version supported is 2.4.4. To build for different Spark 3 versions, use the corresponding profile ``` +# Build against Spark 3.2.0 (default build shipped with the public jars) mvn clean package -DskipTests -Dspark3 + +# Build against Spark 3.1.2 +mvn clean package -DskipTests -Dspark3.1.x + +# Build against Spark 3.0.3 +mvn clean package -DskipTests -Dspark3.0.x ``` ### Build without spark-avro module