Symptom: When using Spark writing to S3, the insert query failed: Caused by: java.lang.NoSuchMethodError: com.google.common.base.Preconditi...

Symptom: When using Spark writing to S3, the insert query failed: java.lang.NoSuchMethodError: org.apache.hadoop.util.SemaphoredDelegatingE...

Goal: This article explains how to access Azure Open Dataset from Spark. Env: spark-3.1.1-bin-hadoop2.7

Goal: This article research on how Spark calculates the Decimal precision and scale using GPU or CPU mode. Basically we will test Addition/S...

Symptom: kubelet failed to start after rebooting.

Goal: This article shares the steps on how to run Spark job with Rapids Accelerator using Spark Operator in a Kubernetes Cluster.

Goal: This article talked about the compatibility of Rapids Accelerator for Spark regarding parquet writing related to parameters spark.sql....

Goal: This article digs into different types of SparkListenerEvent in Spark event log with some examples.  Understanding this can help us kn...

Goal: This article shows how to use latest version of Rapids Accelerator for Spark on EMR.  Currently the latest EMR 6.2 only ships with Rap...

Goal: This article explains how to use NVIDIA Nsight Systems to profile a Spark on K8s job with Rapids Accelerator. This is a follow-up blog...