How to use NVIDIA Nsight Systems to profile a Spark job on Rapids Accelerator

Goal:

This article explains how to use NVIDIA Nsight Systems to profile a Spark job on Rapids Accelerator.

How to enable GpuKryoRegistrator on RAPIDS Accelerator for Spark

Goal:

This article shares the steps to enable GpuKryoRegistrator on RAPIDS Accelerator for Spark.

How to install a Kubernetes Cluster with NVIDIA GPU on AWS using DeepOps

Goal:

This article shares a step-by-step guide on how to install a Kubernetes Cluster with NVIDIA GPU on AWS using DeepOps.

How to install a Kubernetes Cluster with NVIDIA GPU on AWS

Goal:

This article shares a step-by-step guide on how to install a Kubernetes Cluster with NVIDIA GPU on AWS. 

It includes spinning up an AWS EC2 instance, installing NVIDIA drivers&cudatoolkit, installing Kubernetes Cluster with GPU support, and eventually ran a Spark+Rapids job to test it.

concat_ws example on Spark with RAPIDS Accelerator

Goal:

This is a quick example of operator contact_ws on Spark with RAPIDS Accelerator.

Hands-on native cuDF Pandas UDF

Goal:

This article will help show some hands-on steps to play with native cuDF Pandas UDF on Spark with RAPIDS Accelerator for Apache Spark.

How to run the pandas cudf_udf test for RAPIDS Accelerator for Apache Spark

Goal:

How to run the pandas cudf_udf test for RAPIDS Accelerator for Apache Spark.

Understanding RAPIDS Accelerator For Apache Spark's supported timezone

Goal:

This article explains the current supported timezone for "RAPIDS Accelerator For Apache Spark".

Spark Tuning -- Adaptive Query Execution(3): Dynamically optimizing skew joins

Goal:

This article explains Adaptive Query Execution (AQE)'s "Dynamically optimizing skew joins" feature introduced in Spark 3.0. 

This is a follow up article for Spark Tuning -- Adaptive Query Execution(1): Dynamically coalescing shuffle partitions, and Spark Tuning -- Adaptive Query Execution(2): Dynamically switching join strategies.

What Dataset API is not supported for RAPIDS Accelerator for Apache Spark

Goal:

This article explains what Dataset API is not supported for RAPIDS Accelerator for Apache Spark.