Showing posts with label
pig
.
Show all posts
Showing posts with label
pig
.
Show all posts
Tuesday, May 2, 2017
Pig job fails with "org.apache.hadoop.mapreduce.counters.LimitExceededException: Too many counters: 121 max=120"
›
Symptom: Pig job fails with "org.apache.hadoop.mapreduce.counters.LimitExceededException: Too many counters: 121 max=120".
Wednesday, April 22, 2015
Huge Pig job causes local /tmp directory runs out of disk space.
›
Symptom: Huge Pig job causes local /tmp directory runs out of disk space. Env: Pig 0.13 Root cause: Per PIG-1838 , pig keeps the jar...
Friday, April 17, 2015
Understand spill file index in MapReduce V2
›
Env Hadoop 2.x MapReduce V2 Goal This article explains when MapReduce V2 starts to generate spill file index files. We will explorer ...
Thursday, April 16, 2015
Pig job fails with ApplicationMaster OutOfMemoryError when writing parquet files.
›
Env: Pig 0.13 on Yarn Symptom: A pig job which is reading and writing many parquet files, fails with ApplicationMaster OutOfMemoryErro...
Tuesday, January 27, 2015
How to access Hive table with RCFile storage in Pig
›
Goal: This article shows how to access Hive table with RCFile storage in Pig. Solution: 1. Create a hive table with RCFile storage. c...
Wednesday, January 7, 2015
Oozie pig job fails with "Provider org.apache.hadoop.hdfs.HftpFileSystem$TokenManager not found"
›
Env: MapR 4.0.0 or above. Symptom: Oozie pig job fails with below errors by running command "oozie job -log <jobID>": ...
Thursday, November 27, 2014
Failed to load hive table in pig using hcatalog
›
Symptom: In pig, loading hive table using HCatLoader fails with below error message: grunt> a = load 'passwords' using org.apa...
›
Home
View web version