Showing posts with label pig. Show all posts
Showing posts with label pig. Show all posts
Tuesday, May 2, 2017

Pig job fails with "org.apache.hadoop.mapreduce.counters.LimitExceededException: Too many counters: 121 max=120"

›
Symptom: Pig job fails with "org.apache.hadoop.mapreduce.counters.LimitExceededException: Too many counters: 121 max=120".
1 comment:
Wednesday, April 22, 2015

Huge Pig job causes local /tmp directory runs out of disk space.

›
Symptom: Huge Pig job causes local /tmp directory runs out of disk space. Env: Pig 0.13 Root cause: Per PIG-1838 , pig keeps the jar...
1 comment:
Friday, April 17, 2015

Understand spill file index in MapReduce V2

›
Env Hadoop 2.x MapReduce V2 Goal This article explains when MapReduce V2 starts to generate spill file index files. We will explorer ...
1 comment:
Thursday, April 16, 2015

Pig job fails with ApplicationMaster OutOfMemoryError when writing parquet files.

›
Env: Pig 0.13 on Yarn Symptom: A pig job which is reading and writing many parquet files, fails with ApplicationMaster OutOfMemoryErro...
Tuesday, January 27, 2015

How to access Hive table with RCFile storage in Pig

›
Goal: This article shows how to access Hive table with RCFile storage in Pig. Solution: 1. Create a hive table with RCFile storage. c...
3 comments:
Wednesday, January 7, 2015

Oozie pig job fails with "Provider org.apache.hadoop.hdfs.HftpFileSystem$TokenManager not found"

›
Env: MapR 4.0.0 or above. Symptom: Oozie pig job fails with below errors by running command "oozie job -log <jobID>": ...
1 comment:
Thursday, November 27, 2014

Failed to load hive table in pig using hcatalog

›
Symptom: In pig, loading hive table using HCatLoader fails with below error message: grunt> a = load 'passwords' using org.apa...
2 comments: