Monday, July 6, 2015

Beeline of HiveServer2 hangs if huge output data needs to return

Env:

Hive all versions

Symptom:

Beeline of HiveServer2 hangs if huge output data needs to return.
Users can only ctrl-C beeline.
Out of Memory error may show up.

Root Cause:

Per HIVE-7224, by default beeline tries to buffer the entire output relation before printing it on stdout.

Solution:

Beeline has the option "--incremental=true" to print output incrementally.
This option is not in "beeline --help" command output yet, but it is documented here.
So just invoke beeline as below:
beeline --incremental=true

No comments:

Post a Comment

Popular Posts