Hive Tutorial 22 : Hive Configuration properties

We can set configurations in hive using set parameter:
hive.execution.engine: This is Used to change hive execution engine to mr/Tez/Spark
mapred.reduce.tasks: Used to set number of reducer tasks
hive.cli.print.header: Used to print header columns
hive.cli.print.current.db: Used to display current Database
hive.exec.compress.intermediate: Used to compress Mapper output.
hive.exec.compress.output: Used to compress reducer output.
hive.exec.parallel: To make Map jobs to Run in parallel
hive.auto.convert.join: Used to enable map join as per the input size

Refer more at :
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties

Comments

Post a Comment

Popular posts from this blog

MongoDB Tutorial 10 : Operations on Collections

In MongoDB a collection is automatically created when it is referenced in any command. For example, if you run an insert command : db. student . insert ({ name : " Viraj " }) Above command will create a collection named  student  if it doesn't exist already in the database. But we can explicitly create a collection using the  createCollection()  command. The syntax of createCollection method is : db. createCollection ( name , options ) In the above command,  name  will be the name of the collection and  options  is a document which can be used to specify configurations for the collection. options  parameter is optional, and you can simply create a collection by just providing a name for the collection. But if you want to configure your collection, you can use various options available to do so. Following are the available configuration options for creating a collection in MongoDB : Field Type Description capped boolean (Option...
Read more

Unix Tutorial 9 : Vi Editor

Modes of Unix Vi Editor The vi editor has three modes of operation viz. the command mode, the insert mode, and the ex-command mode. #1) Command mode: In this mode, all the keys work as commands. These keys are used for inserting, appending, deleting, opening new lines, moving the cursor over the paragraphs and sentences, etc. In this mode, the keys are not displayed but each key performs an operation. By default the vi editor is in command mode, hence we cannot type text in command mode. In order to write programs or text in vi editor, we need to switch to the insert mode which can be done by pressing the escape button. #2) Insert mode: In this mode, we can insert, append, edit or replace texts. We can switch from the command mode to Insert mode by pressing the escape button and then press I or A to enter into insert mode. #3) Ex command mode: This mode is used for entering commands at the bottom line of the vi editor called as a command line. To switch to Ex command ...
Read more

NoSql Tutorial 3 : CAP Theorm

Image
In   theoretical computer science , the   CAP theorem , also known as   Brewer's theorem. In order to talk about NoSQL databases or when designing any distributed system. CAP theorem states that there are three basic requirements which exist in a special relation when designing applications for a distributed architecture. Consistency   - This means that the data in the database remains consistent after the execution of an operation. For example after an update operation all clients see the same data. Availability   - This means that the system is always on (service guarantee availability), no downtime. Partition Tolerance   - This means that the system continues to function even the communication among the servers is unreliable, i.e. the servers may be partitioned into multiple groups that cannot communicate with one another. In theoretically it is impossible to fulfill all 3 requirements. CAP provides the basic requirements for a distributed ...
Read more