Sqoop tutorial 2 : Sqoop Import

Sqoop import tool imports an individual table from an RDBMS to HDFS. Each row from a table is represented as a separate record in HDFS. Records can be stored as text files (one record per line), or in binary representation as Avro or SequenceFiles.

 Syntax : 
sqoop import --connect jdbc:mysql://database.example.com/tablename \
    --username  --password

Comments

Post a Comment

Popular posts from this blog

Unix Tutorial 14 : Text Processing Commands 1

Unix Filter Commands grep:  Find lines in stdin that match a pattern and print them to stdout. sort:  Sort the lines in stdin, and print the result to stdout. uniq:  Read from stdin and print unique (that are different from the adjacent line) to stdout. cat:  Read lines from stdin (and more files), and concatenate them to stdout. more:  Read lines from stdin, and provide a paginated view to stdout. cut:  Cut specified byte, character or field from each line of stdin and print to stdout. paste:  Read lines from stdin (and more files), and paste them together line-by-line to stdout. head:  Read the first few lines from stdin (and more files) and print them to stdout. tail:  Read the last few lines from stdin (and more files) and print them to stdout. wc:  Read from stdin, and print the number of newlines, words, and bytes to stdout. tr:  Translate or delete characters read from stdin and print to stdout. Command grep...
Read more

Unix Tutorial 11 : Conditional Statements

Unix Conditional Statements The if-elif-fi Unix provides a number of relational operators in addition to the logical operators mentioned earlier. These can be used to compare numeric values. -lt less than -le less than or equal to -gt greater than -ge greater than or equal to -eq equal to -ne not equal to Unix provides a number of ways for conditionally executing the other commands. These are covered below: #1) The if statements Example: if <control command> then <statements> fi #2) The if…else statements Example: if <control command> then <statements> else <statements> fi #3) The if…elif…else…fi statement Example: if <control command> then <statements> elif then <statements> else <statements fi Given below are some example programs that illustrate these conditional statements: #1) Check if an input number is positive: $ echo “Enter a number” $ read num $ if [ $num -gt 0 ] $ t...
Read more

Unix Tutorial 16 : Command Line Arguments

While running a command, the user can pass a variable number of parameters in the command line. Within the command script, the passed parameters are accessible using ‘positional parameters’.  These range from $0 to $9, where $0 refers to the name of the command itself, and $1 to $9 are the first through to the ninth parameter, depending on how many parameters were actually passed. Example: $ sh hello how to do you do Here $0 would be assigned sh $1 would be assigned hello $2 would be assigned how And so on … We will now look at some additional commands to process these parameters. #1) set Each process is also associated with a priority. This is used to ensure that the OS is able to fairly allocate time to various processing tasks. The ‘nice’ command can be used to reduced the priority of a process and thus be ‘nice’ to the other processes, i.e. $ nice <command> This line will run the specified command at a lower priority – by default, the priority wi...
Read more