MongoDB Tutorial 18 : MongoDB import/export data

Load data from the mongo shell

If you are in the mongoshell and want to import some data, then the simplest approach is to use the load(path) function in the mongoshell, that will load data from a JSON file:
load("/full/path/to/sample-data.json")

Mongo Import – import JSON data

Note that mongoimport and mongoexport use data in JSON format, whereas MongoDB stores them in BSON, which is superset of JSON. Thus mongoimport and mongoexport don’t reliably preserve all BSON data types, therefore should not be used for production backups, but they are ok for testing and playing with MongoDB.

Import data into selected database and collection

mongoimport --db mydb --collection mycoll --file mydata.json
If you omit collection parameter, then target collection name will be taken from the filename (without file extension):
# Imports into "customers" collection:
mongoimport --db mydb --file customers.json

Import using shorter syntax:

mongoimport -d mydb -c mycoll < mydata.json

Mongo Export – export JSON/CSV data

mongoexport has mostly the same parameters as mongoimport.

Export selected collection as JSON

mongoexport --db mycoll --collection mycoll --out mydata.json

Export selected collection as CSV

mongoexport --db mycoll --collection mycoll --out mydata.csv --type=csv

Export only documents matching query:

mongoexport --db sales --collection contacts --query '{"city": "Cracow"}'

Export data from remote MongoDB host

mongoexport --host mongodb1.mycorp.kam --port 37017 --username user
            --password pass --collection contacts --out mdb1-examplenet.json

Comments

Post a Comment

Popular posts from this blog

Hive Tutorial 31 : Analytic Functions

Image
Hadoop Hive analytic functions compute an aggregate value that is based on a group of rows. A Hadoop Hive HQL analytic function works on the group of rows and ignores the NULL in the data if you specify Hadoop Hive COUNT Analytic Function Returns number of rows in query or group of rows. Syntax: COUNT(column reference | value expression | *) over(window_spec) For Example; select pat_id, dept_id, count(*) over (partition by dept_id order by dept_id asc) as pat_cnt from patient; at_id dept_id pat_cnt 6 111 4 2 111 4 5 111 4 1 111 4 4 222 3 5 222 3 3 222 3 7 333 1 8 444 1 Hadoop Hive SUM Analytic Function Just like count function, sum Hive analytic function is used to compute the sum of columns or expression. Sum analytic function is used to compute the sum of all rows of table or rows within the groups. Syntax: SUM(column | expression) OVER( window_spec) For example: Calculate sum insured amount of all patients within each department...
Read more

Hive Tutorial 37 : Performance Tuning

Performance plays key role in big data related projects as they deals which huge amount of data. So when you are using Hive if you keep few things in mind then we can see dramatic change in the performance.  Performance tuning in hive: Partitions Bucketing File formats Compression Sampling Tez Vectorization Parallel execution CBO Partitions : The concept of partitioning in Hive is very similar to what we have in RDBMS. A table can be partitioned by one or more keys. This will determine how the data will be stored in the table. For example, if a table has two columns, id, name and age; and is partitioned by age, all the rows having same age will be stored together. So when we try to query based on age range, then hive will retrieve the data by going into particular folders instead of parsing through whole data. /hdfs/user/tablename/age/10 /hdfs/user/tablename/age/11 Bucketing : Bucketing is more efficient for sampling,data will be segre...
Read more