Update an existing collection in MongoDB using Java-Hadoop connector

Question

Is it possible to update existing MongoDB collection with new data. I am using hadoop job to read write data to Mongo. Required scenario is :- Say first collection in Mongo is

{ 
  "_id" : 1,
  "value" : "aaa"
  "value2" : null
}

after reading data from Mongo and processing data, MongoDB should contain

{ 
  "_id" : 1,
  "value" : "aaa"
  "value2" : "bbb"
}

If possible, please provide some dummy code.

Can't you use a simple update with a $set basicDBObject? – peshkira May 30 '12 at 14:40 — peshkira, May 30 '12 at 14:40

score 3 · Answer 1 · edited Sep 23 '15 at 01:35

BasicBSONObject query=new BasicBSONObject();
query.append("fieldname", value);
BasicBSONObject update=new BasicBSONObject();

update.append("$set", new BasicBSONObject().append("newfield",value));
MongoUpdateWritable muw=new MongoUpdateWritable(query,update,false,true);
contex.write(key, muw);

query : is used for providing condition(matching condition).

update : is used for adding new field and value in existing collection.

MongoUpdateWritable: 3rd parameter is upsert value(same as mongodb)

4th parameter is multiple update in many documents in a collection.

Set in Driver class job.setOutputValueClass(MongoUpdateWritable.class);

score 1 · Accepted Answer · answered Jul 25 '12 at 06:19

1

I have done it by extending org.apache.hadoop.mapreduce.RecordWriter and overriding write method of this class.

answered Jul 25 '12 at 06:19

Abhishek bhutra

1,400
1
11
29

score 0 · Answer 3 · answered Jun 06 '12 at 14:53

0

The Mongo-Hadoop Connector doesn't currently suppor this feature. You can open a feature request in the MongoDB Jira if you like.

answered Jun 06 '12 at 14:53

Brendan W. McAdams

9,379
3
41
31

score 0 · Answer 4 · answered Oct 28 '16 at 07:38

0

I have done it by the stratio, if you are using spark, you can check it out!

answered Oct 28 '16 at 07:38

DeFOX

86
1
8

Update an existing collection in MongoDB using Java-Hadoop connector

4 Answers4