hadoop - How TO Filter by _id in mongodb using pig -

-

i have mongo documents this:

db.activity_days.findone() {     "_id" : objectid("54b4ee617acf9ce0440a3185"),     "aca" : 0,     "ca" : 0,     "cbdw" : true,     "day" : isodate("2014-12-10t00:00:00z"),     "dm" : 0,     "fbc" : 0,     "go" : 2500,     "gs" : [ ],     "its" : [         {             "_id" : objectid("551ac8d44f9f322e2b055d3a"),             "at" : 2000,             "atn" : "running",             "cas" : 386.514909469507,             "dis" : 2.788989730832084,             "du" : 1472,             "ibr" : false,             "ide" : false,             "lcs" : false,             "pt" : 0,             "rpt" : 0,             "src" : 1001,             "stp" : 0,             "tcs" : [ ],             "ts" : 1418257729,             "u_at" : isodate("2015-01-13t00:32:10.954z")         }     ],     "po" : 0,     "se" : 0,     "st" : 0,     "tap3c" : [ ],     "tzo" : -21600,     "u_at" : isodate("2015-01-13t00:32:10.952z"),     "uid" : objectid("545eb753ae9237b1df115649") }

i want use pig filter special _id range,i can write mongo query this:

db.activity_day.find(_id:{$gt:objectid("54a48e000000000000000000"),$lt:objectid("54cd6c800000000000000000")})

but don't know how write in pig, knows?

you try using mongo-hadoop connector pig, see mongo-hadoop: usage pig.

once register jars (core, pig, , java driver), e.g., register /path-to/mongo-hadoop-pig-<version>.jar; via grunt run:

set mongo.input.query '{"_id":{"\$gt":{"\$oid":"54a48e000000000000000000},"\$lt":{"\$oid":"54cd6c800000000000000000}}}' rangeactivityday = load 'mongodb://localhost:27017/database.collection' using com.mongodb.hadoop.pig.mongoloader() dump rangeactivityday

you may want use limit before dumping data well.

the above tested using: mongo-java-driver-3.0.0-rc1.jar, mongo-hadoop-pig-1.4.0.jar, mongo-hadoop-core-1.4.0.jar , mongodb v3.0.9


Comments

Post a Comment

Popular posts from this blog

Delphi XE2 Indy10 udp client-server interchange using SendBuffer-ReceiveBuffer -

-
i use delphi xe2 , indy10 udp protocol. can't receive server echo on client side if use receivebuffer method. got "socket error # 10040" although send small echo message server client. console application illustrate problem below. in advance. program project1; {$apptype console} {$r *.res} uses system.sysutils, idglobal, idbasecomponent, idcomponent, idsockethandle, idudpclient, idudpserver, idudpbase, idstack; type tudp_serv = class(tidudpserver) procedure udpsvudpread(athread: tidudplistenerthread; adata: tidbytes; abinding: tidsockethandle); end; var udpserver: tudp_serv; udpcl: tidudpclient; bsnd, brcv: tbytes; s: string; k: integer; //============================================================================== procedure tudp_serv.udpsvudpread(athread: tidudplistenerthread; adata: tidbytes; abinding: tidsockethandle); begin writeln(' server read: ' + tohex(adata, length(adata))); abinding sendto(peerip, peerport, adat...
Read more

Qt ActiveX WMI QAxBase::dynamicCallHelper: ItemIndex(int): No such property in -

-
i new windows programming. here goes code objiwbemlocator = new qaxobject("wbemscripting.swbemlocator"); objwmiservice = objiwbemlocator->querysubobject("connectserver(qstring&,qstring&)",qstring("."),qstring("root\\cimv2")); qaxobject* returnlist = objwmiservice->querysubobject("execquery(qstring&)", qstring("select * %1").arg(domain)); qaxobject* result = returnlist->querysubobject("itemindex(int)", 0); i getting error on runtime qt activex wmi qaxbase::dynamiccallhelper: itemindex(int): no such property in but itemindex method exists msdn says the itemindex method not work collections not contain swbemobjects, such swbemmethodset, swbemnamedvalueset, swbemprivilegeset, swbempropertyset, , swbemqualifierset. what selecting ? have tried iterating on collection ? plus need minimum windows vista itemindex method. hope helps
Read more

Enable autocomplete or intellisense in Atom editor for PHP -

-
i'm first time user of atom editor php code. atom can autocomplete built-in functions of php. possible make editor autocomplete custom function written in separate file? function.php <?php function printsomething() { echo "hello world"; } index.php <?php require_once "function.php"; printsomething(); // autocompleted atom editor while typing thanks in advance. there text file in %userprofile%.atom called snippets.cson. in there can add snippet. more this: http://flight-manual.atom.io/using-atom/sections/snippets/ but need think can use later on other files well. otherwise need copy , paste.
Read more