javascript - Need some help scraping with CasperJS -


this have:

var casper = require('casper').create();  var fs = require('fs'); var foldername = 'card_data'; var filename = 'championdecks.txt'; var save = fs.pathjoin(fs.workingdirectory, foldername, filename);  // init jquery  var casper = require('casper').create({     clientscripts: ['jquery.min.js'] });  // parse url var parseurl = 'http://magic.wizards.com/en/events/coverage/mtgochamp14';  // scrape function getdeckdata() {     var meta = $('.deck-meta h4').text();     var event = $('.deck-meta h5').text().trim();      return [meta, event]; }  casper.start(parseurl, function() {     var data = this.evaluate(getdeckdata);      fs.write(save, data + '\n', 'w'); });  casper.run();

i'm trying scrape http://magic.wizards.com/en/events/coverage/mtgochamp14 in format looks similar this:

{     "event": "2014 magic online championship",     "deckname": "(vintage) magnus lantto's pyromancer control",     "deck": [         "1 dack fayden",         "3 snapcaster mage",         "4 young pyromancer",         "3 cabal therapy",         "1 demonic tutor",         "4 gitaxian probe",         "1 ponder",         "3 preordain",         "1 time walk",         "1 treasure cruise",         "1 ancestral recall",         "1 brainstorm",         "3 dig through time",         "4 force of will",         "3 gush",         "3 lightning bolt",         "4 mental misstep",         "1 pyroblast",         "1 black lotus",         "1 mox jet",         "1 mox ruby",         "1 mox sapphire",         "3 flooded strand",         "1 island",         "4 scalding tarn",         "1 strip mine",         "2 underground sea",         "3 volcanic island"     ],     "sideboard": [         "1 pyroblast",         "1 dread of night",         "1 electrickery",         "4 grafdigger's cage",         "4 ingot chewer",         "1 mountain",         "1 null rod",         "2 pulverize"     ],     "event": "2014 magic online championship",     "deckname": "(modern) magnus lantto's elf company",     "deck": [ ... ],     "sideboard": [ ... ]      ...and on... }

i can't seem figure out how data individually. i'm getting:

(vintage) magnus lantto's pyromancer control(modern) magnus lantto's elf company(standard) magnus lantto's atarka devotion(vintage) jasper de jong's mentor control(modern) jasper de jong's melira , company(standard) jasper de jong's green-white devotion(vintage) aleksa telarov's delver(modern) aleksa telarov's burn(standard) aleksa telarov's jund megamorph(vintage) antonio del moral león's omni-oath(modern) antonio del moral león's splinter twin(standard) antonio del moral león's abzan midrange,2014 magic online championship                                               2014 magic online championship                                               2014 magic online championship                                               2014 magic online championship                                               2014 magic online championship                                               2014 magic online championship                                               2014 magic online championship                                               2014 magic online championship                                               2014 magic online championship                                               2014 magic online championship                                               2014 magic online championship                                               2014 magic online championship

can provide little wisdom send me in right direction?

assuming there event each deck name:

var meta = $('.deck-meta h4'); var event = $('.deck-meta h5'); var output = [];  for(var = 0; < meta.length; i++) {     output.push({         deckname: $(meta[i]).text(),         event: $(event[i]).text().trim()     });     }  return output;

-

Comments

Post a Comment

Popular posts from this blog

OpenCV OpenCL: Convert Mat to Bitmap in JNI Layer for Android -

there several posts converting mat bitmap using utils.mattobitmap() function. i'm assuming function can called in java layer after importing utils class. i want transfer data memory address pointed uint32_t* bmpcontent; in code below. jniexport void jnicall java_com_nod_nodcv_nodcvactivity_runfilter( jnienv *env, jclass clazz, jobject outbmp, jbytearray indata, jint width, jint height, jint choice, jint filter) { int outsz = width*height; int insz = outsz + outsz/2; androidbitmapinfo bmpinfo; if (androidbitmap_getinfo(env, outbmp, &bmpinfo) < 0) { throwjavaexception(env,"gaussianblur","error retrieving bitmap meta data"); return; } if (bmpinfo.format != android_bitmap_format_rgba_8888) { throwjavaexception(env,"gaussianblur","expecting rgba_8888 format"); return; } uint32_t* bmpcontent; if (androidbitmap_lockpixels(env, outbmp,(void**)&bmpcontent)...
Read more

android - org.xmlpull.v1.XmlPullParserException: expected: START_TAG {http://schemas.xmlsoap.org/soap/envelope/}Envelope -

i trying hit soap api in application login purpose , getting above mentioned error , can 1 tell me going wrong , first time soap apis. here code hit soap :- vector<object> args = new vector<object>(); hashtable<string, object> hashtable = new hashtable<string, object>(); hashtable.put("email", "mss.siddhart28@gmail.com"); hashtable.put("password", "siddharth"); args.add(hashtable); soapserializationenvelope envelope = new soapserializationenvelope( soapenvelope.ver11); envelope.dotnet = true; envelope.xsd = soapserializationenvelope.xsd; envelope.enc = soapserializationenvelope.enc; (new marshalhashtable()).register(envelope); httptransportse androidhttptransport = new httptransportse( "http://tempuri.org/", 15000); androidhttptransport.debug = true; string result = ""; try { soapobject request = new soapobject("http:...
Read more

python - How to remove the Xframe Options header in django? -

i have made page has iframe . inside iframe want show multiple different links article facebook, or news, or youtube video or other possible url. but, due xframe header, unable so. referred following link: https://docs.djangoproject.com/en/1.8/ref/clickjacking/ , django xframeoptionsmiddleware (x-frame-options) - allow iframe client ip but didn't help. my settings.py file's middleware_classes is: middleware_classes = ( 'django.contrib.sessions.middleware.sessionmiddleware', 'django.middleware.common.commonmiddleware', 'django.middleware.csrf.csrfviewmiddleware', 'django.contrib.auth.middleware.authenticationmiddleware', 'django.contrib.auth.middleware.sessionauthenticationmiddleware', 'django.contrib.messages.middleware.messagemiddleware', 'django.middleware.clickjacking.xframeoptionsmiddleware', ) from http://django-secure.readthedocs.org/en/latest/middleware.html , found using ...
Read more