java - Sequence File created gives strange output in hadoop -


i want combine several small bzip2 files sequence file .i saw code create sequence file , tried it. gives strange output below. because unable read bzip2 files? 

seqorg.apache.hadoop.io.textorg.apache.hadoop.io.text    �*org.apache.hadoop.io.compress.defaultcodec����gwŒ‚Êo≈îbº¡vœÖ��� ���     .ds_storexúÌò±   ¬0eÔ4.s∫a�6∞¢0p∞=0ì·‡/d)Ädï˛ì¨w≈ù7÷ùØ›⁄Öüo;≥x¬`’∂µóÆ Æâ¡=Ñ   b±lp6Û˛ÜbÅå˜c¢3}ª‘�lp¥oä"ùËl?jk�&:⁄”Åét¢3]Î º∑¿˘¸68§ÄÉùø:µ√™*é-¿fifi>!~¯·0Ùˆú ¶   eõ¯c‡ÍÉa◊':”ÍÑòù;i1•�∂©���00.json.bz2xúl\gwtk∞% ,y ä( hjfêúsŒ\prrrŒ9ÁcŒ9√0ÃzuÏÌÊΩÔ≤Ù‚Ãô”’uªvÌÍÓ3£oˆä2ä<˝”-”ãȧπË/d;u¥Û£üv;ÀÒÛ¯Ú˜ˇ˚…≥2¢5Í0‰˝8m⁄,s¸¢`f•†`o<ëüd£≈tÃ¥ó`•´d˚~aº˝«õ˜v'≠)(f|§fiÆÕ ?y¬àœtÒÊyåb…u%e?⁄§efiwˇÒy#üÛÓÓ‚ ⁄è„ÍåÚÊu5‡  æ‚Â?q‘°�À{©?íwyü÷Èûf<[˘éŒhãd>x_ÅÁ fiÒ_eâ5-—|-m)˙)¸r·ªcÆßs„f>uŒ©ß{o„uÔ&∫˚˚Ÿ?Ä©ßw,”◊Ê∫â«õxã¸[yûgÈñfmx|‡ªÍ¶”¶‡Óp-∆ú§ı <jn t «f4™@Àä¥jœ¥‰√|e„‘œ„&º§@g|ˆá{iõox

the code 

import java.io.ioexception;  import org.apache.hadoop.conf.configuration; import org.apache.hadoop.fs.fsdatainputstream; import org.apache.hadoop.fs.filestatus; import org.apache.hadoop.fs.filesystem; import org.apache.hadoop.fs.path; import org.apache.hadoop.io.ioutils; import org.apache.hadoop.io.sequencefile; import org.apache.hadoop.io.text; import org.apache.hadoop.util.genericoptionsparser;  public class cinput {      /**      * @param args      * @throws ioexception      * @throws illegalaccessexception      * @throws instantiationexception      */     public static void main(string[] args) throws ioexception,             instantiationexception, illegalaccessexception {         // todo auto-generated method stub          configuration conf = new configuration();          filesystem fs = filesystem.get(conf);         string[] otherargs = new genericoptionsparser(conf, args)         .getremainingargs();         path inputfile = new path(otherargs[0]);         path outputfile = new path(otherargs[1]);         fsdatainputstream inputstream;         text key = new text();         text value = new text();         sequencefile.writer writer = sequencefile.createwriter(fs, conf,                 outputfile, key.getclass(), value.getclass());         filestatus[] fstatus = fs.liststatus(inputfile);          (filestatus fst : fstatus) {             string str = "";             system.out.println("processing file : " + fst.getpath().getname() + " , size : " + fst.getpath().getname().length());             inputstream = fs.open(fst.getpath());             key.set(fst.getpath().getname());             while(inputstream.available()>0) {                 str = str+inputstream.readline();                // system.out.println(str);             }             value.set(str);             writer.append(key, value);          }         fs.close();         ioutils.closestream(writer);         system.out.println("sequence file created successfully........");     } }

the input passing json.bzip2 files. please point out why getting strange output.


-

Comments

Post a Comment

Popular posts from this blog

OpenCV OpenCL: Convert Mat to Bitmap in JNI Layer for Android -

there several posts converting mat bitmap using utils.mattobitmap() function. i'm assuming function can called in java layer after importing utils class. i want transfer data memory address pointed uint32_t* bmpcontent; in code below. jniexport void jnicall java_com_nod_nodcv_nodcvactivity_runfilter( jnienv *env, jclass clazz, jobject outbmp, jbytearray indata, jint width, jint height, jint choice, jint filter) { int outsz = width*height; int insz = outsz + outsz/2; androidbitmapinfo bmpinfo; if (androidbitmap_getinfo(env, outbmp, &bmpinfo) < 0) { throwjavaexception(env,"gaussianblur","error retrieving bitmap meta data"); return; } if (bmpinfo.format != android_bitmap_format_rgba_8888) { throwjavaexception(env,"gaussianblur","expecting rgba_8888 format"); return; } uint32_t* bmpcontent; if (androidbitmap_lockpixels(env, outbmp,(void**)&bmpcontent)...
Read more

android - org.xmlpull.v1.XmlPullParserException: expected: START_TAG {http://schemas.xmlsoap.org/soap/envelope/}Envelope -

i trying hit soap api in application login purpose , getting above mentioned error , can 1 tell me going wrong , first time soap apis. here code hit soap :- vector<object> args = new vector<object>(); hashtable<string, object> hashtable = new hashtable<string, object>(); hashtable.put("email", "mss.siddhart28@gmail.com"); hashtable.put("password", "siddharth"); args.add(hashtable); soapserializationenvelope envelope = new soapserializationenvelope( soapenvelope.ver11); envelope.dotnet = true; envelope.xsd = soapserializationenvelope.xsd; envelope.enc = soapserializationenvelope.enc; (new marshalhashtable()).register(envelope); httptransportse androidhttptransport = new httptransportse( "http://tempuri.org/", 15000); androidhttptransport.debug = true; string result = ""; try { soapobject request = new soapobject("http:...
Read more

python - How to remove the Xframe Options header in django? -

i have made page has iframe . inside iframe want show multiple different links article facebook, or news, or youtube video or other possible url. but, due xframe header, unable so. referred following link: https://docs.djangoproject.com/en/1.8/ref/clickjacking/ , django xframeoptionsmiddleware (x-frame-options) - allow iframe client ip but didn't help. my settings.py file's middleware_classes is: middleware_classes = ( 'django.contrib.sessions.middleware.sessionmiddleware', 'django.middleware.common.commonmiddleware', 'django.middleware.csrf.csrfviewmiddleware', 'django.contrib.auth.middleware.authenticationmiddleware', 'django.contrib.auth.middleware.sessionauthenticationmiddleware', 'django.contrib.messages.middleware.messagemiddleware', 'django.middleware.clickjacking.xframeoptionsmiddleware', ) from http://django-secure.readthedocs.org/en/latest/middleware.html , found using ...
Read more