cannot run python MRJob locally -


if understand mrjob correctly, can simulate hadoop's multi process run using mrjob running with

python mrfile.py -r local input.txt

i'm running windows(no choice now), , when issue above command, i'm getting bunch of mambo jumbo , @ end tells me :

windowserror: [error 2] system cannot find file specified

this full error. help? 

c:\users\someuser\documents\python_projects\something>python mrjob_parser.py -r loc al test2.txt no configs found; falling on auto-configuration no configs found; falling on auto-configuration creating tmp directory c:\users\someuser\appdata\local\temp\mrjob_parser.someuser. 20150701.211822.496000 writing wrapper script c:\users\someuser\appdata\local\temp\mrjob_parser.bw401 45.20150701.211822.496000\setup-wrapper.sh writing c:\users\someuser\appdata\local\temp\mrjob_parser.someuser.20150701.211 822.496000\step-0-mapper_part-00000 > sh -ex setup-wrapper.sh 'c:\users\someuser\documents\python_venv\something_project\ scripts\python.exe' mrjob_parser.py --step-num=0 --mapper 'c:\users\someuser\appd ata\local\temp\mrjob_parser.someuser.20150701.211822.496000\input_part-00000' > c :\users\someuser\appdata\local\temp\mrjob_parser.someuser.20150701.211822.496000\s tep-0-mapper_part-00000 traceback (most recent call last):   file "mrjob_parser.py", line 18, in <module>     extractor.run()   file "c:\users\someuser\documents\python_venv\something_project\lib\site-packages\m rjob\job.py", line 461, in run     mr_job.execute()   file "c:\users\someuser\documents\python_venv\something_project\lib\site-packages\m rjob\job.py", line 479, in execute     super(mrjob, self).execute()   file "c:\users\someuser\documents\python_venv\something_project\lib\site-packages\m rjob\launch.py", line 151, in execute     self.run_job()   file "c:\users\someuser\documents\python_venv\something_project\lib\site-packages\m rjob\launch.py", line 214, in run_job     runner.run()   file "c:\users\someuser\documents\python_venv\something_project\lib\site-packages\m rjob\runner.py", line 464, in run     self._run()   file "c:\users\someuser\documents\python_venv\something_project\lib\site-packages\m rjob\sim.py", line 173, in _run     self._invoke_step(step_num, 'mapper')   file "c:\users\someuser\documents\python_venv\something_project\lib\site-packages\m rjob\sim.py", line 260, in _invoke_step     working_dir, env)   file "c:\users\someuser\documents\python_venv\something_project\lib\site-packages\m rjob\local.py", line 147, in _run_step     procs_args, output_path, working_dir, env)   file "c:\users\someuser\documents\python_venv\something_project\lib\site-packages\m rjob\local.py", line 250, in _invoke_processes     cwd=working_dir, env=env)   file "c:\users\someuser\documents\python_venv\something_project\lib\site-packages\m rjob\local.py", line 73, in _chain_procs     proc = popen(args, **proc_kwargs)   file "c:\python27\lib\subprocess.py", line 710, in __init__     errread, errwrite)   file "c:\python27\lib\subprocess.py", line 958, in _execute_child     startupinfo) windowserror: [error 2] system cannot find file specified  c:\users\someuser\documents\python_projects\something>

from https://github.com/yelp/mrjob:

# locally python mrjob/examples/mr_word_freq_count.py readme.rst > counts

my guess don't have pass in local runner option , that's causing kind of error.


-

Comments

Post a Comment

Popular posts from this blog

OpenCV OpenCL: Convert Mat to Bitmap in JNI Layer for Android -

there several posts converting mat bitmap using utils.mattobitmap() function. i'm assuming function can called in java layer after importing utils class. i want transfer data memory address pointed uint32_t* bmpcontent; in code below. jniexport void jnicall java_com_nod_nodcv_nodcvactivity_runfilter( jnienv *env, jclass clazz, jobject outbmp, jbytearray indata, jint width, jint height, jint choice, jint filter) { int outsz = width*height; int insz = outsz + outsz/2; androidbitmapinfo bmpinfo; if (androidbitmap_getinfo(env, outbmp, &bmpinfo) < 0) { throwjavaexception(env,"gaussianblur","error retrieving bitmap meta data"); return; } if (bmpinfo.format != android_bitmap_format_rgba_8888) { throwjavaexception(env,"gaussianblur","expecting rgba_8888 format"); return; } uint32_t* bmpcontent; if (androidbitmap_lockpixels(env, outbmp,(void**)&bmpcontent)...
Read more

android - org.xmlpull.v1.XmlPullParserException: expected: START_TAG {http://schemas.xmlsoap.org/soap/envelope/}Envelope -

i trying hit soap api in application login purpose , getting above mentioned error , can 1 tell me going wrong , first time soap apis. here code hit soap :- vector<object> args = new vector<object>(); hashtable<string, object> hashtable = new hashtable<string, object>(); hashtable.put("email", "mss.siddhart28@gmail.com"); hashtable.put("password", "siddharth"); args.add(hashtable); soapserializationenvelope envelope = new soapserializationenvelope( soapenvelope.ver11); envelope.dotnet = true; envelope.xsd = soapserializationenvelope.xsd; envelope.enc = soapserializationenvelope.enc; (new marshalhashtable()).register(envelope); httptransportse androidhttptransport = new httptransportse( "http://tempuri.org/", 15000); androidhttptransport.debug = true; string result = ""; try { soapobject request = new soapobject("http:...
Read more

python - How to remove the Xframe Options header in django? -

i have made page has iframe . inside iframe want show multiple different links article facebook, or news, or youtube video or other possible url. but, due xframe header, unable so. referred following link: https://docs.djangoproject.com/en/1.8/ref/clickjacking/ , django xframeoptionsmiddleware (x-frame-options) - allow iframe client ip but didn't help. my settings.py file's middleware_classes is: middleware_classes = ( 'django.contrib.sessions.middleware.sessionmiddleware', 'django.middleware.common.commonmiddleware', 'django.middleware.csrf.csrfviewmiddleware', 'django.contrib.auth.middleware.authenticationmiddleware', 'django.contrib.auth.middleware.sessionauthenticationmiddleware', 'django.contrib.messages.middleware.messagemiddleware', 'django.middleware.clickjacking.xframeoptionsmiddleware', ) from http://django-secure.readthedocs.org/en/latest/middleware.html , found using ...
Read more