Hadoop data nodes stops reporting -

-


Hadoop data nodes stops reporting -

i have 4 node (master + 3 slave) cluster running hadoop 0.20.203.0. every few days, datanodes become reported dead on master. on slave, appears fine , datanode process still running, nil suspicious in logs, although no longer receiving requests. on master, logs show datanode heartbeat has been lost.

the solution manually stop datanode , start again. after several minutes datanode becomes reported live again.

has else experienced this? if cause, , solution?

we had similar problem, solusion increment open file limit.

try add together line ulimit -n 4096 file hadoop-env.sh

hadoop

Comments

Post a Comment

Popular posts from this blog

delphi - blogger via idHTTP : error 400 bad request -

-
delphi - blogger via idHTTP : error 400 bad request - i'm trying post blogger using idhttp component, however, i'm getting "http/1.0 400 bad request" error. procedure tform1.button1click(sender: tobject); var request,response,req : tstringlist; auth,blogid : string; begin blogid := '00000000000000000000000'; request := tstringlist.create; response := tstringlist.create; req := tstringlist.create; idhttp1.request.connection := 'keep-alive'; idhttp1.request.contenttype := 'application/x-www-form-urlencoded'; idssliohandlersocket1.ssloptions.method := sslvsslv23; request.clear(); request.values['accounttype'] := 'google'; request.values['email'] := 'xxx@gmail.com'; request.values['passwd'] := 'yyy'; request.values['service'] := 'blogger'; response.text :=idhttp1.post('https://www.google.com/accounts/clientlogin',request); auth := resp...
Read more

c++ - cuda, pycuda -- how to write complex numbers -- errors:class "cuComplex" has no member "i" -

-
c++ - cuda, pycuda -- how to write complex numbers -- errors:class "cuComplex" has no member "i" - i have difficulties utilize complex numbers in cuda,pycuda. i have in c: #include <complex> typedef std::complex<double> cmplx; .... cmplx j(0.,1.); also,in same code: #include <boost/python.hpp> #include <boost/array.hpp> ... typedef std::vector< boost::array<std::complex<double>,3 > > complexfieldtype; typedef std::vector< boost::array<double,3> > realfieldtype; ... __global__ void compute(realfieldtype const & rs,complexfieldtype const & m,..) ... how can convert utilize pycuda? tried sth (according book 'cuda example'): struct cucomplex { float real; float imag; cucomplex(float a,float b): real(a),imag(b){} cucomplex operator *(const cucomplex& a) { homecoming cucomplex(real*a.real -imag*a.imag ,imag*a.real +real*a.imag); } cucomplex operat...
Read more

How do I check if an insert was successful with MySQLdb in Python? -

-
How do I check if an insert was successful with MySQLdb in Python? - i have code: cursor = conn.cursor() cursor.execute(("insert new_files (videos_id, filename, " "is_processing) values (%s,%s,1)"), (id, filename)) logging.warn("%d", cursor.rowcount) if (cursor.rowcount == 1): logging.info("inserted values %d, %s", id, filename) else: logging.warn("failed insert values %d, %s", id, filename) cursor.close() fun is, cursor.rowcount always one, though updated database create videos_id unique key. is, insert fails because in tests same videos_id going appear (and when check database, nil inserted). whatever reason, rowcount 1 - logging.warn have spits out rowcount of 1. so, question: can utilize rowcount work out if insert went fine? if so, (presumably) doing wrong? otherwise, how check if insert went fine? your code not commit after modifications (your modifications rolled back). should...
Read more