akka - Spark 0.90 Stand alone connection refused -


i using spark 0.90 stand alone mode. when tried streaming application in stand alone mode, getting connection refused exception.i added hostname in /etc/hosts tried ip alone.in both cases worker got registered master without issues.

is there way solve issue?

14/02/28 07:15:01 info master: akka.tcp://driverclient@127.0.0.1:55891 got disassociated, removing it. 14/02/28 07:15:04 info master: registering app twitter streaming 14/02/28 07:15:04 info master: registered app twitter streaming id app-20140228071504-0000 14/02/28 07:34:42 info master: akka.tcp://spark@127.0.0.1:33688 got disassociated, removing it. 14/02/28 07:34:42 info localactorref: message [akka.remote.transport.actortransportadapter$disassociateunderlying] actor[akka://sparkmaster/deadletters] actor[akka://sparkmaster/system/transports/akkaprotocolmanager.tcp0/akkaprotocol-tcp%3a%2f%2fsparkmaster%4010.165.35.96%3a38903-6#-1146558090] not delivered. [2] dead letters encountered. logging can turned off or adjusted configuration settings 'akka.log-dead-letters' , 'akka.log-dead-letters-during-shutdown'. 14/02/28 07:34:42 error endpointwriter: associationerror [akka.tcp://sparkmaster@10.165.35.96:8910] -> [akka.tcp://spark@127.0.0.1:33688]: error [association failed [akka.tcp://spark@127.0.0.1:33688]] [ akka.remote.endpointassociationexception: association failed [akka.tcp://spark@127.0.0.1:33688] caused by: akka.remote.transport.netty.nettytransport$$anonfun$associate$1$$anon$2: connection refused: /127.0.0.1:33688

i had similar issue when running in spark in cluster mode. problem server started hostname 'fluentd:7077' , not fqdn. edited 

/sbin/start-master.sh

to reflect how remote nodes connect -ip flag.

/usr/lib/jvm/jdk1.7.0_51/bin/java -cp :/home/vagrant/spark-0.9.0-incubating-bin-   hadoop2/conf:/home/vagrant/spark-0.9.0-incuba ting-bin-hadoop2/assembly/target/scala-2.10/spark-assembly_2.10-0.9.0-incubating-hadoop2.2.0.jar -dspark.akka.loglifecycleevents=true -djava.library.path= -xms512m -xmx512m org.ap ache.spark.deploy.master.master --ip fluentd.alex.dev --port 7077 --webui-port 8080

hope helps.


Comments

Post a Comment

Popular posts from this blog

Android layout hidden on keyboard show -

i have strange problem layout. when tap on edittext , keyboard shown edittext stay on bottom , when tap on to hide keyboard , keyboard hides , edittext go should when want input text. when tap again, keyboard shown , edittext goes down behind keyboard... <relativelayout android:layout_width="match_parent" android:layout_height="match_parent" > <scrollview android:layout_width="match_parent" android:layout_height="fill_parent" android:above="@+id/rl_commands"> <textview android:layout_width="match_parent" android:layout_height="wrap_content"/> </scrollview> <relativelayout android:layout_width="match_parent android:layout_height="24dp" android:id="@+id/rl_commands" android:alignparentbottom="true">
Read more

google app engine - 403 Forbidden POST - Flask WTForms -

i have flask application running on google app engine. trying submit form built using wtform , keep getting following error. 403 forbidden: don't have permission access requested resource. either read-protected or not readable server. location.html (part of code) <form method=post action="/home/location"> .... <button type="submit" class="btn btn-primary" value="submit"> directions </button> </form> main.py @app.route('/home/location', methods=['post', 'get']) def location(): form = cfcdirections.direction(request.form) print(request.method) if request.method == 'post' , form.validate(): print("after if") directions = cfcdirections() street_no = directions.no street = directions.street suburb = directions.suburb postcode = directions.postcode
Read more

c - Why would PK11_GenerateRandom() return an error -8023? -

i looking through internet trying find source of pk11_generaterandom() function see why function fail. have program uses function when moved new flavor of linux, fails after forking ( fork() ) since not believe there problem nss, suspect doing incorrectly disregarded in older versions of linux new 1 there issue. the openssl package same on 'good' , 'bad' server: openssl 0.9.8e-fips-rhel5 01 jul nss rpm differs though. 'good' has nss-3.12.2.0-2.el5 and bas has version nss-3.15.3-4.el5_10 the 'good' server uses quite obsolete linux: linux 2.6.18-128.el5 #1 smp wed jan 21 08:45:05 est 2009 x86_64 x86_64 x86_64 gnu/linux enterprise linux enterprise linux server release 5.3 (carthage) red hat enterprise linux server release 5.3 (tikanga) the 'bad' server newer: linux bad 2.6.18-371.4.1.el5 #1 smp wed jan 29 11:05:49 pst 2014 x86_64 x86_64 x86_64 gnu/linux oracle linux server release 5.10 red hat enterprise linux server release
Read more