python - Scrapy Clusters kafka_monitor.py interrupted -

-

scrapy clusters great new way scale large, continuous scrapy projects. setup within vm , runs several instances different tools.

i've built vm out , installed necessary tools such redis, kafka, , zookeeper.

i'm stuck on simple line prior first test crawl , don't know if it's python issue, installation issue, or what.

when try

python kafka_monitor.py run

i get:

traceback (most recent call last): file "kafka_monitor.py", line 512, in sys.exit(main())
file "kafka_monitor.py", line 497, in main kafka_monitor.run()
file "kafka_monitor.py", line 413, in run self._setup_kafka()
file "kafka_monitor.py", line 232, in _setup_kafka ret_val = _hidden_setup()
file "/usr/local/lib/python2.7/dist-packages/scutils/method_timer.py", line 46, in f2 retval = f(*args)
file "kafka_monitor.py", line 218, in _hidden_setup self.kafka_conn = kafkaclient(self.settings['kafka_hosts'])

typeerror: ____init___() takes 1 argument (2 given)

the settings.py includes:

kafka_hosts = 'localhost:9092' kafka_incoming_topic = 'demo.incoming' kafka_group = 'demo-group' kafka_feed_timeout = 5 kafka_conn_timeout = 5

and instructed quick start made localsettings.py well

# here, 'scdev' host kafka, redis, , zookeeper redis_host = 'scdev' kafka_hosts = 'scdev:9092' zookeeper_hosts = 'scdev:2181'

even if go kafka_monitor.py , change line 218 (from intital error traceback above)

from:

self.kafka_conn = kafkaclient(self.settings['kafka_hosts'])

to:

self.kafka_conn = kafkaclient(self.settings['scdev:9092'])

i receive same error.

success!

@madison bahmer steering me in right direction. want clarify how got run.

the first line of actual code (so line 3) in kafka_monitor.py reads:

from kafka.client import kafkaclient

i changed to:

from kafka import kafkaclient

this got work!

is short-sighted solution? break in future without:

from kafka.client import kafkaclient

i don't know i'll update in future if problems specific arrise.


Comments

Post a Comment

Popular posts from this blog

java - Run spring boot application error: Cannot instantiate interface org.springframework.context.ApplicationListener -

-
i have spring project , try make use spring boot , run @ embadded tomcat following : https://spring.io/guides/gs/rest-service/ this application //@configuration //@enableaspectjautoproxy @springbootapplication @componentscan(basepackages = "gux.prome") public class application { public static void main(string[] args) { springapplication.run(application.class, args); } } if use maven command: mvn spring-boot:run , project starts fine, need debug , run main method @ intelij, exception occurs: exception in thread "main" java.lang.illegalargumentexception: cannot instantiate interface org.springframework.context.applicationlistener : org.springframework.boot.logging.classpathloggingapplicationlistener @ org.springframework.boot.springapplication.createspringfactoriesinstances(springapplication.java:414) @ org.springframework.boot.springapplication.getspringfactoriesinstances(springapplication.java:394) @ org.springframework.bo...
Read more

reactjs - React router and this.props.children - how to pass state to this.props.children -

-
i'm using react-router first time , don't know how think in yet. here's how i'm loading components in nested routes. entry point .js reactdom.render( <router history={hashhistory} > <route path="/" component={app}> <route path="models" component={content}> </route> </router>, document.getelementbyid('app') ); app.js render: function() { return ( <div> <header /> {this.props.children} </div> ); } so child of app content component sent in. i'm using flux , app.js has state , listens changes, don't know how pass state down this.props.children. before using react-router app.js defines children explicitly, passing state natural don't see how now. using couple of react helper methods can add state, props , whatever else this.props.children render: function() { var children = react.ch...
Read more

Excel VBA "Microsoft Windows Common Controls 6.0 (SP6)" Location Changes -

-
i have excel workbook used generate quotations customers. there main page user inputs data, , there buttons generate various pdfs , send them customer. however, 1 user consistently getting error preventing generating , sending pdfs. i beleive "microsoft windows common controls 6.0 (sp6)". it's installed on users' computers. on mine, location "c:\windows\syswow64\mscomctl.ocx" on others "c:\windows\system32\mscomctl.ocx" the user experiencing issues on 32-bit machine, "mscomctl.ocx" file should in system32. have manually put in there, , pointed common controls reference in vba it. issue seems keep reverting looking in syswow64. since folder doesn't exist, can't find it, , can't produce pdfs. i thought perhaps issue user running older version of office (2007) there users on 2013 , 2016. thought perhaps mixture of 64-bit , 32-bit users. user gets sent workbook other users (as quotation process goes further, gets passed ...
Read more