Python Sqlite - Select Only Spans of Rows with Multiple Words -

-

i have book in sqlite table has 1 sentence per row. there on 30k rows/sentences , format of table cannot changed (it break many other things).

i have several different spans of ids more or less divide book paragraphs. in tuples in list, i.e. [(0,2), (3,6), (7,10) ...] or [(0,3), (4,9), (10,13) ...], etc.

i need able return spans contain 2 words or more. is, find "water" , "earth" within same span/paragraph.

i looked @ making views using each group of spans using group_concant combine sentences, find no way since views cannot appended.

making 1000s of select calls 'select * in book id between ? , ? and...' not seem efficient.

is there way return spans have hits single statement or maybe way use temporary table combine them?

if they're sequential (or can force ordering id correlate spans), can use python grouping applying arbitrary key each group, , using part of groupby. eg: 

from itertools import repeat, izip, chain, groupby operator import itemgetter  testdata = [str(i) in range(10)]  spans = [(0,2), (3,6), (7,10)]     groups = chain.from_iterable(repeat(idx, e - s + 1) idx, (s, e) in enumerate(spans))  k, g in groupby(izip(testdata, groups), itemgetter(1)):     words = set(chain.from_iterable(el[0].split() el in g))     if words.issuperset(['3', '6']):          print words

you need modify how splits words , chooses matches, remains 1 possible option.

if you're doing often, may wish consider creating table containing single column representing paragraph (instead of sentences), , apply full text index on column make future queries lot easier. utilise above code assist in building table.


Comments

Post a Comment

Popular posts from this blog

java - Run spring boot application error: Cannot instantiate interface org.springframework.context.ApplicationListener -

-
i have spring project , try make use spring boot , run @ embadded tomcat following : https://spring.io/guides/gs/rest-service/ this application //@configuration //@enableaspectjautoproxy @springbootapplication @componentscan(basepackages = "gux.prome") public class application { public static void main(string[] args) { springapplication.run(application.class, args); } } if use maven command: mvn spring-boot:run , project starts fine, need debug , run main method @ intelij, exception occurs: exception in thread "main" java.lang.illegalargumentexception: cannot instantiate interface org.springframework.context.applicationlistener : org.springframework.boot.logging.classpathloggingapplicationlistener @ org.springframework.boot.springapplication.createspringfactoriesinstances(springapplication.java:414) @ org.springframework.boot.springapplication.getspringfactoriesinstances(springapplication.java:394) @ org.springframework.bo...
Read more

reactjs - React router and this.props.children - how to pass state to this.props.children -

-
i'm using react-router first time , don't know how think in yet. here's how i'm loading components in nested routes. entry point .js reactdom.render( <router history={hashhistory} > <route path="/" component={app}> <route path="models" component={content}> </route> </router>, document.getelementbyid('app') ); app.js render: function() { return ( <div> <header /> {this.props.children} </div> ); } so child of app content component sent in. i'm using flux , app.js has state , listens changes, don't know how pass state down this.props.children. before using react-router app.js defines children explicitly, passing state natural don't see how now. using couple of react helper methods can add state, props , whatever else this.props.children render: function() { var children = react.ch...
Read more

Excel VBA "Microsoft Windows Common Controls 6.0 (SP6)" Location Changes -

-
i have excel workbook used generate quotations customers. there main page user inputs data, , there buttons generate various pdfs , send them customer. however, 1 user consistently getting error preventing generating , sending pdfs. i beleive "microsoft windows common controls 6.0 (sp6)". it's installed on users' computers. on mine, location "c:\windows\syswow64\mscomctl.ocx" on others "c:\windows\system32\mscomctl.ocx" the user experiencing issues on 32-bit machine, "mscomctl.ocx" file should in system32. have manually put in there, , pointed common controls reference in vba it. issue seems keep reverting looking in syswow64. since folder doesn't exist, can't find it, , can't produce pdfs. i thought perhaps issue user running older version of office (2007) there users on 2013 , 2016. thought perhaps mixture of 64-bit , 32-bit users. user gets sent workbook other users (as quotation process goes further, gets passed ...
Read more