hadoop - Able to create Hive table using JSON objects but not all objects are being captured into respective attribute -

-

i able create hive table using json objects not objects being captured respective attribute. few absorbed 1 attribute. how break out remaining attributes respective "columns".

most of below fields put table screen_name, name , location grouped number of other objects retweeted_status , user. retweeted_status , user appear long json string needs broken out table. need perform activity below, , if so, how that? appreciated. thanks,

here script,

create table bank_f001 (json string); load data local inpath 'banking-1-26-16.txt' table bank_f001;  create table bank_f001_table select     get_json_object(bank_f001.json, '$.text') text,     get_json_object(bank_f001.json, '$.in_reply_to_user_id') in_reply_to_user_id,     get_json_object(bank_f001.json, '$.id') id,     get_json_object(bank_f001.json, '$.favorite_count') favorite_count,     get_json_object(bank_f001.json, '$.coordinates') coordinates,     get_json_object(bank_f001.json, '$.id_str') id_str,     get_json_object(bank_f001.json, '$.location') location,     get_json_object(bank_f001.json, '$.lang') lang,     get_json_object(bank_f001.json, '$.indices') indices,     get_json_object(bank_f001.json, '$.type') type,     get_json_object(bank_f001.json, '$.hashtags') hashtags,     get_json_object(bank_f001.json, '$.user_mentions') user_mentions,     get_json_object(bank_f001.json, '$.screen_name') screen_name,     get_json_object(bank_f001.json, '$.name') name,     get_json_object(bank_f001.json, '$.in_reply_to_screen_name') in_reply_to_screen_name,     get_json_object(bank_f001.json, '$.retweet_count') retweet_count,     get_json_object(bank_f001.json, '$.favorited') favorited,     get_json_object(bank_f001.json, '$.retweeted_status') retweeted_status,     get_json_object(bank_f001.json, '$.user') user,     get_json_object(bank_f001.json, '$.followers_count') followers_count,     get_json_object(bank_f001.json, '$.statuses_count') statuses_count,     get_json_object(bank_f001.json, '$.description') description,     get_json_object(bank_f001.json, '$.geo_enabled') geo_enabled,     get_json_object(bank_f001.json, '$.favourites_count') favourites_count,     get_json_object(bank_f001.json, '$.created_at') created_at,     get_json_object(bank_f001.json, '$.time_zone') time_zone,     get_json_object(bank_f001.json, '$.listed_count') listed_count,     get_json_object(bank_f001.json, '$.in_reply_to_user_id_str') in_reply_to_user_id_str bank_f001;

i figured out... in case you're interested... :) bunch of attributes nested in user attribute object. used following code break out... ".user.location"

create table bank_f001_table select     get_json_object(bank_f001.json, '$.text') text,     get_json_object(bank_f001.json, '$.in_reply_to_user_id') in_reply_to_user_id,     get_json_object(bank_f001.json, '$.id') id,     get_json_object(bank_f001.json, '$.favorite_count') favorite_count,     get_json_object(bank_f001.json, '$.coordinates') coordinates,     get_json_object(bank_f001.json, '$.id_str') id_str,     get_json_object(bank_f001.json, '$.user.location') location,     get_json_object(bank_f001.json, '$.lang') lang,     get_json_object(bank_f001.json, '$.indices') indices,     get_json_object(bank_f001.json, '$.type') type,     get_json_object(bank_f001.json, '$.hashtags') hashtags,     get_json_object(bank_f001.json, '$.user_mentions') user_mentions,     get_json_object(bank_f001.json, '$.user.screen_name') screen_name,     get_json_object(bank_f001.json, '$.user.name') name,     get_json_object(bank_f001.json, '$.in_reply_to_screen_name') in_reply_to_screen_name,     get_json_object(bank_f001.json, '$.retweet_count') retweet_count,     get_json_object(bank_f001.json, '$.favorited') favorited,     get_json_object(bank_f001.json, '$.retweeted_status') retweeted_status,     get_json_object(bank_f001.json, '$.user') user,     get_json_object(bank_f001.json, '$.followers_count') followers_count,     get_json_object(bank_f001.json, '$.statuses_count') statuses_count,     get_json_object(bank_f001.json, '$.description') description,     get_json_object(bank_f001.json, '$.geo_enabled') geo_enabled,     get_json_object(bank_f001.json, '$.favourites_count') favourites_count,     get_json_object(bank_f001.json, '$.created_at') created_at,     get_json_object(bank_f001.json, '$.time_zone') time_zone,     get_json_object(bank_f001.json, '$.listed_count') listed_count,     get_json_object(bank_f001.json, '$.in_reply_to_user_id_str') in_reply_to_user_id_str bank_f001;

Comments

Post a Comment

Popular posts from this blog

java - Run spring boot application error: Cannot instantiate interface org.springframework.context.ApplicationListener -

-
i have spring project , try make use spring boot , run @ embadded tomcat following : https://spring.io/guides/gs/rest-service/ this application //@configuration //@enableaspectjautoproxy @springbootapplication @componentscan(basepackages = "gux.prome") public class application { public static void main(string[] args) { springapplication.run(application.class, args); } } if use maven command: mvn spring-boot:run , project starts fine, need debug , run main method @ intelij, exception occurs: exception in thread "main" java.lang.illegalargumentexception: cannot instantiate interface org.springframework.context.applicationlistener : org.springframework.boot.logging.classpathloggingapplicationlistener @ org.springframework.boot.springapplication.createspringfactoriesinstances(springapplication.java:414) @ org.springframework.boot.springapplication.getspringfactoriesinstances(springapplication.java:394) @ org.springframework.bo...
Read more

reactjs - React router and this.props.children - how to pass state to this.props.children -

-
i'm using react-router first time , don't know how think in yet. here's how i'm loading components in nested routes. entry point .js reactdom.render( <router history={hashhistory} > <route path="/" component={app}> <route path="models" component={content}> </route> </router>, document.getelementbyid('app') ); app.js render: function() { return ( <div> <header /> {this.props.children} </div> ); } so child of app content component sent in. i'm using flux , app.js has state , listens changes, don't know how pass state down this.props.children. before using react-router app.js defines children explicitly, passing state natural don't see how now. using couple of react helper methods can add state, props , whatever else this.props.children render: function() { var children = react.ch...
Read more

Excel VBA "Microsoft Windows Common Controls 6.0 (SP6)" Location Changes -

-
i have excel workbook used generate quotations customers. there main page user inputs data, , there buttons generate various pdfs , send them customer. however, 1 user consistently getting error preventing generating , sending pdfs. i beleive "microsoft windows common controls 6.0 (sp6)". it's installed on users' computers. on mine, location "c:\windows\syswow64\mscomctl.ocx" on others "c:\windows\system32\mscomctl.ocx" the user experiencing issues on 32-bit machine, "mscomctl.ocx" file should in system32. have manually put in there, , pointed common controls reference in vba it. issue seems keep reverting looking in syswow64. since folder doesn't exist, can't find it, , can't produce pdfs. i thought perhaps issue user running older version of office (2007) there users on 2013 , 2016. thought perhaps mixture of 64-bit , 32-bit users. user gets sent workbook other users (as quotation process goes further, gets passed ...
Read more