Overwriting conflict when i load table from hive

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

Overwriting conflict when i load table from hive

周湘伦
Hi,all
When i built project and loaded table from hive,some errors occurs.

But when i load table from hive which i created,it's ok.
I know it's time stamp,but i do not know how to fix it.
Can you tell me how to solve it?Thank you.
Reply | Threaded
Open this post in threaded view
|

Re: Overwriting conflict when i load table from hive

Billy Liu
Could you reload the metadata from system tab, and load the table again?

2017-06-13 10:21 GMT+08:00 周湘伦 <[hidden email]>:

> Hi,all
> When i built project and loaded table from hive,some errors occurs.
> [image: 内嵌图片 1]
> But when i load table from hive which i created,it's ok.
> I know it's time stamp,but i do not know how to fix it.
> Can you tell me how to solve it?Thank you.
>
Reply | Threaded
Open this post in threaded view
|

Re: Overwriting conflict when i load table from hive

周湘伦
Yes, i had reloaded the matedata,but it didn't work.
I even restarted kylin.

2017-06-13 15:15 GMT+08:00 Billy Liu <[hidden email]>:

> Could you reload the metadata from system tab, and load the table again?
>
> 2017-06-13 10:21 GMT+08:00 周湘伦 <[hidden email]>:
>
> > Hi,all
> > When i built project and loaded table from hive,some errors occurs.
> > [image: 内嵌图片 1]
> > But when i load table from hive which i created,it's ok.
> > I know it's time stamp,but i do not know how to fix it.
> > Can you tell me how to solve it?Thank you.
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: Overwriting conflict when i load table from hive

Billy Liu
First, the snapshot could not be shown.

Second, you said "loaded table from hive, some errors occurs", and also
"load table from hive which i created, it's ok." What do you mean "it's
ok"? Load the table which you created is fine, but failed if load tables
which created by others?

2017-06-13 19:32 GMT+08:00 周湘伦 <[hidden email]>:

> Yes, i had reloaded the matedata,but it didn't work.
> I even restarted kylin.
>
> 2017-06-13 15:15 GMT+08:00 Billy Liu <[hidden email]>:
>
> > Could you reload the metadata from system tab, and load the table again?
> >
> > 2017-06-13 10:21 GMT+08:00 周湘伦 <[hidden email]>:
> >
> > > Hi,all
> > > When i built project and loaded table from hive,some errors occurs.
> > > [image: 内嵌图片 1]
> > > But when i load table from hive which i created,it's ok.
> > > I know it's time stamp,but i do not know how to fix it.
> > > Can you tell me how to solve it?Thank you.
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: Overwriting conflict when i load table from hive

周湘伦
I'm sorry, my english is not good.
1.
The error log is:
09:33:59.822 [http-bio-7070-exec-4] ERROR
org.apache.kylin.rest.controller.BasicController -
org.apache.kylin.rest.exception.InternalErrorException: Overwriting
conflict /table/DEFAULT.KYLIN_CAL_DT.json, expect old TS 1496820166000, but
it is 1496820707107
        at
org.apache.kylin.rest.controller.TableController.loadHiveTables(TableController.java:117)
~[kylin-server-base-2.0.0.jar:2.0.0]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[?:1.8.0_131]
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_131]
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_131]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_131]

2.
I'm sorry,it was not clear.
I mean after i executed $KYLIN_HOME/bin/sample.sh,some
tables(KYLIN_SALES,KYLIN_CAL_DT...) are loaded into hive.
I also created a table which named test in hive myself.
Then i clicked the button on the web page(http://master:7070/kylin/models)
to load hive table from tree,i selected KYLIN_SALES and KYLIN_CAL_DT, after
i clicked on the sync button, the error which i said above occured.
But when i selected test table ,after i clicked on the sync button, the
page showed successfully.

Thank you.

2017-06-13 22:34 GMT+08:00 Billy Liu <[hidden email]>:

> First, the snapshot could not be shown.
>
> Second, you said "loaded table from hive, some errors occurs", and also
> "load table from hive which i created, it's ok." What do you mean "it's
> ok"? Load the table which you created is fine, but failed if load tables
> which created by others?
>
> 2017-06-13 19:32 GMT+08:00 周湘伦 <[hidden email]>:
>
> > Yes, i had reloaded the matedata,but it didn't work.
> > I even restarted kylin.
> >
> > 2017-06-13 15:15 GMT+08:00 Billy Liu <[hidden email]>:
> >
> > > Could you reload the metadata from system tab, and load the table
> again?
> > >
> > > 2017-06-13 10:21 GMT+08:00 周湘伦 <[hidden email]>:
> > >
> > > > Hi,all
> > > > When i built project and loaded table from hive,some errors occurs.
> > > > [image: 内嵌图片 1]
> > > > But when i load table from hive which i created,it's ok.
> > > > I know it's time stamp,but i do not know how to fix it.
> > > > Can you tell me how to solve it?Thank you.
> > > >
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: Overwriting conflict when i load table from hive

Billy Liu
When you run the sample.sh, it actually does two things. One is to generate
a few tables in Hive, another one is to generate the table metadata in
Kylin's learn_kylin project which is saved in the metastore. You need click
"System" tab "Reload Metadata" button to reload the metadata. After that
the inconsistency status between Kylin instance and metastore will
disappear.

2017-06-14 9:51 GMT+08:00 周湘伦 <[hidden email]>:

> I'm sorry, my english is not good.
> 1.
> The error log is:
> 09:33:59.822 [http-bio-7070-exec-4] ERROR
> org.apache.kylin.rest.controller.BasicController -
> org.apache.kylin.rest.exception.InternalErrorException: Overwriting
> conflict /table/DEFAULT.KYLIN_CAL_DT.json, expect old TS 1496820166000,
> but
> it is 1496820707107
>         at
> org.apache.kylin.rest.controller.TableController.loadHiveTables(
> TableController.java:117)
> ~[kylin-server-base-2.0.0.jar:2.0.0]
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[?:1.8.0_131]
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
> ~[?:1.8.0_131]
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_131]
>         at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_131]
>
> 2.
> I'm sorry,it was not clear.
> I mean after i executed $KYLIN_HOME/bin/sample.sh,some
> tables(KYLIN_SALES,KYLIN_CAL_DT...) are loaded into hive.
> I also created a table which named test in hive myself.
> Then i clicked the button on the web page(http://master:7070/kylin/models)
> to load hive table from tree,i selected KYLIN_SALES and KYLIN_CAL_DT, after
> i clicked on the sync button, the error which i said above occured.
> But when i selected test table ,after i clicked on the sync button, the
> page showed successfully.
>
> Thank you.
>
> 2017-06-13 22:34 GMT+08:00 Billy Liu <[hidden email]>:
>
> > First, the snapshot could not be shown.
> >
> > Second, you said "loaded table from hive, some errors occurs", and also
> > "load table from hive which i created, it's ok." What do you mean "it's
> > ok"? Load the table which you created is fine, but failed if load tables
> > which created by others?
> >
> > 2017-06-13 19:32 GMT+08:00 周湘伦 <[hidden email]>:
> >
> > > Yes, i had reloaded the matedata,but it didn't work.
> > > I even restarted kylin.
> > >
> > > 2017-06-13 15:15 GMT+08:00 Billy Liu <[hidden email]>:
> > >
> > > > Could you reload the metadata from system tab, and load the table
> > again?
> > > >
> > > > 2017-06-13 10:21 GMT+08:00 周湘伦 <[hidden email]>:
> > > >
> > > > > Hi,all
> > > > > When i built project and loaded table from hive,some errors occurs.
> > > > > [image: 内嵌图片 1]
> > > > > But when i load table from hive which i created,it's ok.
> > > > > I know it's time stamp,but i do not know how to fix it.
> > > > > Can you tell me how to solve it?Thank you.
> > > > >
> > > >
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: Overwriting conflict when i load table from hive

周湘伦
It's OK .
I restarted kyliy,then i loaded table successfully...
Do not know why not yesterday.

Thank you.

2017-06-14 19:35 GMT+08:00 Billy Liu <[hidden email]>:

> When you run the sample.sh, it actually does two things. One is to generate
> a few tables in Hive, another one is to generate the table metadata in
> Kylin's learn_kylin project which is saved in the metastore. You need click
> "System" tab "Reload Metadata" button to reload the metadata. After that
> the inconsistency status between Kylin instance and metastore will
> disappear.
>
> 2017-06-14 9:51 GMT+08:00 周湘伦 <[hidden email]>:
>
> > I'm sorry, my english is not good.
> > 1.
> > The error log is:
> > 09:33:59.822 [http-bio-7070-exec-4] ERROR
> > org.apache.kylin.rest.controller.BasicController -
> > org.apache.kylin.rest.exception.InternalErrorException: Overwriting
> > conflict /table/DEFAULT.KYLIN_CAL_DT.json, expect old TS 1496820166000,
> > but
> > it is 1496820707107
> >         at
> > org.apache.kylin.rest.controller.TableController.loadHiveTables(
> > TableController.java:117)
> > ~[kylin-server-base-2.0.0.jar:2.0.0]
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > ~[?:1.8.0_131]
> >         at
> > sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:
> > 62)
> > ~[?:1.8.0_131]
> >         at
> > sun.reflect.DelegatingMethodAccessorImpl.invoke(
> > DelegatingMethodAccessorImpl.java:43)
> > ~[?:1.8.0_131]
> >         at java.lang.reflect.Method.invoke(Method.java:498)
> ~[?:1.8.0_131]
> >
> > 2.
> > I'm sorry,it was not clear.
> > I mean after i executed $KYLIN_HOME/bin/sample.sh,some
> > tables(KYLIN_SALES,KYLIN_CAL_DT...) are loaded into hive.
> > I also created a table which named test in hive myself.
> > Then i clicked the button on the web page(http://master:7070/kylin/
> models)
> > to load hive table from tree,i selected KYLIN_SALES and KYLIN_CAL_DT,
> after
> > i clicked on the sync button, the error which i said above occured.
> > But when i selected test table ,after i clicked on the sync button, the
> > page showed successfully.
> >
> > Thank you.
> >
> > 2017-06-13 22:34 GMT+08:00 Billy Liu <[hidden email]>:
> >
> > > First, the snapshot could not be shown.
> > >
> > > Second, you said "loaded table from hive, some errors occurs", and also
> > > "load table from hive which i created, it's ok." What do you mean "it's
> > > ok"? Load the table which you created is fine, but failed if load
> tables
> > > which created by others?
> > >
> > > 2017-06-13 19:32 GMT+08:00 周湘伦 <[hidden email]>:
> > >
> > > > Yes, i had reloaded the matedata,but it didn't work.
> > > > I even restarted kylin.
> > > >
> > > > 2017-06-13 15:15 GMT+08:00 Billy Liu <[hidden email]>:
> > > >
> > > > > Could you reload the metadata from system tab, and load the table
> > > again?
> > > > >
> > > > > 2017-06-13 10:21 GMT+08:00 周湘伦 <[hidden email]>:
> > > > >
> > > > > > Hi,all
> > > > > > When i built project and loaded table from hive,some errors
> occurs.
> > > > > > [image: 内嵌图片 1]
> > > > > > But when i load table from hive which i created,it's ok.
> > > > > > I know it's time stamp,but i do not know how to fix it.
> > > > > > Can you tell me how to solve it?Thank you.
> > > > > >
> > > > >
> > > >
> > >
> >
>