build error

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

build error

耳东
hi All:


when I build the cube, it failed in the Build Cube step. And the error logs are as follows, what should I do to solve this error?




Error: java.io.IOException: Initialization of all the collectors failed. Error in last collector was :Cannot find serializer for org.apache.kylin.engine.mr.ByteArrayWritable at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:414) at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:81) at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:698) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:770) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1784) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) Caused by: java.io.IOException: Cannot find serializer for org.apache.kylin.engine.mr.ByteArrayWritable at org.apache.hadoop.mapred.nativetask.NativeMapOutputCollectorDelegator.init(NativeMapOutputCollectorDelegator.java:127) at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:402) ... 9 more
Reply | Threaded
Open this post in threaded view
|

Re: build error

qiumingming
Have you solved this error, I got a similar error when use kylin 2.0. Thank you!
Reply | Threaded
Open this post in threaded view
|

Re: build error

Yang
I start to suspect this is because Kylin 2.0 is compiled with hadoop 2.7
while Kylin 1.6 is compiled with hadoop 2.6.

Could you confirm your hadoop version and JDK version?

Thanks
Yang

On Sun, May 28, 2017 at 10:28 PM, qiumingming <[hidden email]> wrote:

> Have you solved this error, I got a similar error when use kylin 2.0. Thank
> you!
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/build-error-tp4486p8113.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
Reply | Threaded
Open this post in threaded view
|

Re: build error

qiumingming
My Hadoop version is 2.6.0-cdh5.4.4 and jdk is 1.8. You can track this problem at https://issues.apache.org/jira/browse/KYLIN-2654.
Reply | Threaded
Open this post in threaded view
|

Re: build error

qiumingming
In reply to this post by Yang
Can you see my comments at https://issues.apache.org/jira/browse/KYLIN-2654. The website said my comments are internal and only be visible to agents and collaborators. If you can not, we can communicate by email, I have some questions want to ask you about this problem. Or we can talk on WeChat if possible.
Reply | Threaded
Open this post in threaded view
|

Re: build error

Yang
Yes, internal comments are good for us to collaborate.

On Sat, Jun 3, 2017 at 5:31 PM, qiumingming <[hidden email]> wrote:

> Can you see my comments at https://issues.apache.org/
> jira/browse/KYLIN-2654.
> The website said my comments are internal and only be visible to agents and
> collaborators. If you can not, we can communicate by email, I have some
> questions want to ask you about this problem. Or we can talk on WeChat if
> possible.
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/build-error-tp4486p8165.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>