[jira] [Created] (KYLIN-2647) Should get FileSystem from HBaseConfiguration in HBaseResourceStore

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[jira] [Created] (KYLIN-2647) Should get FileSystem from HBaseConfiguration in HBaseResourceStore

JIRA jira@apache.org
kangkaisen created KYLIN-2647:
---------------------------------

             Summary: Should get FileSystem from HBaseConfiguration in HBaseResourceStore
                 Key: KYLIN-2647
                 URL: https://issues.apache.org/jira/browse/KYLIN-2647
             Project: Kylin
          Issue Type: Bug
          Components: Metadata
    Affects Versions: v2.0.0
            Reporter: kangkaisen
            Assignee: kangkaisen
            Priority: Critical


KYLIN-2351 introduced a bug if User use Standalone HBase Cluster.
{code:java}
   Error while executing SQL "SELECT SUM(revenue) AS revenue, SUM(profit) AS profit, SUM(repay_profit) AS repayProfit, SUM(fraud_profit) AS fraudProfit, SUM(share_profit) AS shareProfit, SUM(consume) AS consume, SUM(repay_consume) AS repayConsume, SUM(fraud_consume) AS fraudConsume, SUM(share_consume) AS shareConsume, SUM(cost) AS cost, SUM(fraud_cost) AS fraudCost, SUM(repay_cost) AS repayCost, poi_cate2_id AS poiCategory2Id, poi_cate2_name AS poiCategory2Name, main_poi_id AS orgId, main_poi_name AS orgName, COUNT(DISTINCT NEW_OBJECT) AS newDeal, COUNT(DISTINCT ONLINE_OBJECT) AS onlineDeal, partition_date AS dateStr FROM mart_catering.app_shu_v5_trade_view WHERE (bd_id = 2084324 AND c_platform IN ('mt', 'dp') AND partition_date = '2017-05-24') GROUP BY poi_cate2_id, poi_cate2_name, partition_date, main_poi_id, main_poi_name LIMIT 50000": java.io.FileNotFoundException: File does not exist: /user/kylin2x/prod/kylin2x_metadata_prod/resources/dict/MART_CATERING.APP_SHU_V5_TRADE_VIEW/C_OBJECT_ID/854df823-abc8-4e19-9035-def12f8af3e2.dict at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71) at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:61) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1850) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1821) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1729) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:589) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:365) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043)



at org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:299)
        at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:793)
        at org.apache.kylin.storage.hbase.HBaseResourceStore.getInputStream(HBaseResourceStore.java:206)
        at org.apache.kylin.storage.hbase.HBaseResourceStore.getResourceImpl(HBaseResourceStore.java:226)
        at org.apache.kylin.common.persistence.ResourceStore.getResource(ResourceStore.java:148)
        at org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:448)
        at org.apache.kylin.dict.DictionaryManager$1.load(DictionaryManager.java:105)
        at org.apache.kylin.dict.DictionaryManager$1.load(DictionaryManager.java:102)
        at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3599)
        at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2379)
        at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2342)
        at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2257)
        at com.google.common.cache.LocalCache.get(LocalCache.java:4000)
        at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4004)
        at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4874)
        at org.apache.kylin.dict.DictionaryManager.getDictionaryInfo(DictionaryManager.java:122)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Loading...