IT博客汇
  • 首页
  • 精华
  • 技术
  • 设计
  • 资讯
  • 扯淡
  • 权利声明
  • 登录 注册

    关于生产环境HBase读写偶发性org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException

    Kagura发表于 2020-11-10 02:59:51
    love 0

    具体报错信息如下:

    ... 1 more
     at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:269)
     at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:129)
     at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:107)
     at org.apache.hadoop.hbase.client.HTable.get(HTable.java:384)
     at org.apache.hadoop.hbase.client.HTable.get(HTable.java:358)
     at org.apache.hadoop.hbase.MetaTableAccessor.getTableState(MetaTableAccessor.java:1118)
     at org.apache.hadoop.hbase.client.ConnectionImplementation.getTableState(ConnectionImplementation.java:2039)
     at org.apache.hadoop.hbase.client.ConnectionImplementation.isTableDisabled(ConnectionImplementation.java:630)
     at org.apache.hadoop.hbase.client.RegionServerCallable.prepare(RegionServerCallable.java:219)
     at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:105)
     at org.apache.hadoop.hbase.client.HTable.get(HTable.java:384)
     at org.apache.hadoop.hbase.client.HTable.get(HTable.java:358)
     at com.ifeng.ai.api.ua.comm.HbaseComm.getRowCellsAsMap(HbaseComm.kt:77)
     at com.ifeng.ai.api.ua.comm.HbaseComm.getProfileLastDay(HbaseComm.kt:26)
     at com.ifeng.ai.api.ua.controller.ProfileControllerV2$startReceive$$inlined$repeat$lambda$1.invokeSuspend(ProfileControllerV2.kt:166)
     at kotlin.coroutines.jvm.internal.BaseContinuationImpl.resumeWith(ContinuationImpl.kt:33)
     at kotlinx.coroutines.DispatchedTask.run(DispatchedTask.kt:106)
     at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
     at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
     at java.base/java.lang.Thread.run(Thread.java:834)
    Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: Column family table does not exist in region hbase:meta,,1.1588230740 in table 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}, {NAME => 'info', BLOOMFILTER => 'NONE', VERSIONS => '10', IN_MEMORY => 'true', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'true', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}
     at org.apache.hadoop.hbase.regionserver.HRegion.checkFamily(HRegion.java:7973)
     at org.apache.hadoop.hbase.regionserver.HRegion.get(HRegion.java:6994)
     at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2110)
     at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:34946)
     at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2339)
     at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:123)
     at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:188)
     at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:168)
    

    由于用户画像存储在HBase需要大量查询,但是观察日志发现偶尔会有Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException: org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: Column family table does not exist in region hbase,然后本地开发环境时有时无,后来一顿搜,发现是java客户端版本问题.

    我司HBase集群是1.3.1版本,然后我用的是hbase-client是2.3.3版本,换到1.4.13版本后观察异常消失.



沪ICP备19023445号-2号
友情链接