1. This Impala daemon is not ready to accept user requests. Status: Waiting for catalog update from the StateStore.
端口未开启。開啓23000。
涉及impala的端口有:
组件 | 服务 | 端口 | 访问要求 | 说明 |
Impala Daemon | Impala Daemon Frontend Port | 21000 | External | 用于通过impala-shell和Cloudera ODBC驱动程序1.2版传输命令和接收结果。 |
Impala Daemon Frontend Port | 21050 | External | 例如商业智能工具, JDBC,Hue中的Beeswax查询编辑器,以及Cloudera ODBC驱动程序的2.0或更高版本等传输命令和接收结果。 | |
Impala Daemon Backend Port | 22000 | Internal | 限内部使用。 Impala守护程序使用此端口相互通信。 | |
StateStoreSubscriber Service Port | 23000 | Internal | 限内部使用。 Impala守护程序在此端口上侦听statestore守护程序的更新。 | |
Impala Daemon HTTP Server Port | 25000 | External | 供管理员监控和排除故障的Impala Web界面。 | |
Llama Callback Port | 28000 | Internal | 限内部使用。 Impala守护进程用于与Llama通信。 | |
Catalog Daemon | StateStoreSubscriber Service Port | 23020 | Internal | 限内部使用。catalog daemon在此端口上侦听statestore守护程序的更新。 |
Catalog HTTP Server Port | 25020 | External | Catalog服务Web界面,供管理员监控和排除故障。 | |
StateStore Service Port | 26000 | Internal | 限内部使用。 Catalog服务使用此端口与Impala守护程序进行通信。 | |
Impala StateStore Daemon | StateStore HTTP Server Port | 25010 | External | StateStore Web界面供管理员监控和排除故障。 |
StateStore Service Port | 24000 | Internal | 限内部使用。 statestore守护程序在此端口上侦听注册/取消注册请求。 | |
Impala Llama ApplicationMaster | Llama Thrift Admin Port | 15002 | Internal | 限内部使用 |
Llama Thrift Port | 15000 | Internal | 限内部使用 | |
Llama HTTP Port | 15001 | External | Llama服务Web界面,供管理员监控和排除故障。 |
2. java.sql.SQLException: Cannot create PoolableConnectionFactory (Method not supported)
jmeter测试kerberos认证的impala接口时,出现的错误。
3. impala刚启动后,运行正常,一段时间后,响应时间边长。查看catalog日志
W0104 14:13:52.062723 16850 RetryingMetaStoreClient.java:148] MetaStoreClient lost connection. Attempting to reconnect.Java exception follows:org.apache.thrift.transport.TTransportException: java.net.SocketException: Connection timed out at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129) at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:346) at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:423) at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:405) at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37) at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) at org.apache.hadoop.hive.thrift.TFilterTransport.readAll(TFilterTransport.java:62) at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378) at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297) at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204) at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_table(ThriftHiveMetastore.java:1262) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_table(ThriftHiveMetastore.java:1248) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1271) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:101) at com.sun.proxy.$Proxy5.getTable(Unknown Source) at org.apache.impala.catalog.CatalogServiceCatalog.reloadTable(CatalogServiceCatalog.java:1011) at org.apache.impala.service.CatalogOpExecutor.execResetMetadata(CatalogOpExecutor.java:3125) at org.apache.impala.service.JniCatalog.resetMetadata(JniCatalog.java:156)Caused by: java.net.SocketException: Connection timed out at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:170) at java.net.SocketInputStream.read(SocketInputStream.java:141) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) ... 23 moreW0104 14:13:53.067286 16850 TIOStreamTransport.java:112] Error closing output stream.Java exception follows:java.net.SocketException: Socket closed at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:116) at java.net.SocketOutputStream.write(SocketOutputStream.java:153) at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) at java.io.FilterOutputStream.close(FilterOutputStream.java:158) at org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110) at org.apache.thrift.transport.TSocket.close(TSocket.java:194) at org.apache.thrift.transport.TSaslTransport.close(TSaslTransport.java:372) at org.apache.thrift.transport.TSaslClientTransport.close(TSaslClientTransport.java:37) at org.apache.hadoop.hive.thrift.TFilterTransport.close(TFilterTransport.java:52) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.close(HiveMetaStoreClient.java:554) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.reconnect(HiveMetaStoreClient.java:332) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:98) at com.sun.proxy.$Proxy5.getTable(Unknown Source) at org.apache.impala.catalog.CatalogServiceCatalog.reloadTable(CatalogServiceCatalog.java:1011) at org.apache.impala.service.CatalogOpExecutor.execResetMetadata(CatalogOpExecutor.java:3125) at org.apache.impala.service.JniCatalog.resetMetadata(JniCatalog.java:156)