0
Follow
0
View

An error was reported about hbase writing to flume

does2006 注册会员
2023-02-27 08:20
< div class = "md_content_show e397 data - v - 3967" = "" >

the reference answer GPT ᴼ ᴾ ᴱ ᴺ ᴬ ᴵ < br / > to check the Flume for permissions, you can try the following steps:

1. Check whether the directory and file specified in the Flume configuration file exist, and the Flume user has read and write permission.

2. Check whether Flume users have sufficient permissions to access directories and files. You can run the following command to check Flume users:

ps -ef | grep flume
After executing the command, you should see output similar to this:
flume    1234  5678  0 08:00 ?        00:00:01 /usr/local/flume/bin/flume-ng agent -n myagent -c /etc/flume/conf.d -f /etc/flume/conf.d/myagent.conf

Where "flume" is the user when Flume is running.

3. If Flume uses Hadoop HDFS as the data source or data destination, check whether the machine where Flume resides has been authorized to users and groups of Hadoop HDFS so that they can access and write HDFS data. You can run the following command to check the group of Flume users:

groups flume
After executing the command, you should see output similar to this:
flume : flume hadoop

In the command, "flume" is the user of the Flume runtime, "flume" and "hadoop" are the groups to which the Flume runtime user belongs.

If you have checked the above steps and still cannot resolve the problem, you can try running Flume with a higher permission user to see if you can resolve the problem. If the problem persists, you can view the Flume log file to learn about the specific error information.

dreamwing0324 注册会员
2023-02-27 08:20
< div class = "md_content_show e397 data - v - 3967" = "" >

a: user's root should be of the highest, still won't do(ㄒ o ㄒ)

cuitghp 注册会员
2023-02-27 08:20

the reference answer GPT ᴼ ᴾ ᴱ ᴺ ᴬ ᴵ < br / > according to the error message, you can see HBaseSink unable to load table" TLS "at startup, resulted in the abnormal. Here are some possible reasons:

  1. Incorrect table name: Ensure that the spelling of the table name is consistent with the actual table name in HBase, including case and case.

  2. If the HBase table does not exist, ensure that the table has been created in HBase. You can use the HBase Shell command or the HBase web UI.

  3. HBase configuration error: Ensure that Flume HBase configuration is correct, including HBase connection configuration and column family information of the table.

  4. Permission problem: Ensure that the Flume process has permission to read and write HBase tables. This section describes how to check HBase permission Settings and Flume process permissions.

  5. HBase service is not started: Ensure that the HBase service is started. You can use the HBase Shell command or the HBase web UI to confirm.

dy15145071020 注册会员
2023-02-27 08:20

How to check whether Flume has permission?