NiFi PutHBaseCell failing

Multi tool use
Multi tool use
The name of the pictureThe name of the pictureThe name of the pictureClash Royale CLAN TAG#URR8PPP


NiFi PutHBaseCell failing



I am writing data to HBase with NiFi (v1.4) using PutHBase cell, we process ~300 million inserts a day. At times we receive bulletins:



Failed to send StandardFlowFileRecord...to HBase due to RetriesExhaustedWithDetailsException: Failed x actions: ConnectionClosingException: y times, IOException: z times, routing to failure



I have routed failure back into PutHBaseCell - my understanding is periodic failure is expected/normal when HBase is splitting a region, and indeed after a short period of time the failed records are successfully inserted.



However, at least once a day, this issue does not clear up. The error above appears in the NiFi logs w/o end, and the only way we are able to fix it is to restart NiFi, only to see it happen again in a day or so.



Any ideas on how to investigate/correct this issue would be immensely appreciated. Our HBase/Hadoop (Cloudera distribution) admin has not found a smoking gun on the HBase side of things (HBase config and logs).









By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Jad4Du027Gpyq3Y1ohn,JMF PXMjrb7cMav5MT4,0wq4uMhfX1F xFr63fxbuhBqKzSfh7Kc3kWx VOrL,XkG1UhGw5PGD 6900t61IeS
fGiBy 4S731Lztw

Popular posts from this blog

Visual Studio Code: How to configure includePath for better IntelliSense results

Spring cloud config client Could not locate PropertySource

Makefile test if variable is not empty