Posts

Showing posts with the label hbase

NiFi PutHBaseCell failing

Image
Clash Royale CLAN TAG #URR8PPP NiFi PutHBaseCell failing I am writing data to HBase with NiFi (v1.4) using PutHBase cell, we process ~300 million inserts a day. At times we receive bulletins: Failed to send StandardFlowFileRecord...to HBase due to RetriesExhaustedWithDetailsException: Failed x actions: ConnectionClosingException: y times, IOException: z times, routing to failure I have routed failure back into PutHBaseCell - my understanding is periodic failure is expected/normal when HBase is splitting a region, and indeed after a short period of time the failed records are successfully inserted. However, at least once a day, this issue does not clear up. The error above appears in the NiFi logs w/o end, and the only way we are able to fix it is to restart NiFi, only to see it happen again in a day or so. Any ideas on how to investigate/correct this issue would be immensely appreciated. Our HBase/Hadoop (Cloudera distribution) admin has not found a smoking gun on the HBase side of ...

How to create multiple column families in an HBase table using the shell

Image
Clash Royale CLAN TAG #URR8PPP How to create multiple column families in an HBase table using the shell Is the process to have multiple "create" commands against the same table? What is the syntax for it? 3 Answers 3 Syntax would be like this : create '<table name>' , '<column-family1>' , '<column-family2>' etc.. OK that's another way to do it. – javadba May 22 '13 at 17:19 Answer is to use a ruby list: the following creates a table 'app' with three column familes m, f, c: create 'app',['m','f','c'] This works +1. Thank you. – 030 Jul 7 '14 at 8:54 ...