and add the fully qualified class name here. implement your own BaseHFileCleanerDelegate, just put it in HBase's classpath. Reason: Failed to get stat of replication hfile references node. so put the cleaner that prunes the most files in front.
#Hbase archive cleaner series
After sifting through the logs for the cleaner, I have identified the following series of warnings: 06:29:11,808 WARN master.ReplicationHFileCleaner: ReplicationHFileCleaner received abort, ignoring.
#Hbase archive cleaner software
We recently had some fairly severe zookeeper issues, but things have returned to a completely stable state now, apart from this.ĭo you have any advice for how I can move forward, either with forcing the HFile cleaner to run or with repairing the state of Elser Disabling hbase backups did not improve the situation. apache / hbase Public master hbase/bin/hbase-cleanup.sh Go to file Cannot retrieve contributors at this time executable file 155 lines (139 sloc) 4.73 KB Raw Blame /usr/bin/env bash / Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. So it appears that the replication HFile cleaner is failing due to an issue with zookeeper. $SessionExpiredException: KeeperErrorCode = Session expired for /hbase-unsecure/replication/hfile-refs
When a HFileLink is created a back reference file is created in: /hbase/archive. HFiles can be deleted only if there're no links to them. HFileLink cleaner that determines if a hfile should be deleted. 06:29:11,808 WARN zookeeper.ZKUtil: replicationHFileCleaner-0x15fb38de0a0007a, quorum=server01:2181,server02:2181,server03:2181, baseZNode=/hbase-unsecure Unable to get data of znode /hbase-unsecure/replication/hfile-refs InterfaceAudience.LimitedPrivate (value'Configuration') public class HFileLinkCleaner extends BaseHFileCleanerDelegate. 06:29:11,808 WARN master.ReplicationHFileCleaner: Failed to read hfile references from zookeeper, skipping checking deletable files Reason: Failed to get stat of replication hfile references node. It splits into four major parts: collective cleaning, classification, clustering. After sifting through the logs for the cleaner, I have identified the following series of warnings: 06:29:11,808 WARN master.ReplicationHFileCleaner: ReplicationHFileCleaner received abort, ignoring. system logs, and Avro, however, sinks connect to HBase and HDFS. Elser Disabling hbase backups did not improve the situation.
0 kommentar(er)
