HBase官方指南(2015最新版本)-配置详解篇-for-baidu

Apache Hbase最新官网指南中文翻译 详细配置调优篇

Apache HBase 参考手册（详细配置调优篇

Version 2.0.0-SNAPSHOT

1

2）

Apache Hbase最新官网指南中文翻译 详细配置调优篇

目录

Apache HBase 配置 ......................................................................................................................... 9

3.配置文件 ................................................................................................................................ 9 4.先决条件（当然是部署HBase的咯） .............................................................................. 11

JDK环境 表2. Java ........................................................................................................ 11 操作系统基础服务 ......................................................................................................... 12

ssh ........................................................................................................................... 12 DNS .......................................................................................................................... 12 Loopback IP ............................................................................................................. 12 NTP .......................................................................................................................... 13

文件和进程的数量限制（与文件系统及程序的限制关系） ............................. 13 Linux shell ................................................................................................................ 15 Windows ................................................................................................................. 15 4.1 Hadoop ...................................................................................................................... 15

4.1.1 Apache HBase 0.94和Hadoop2 .................................................................... 18 4.1.2 Apache HBase0.92和0.94............................................................................. 19 4.1.3 Apache HBase 0.96 ......................................................................................... 19 4.1.4 Hadoop 0.20.x-1.x .......................................................................................... 20

4.1.5 运行在安全的Hadoop上的HBase ............................................................. 20 4.1.6关于 dfs.datanode.max.transfer.threads ...................................................... 21 4.2 Zookeeper ................................................................................................................. 21 5.HBase的运行模式：独立运行与分布式运行 ................................................................... 22

5.1HBase独立运行模式 ......................................................................................... 22 5.2HBase分布式模式 ............................................................................................. 22

5.2.1伪分布式（ Pseudo-distributed） ...................................................... 23 5.3完全分布式（Fully-distributed） .................................................................... 23

分布式的RegionServer .......................................................................... 23 Zookeeper与HBase................................................................................ 24 分布式HBase快速入门 ......................................................................... 25 HDFS客户端配置步骤 ........................................................................... 25

6.运行验证你的安装 .............................................................................................................. 25 7.默认配置 .............................................................................................................................. 27

7.1hbase-site.xml和hbase-default.xml ......................................................................... 27 7.2HBase默认配置参数说明 ......................................................................................... 27

hbase.tmp.dir .......................................................................................................... 27 hbase.rootdir ........................................................................................................... 28 hbase.fs.tmp.dir ...................................................................................................... 28 hbase.bulkload.staging.dir ...................................................................................... 28 hbase.cluster.distributed ......................................................................................... 29 Hbase.zookeeper.quorum ....................................................................................... 29 hbase.local.dir ......................................................................................................... 29

2

Apache Hbase最新官网指南中文翻译 详细配置调优篇

hbase.master.port ................................................................................................... 30 hbase.master.info.port ............................................................................ 30 hbase.master.info.bindAddress ........................................................... 30 hbase.master.logcleaner.plugins ....................................................... 30 hbase.master.logcleaner.ttl ................................................................ 31 hbase.master.hfilecleaner.plugins .................................................. 31 hbase.master.catalog.timeout .............................................................. 31 hbase.master.infoserver.redirect .................................................... 32 hbase.regionserver.port .......................................................................... 32 hbase.regionserver.info.port .............................................................. 32 hbase.regionserver.info.bindAddress ............................................. 32 hbase.regionserver.info.port.auto .................................................. 33 hbase.regionserver.handler.count .................................................... 33 hbase.ipc.server.callqueue.handler.factor ............................... 33 hbase.ipc.server.callqueue.read.ratio ........................................ 34 hbase.ipc.server.callqueue.scan.ratio ........................................ 35 hbase.regionserver.msginterval ......................................................... 36 hbase.regionserver.logroll.period .................................................. 36 hbase.regionserver.logroll.errors.tolerated .......................... 36 hbase.regionserver.hlog.reader.impl ............................................. 37 hbase.regionserver.hlog.writer.impl ............................................. 37 hbase.regionserver.global.memstore.size ................................... 37 hbase.regionserver.global.memstore.size.lower.limit ....... 38 hbase.regionserver.optionalcacheflushinterval ..................... 38 hbase.regionserver.catalog.timeout ............................................... 39 hbase.regionserver.dns.interface .................................................... 39 hbase.regionserver.dns.nameserver .................................................. 39 hbase.regionserver.region.split.policy ...................................... 40 hbase.regionserver.regionSplitLimit ............................................. 40 zookeeper.session.timeout ..................................................................... 41 zookeeper.znode.parent ............................................................................ 42 zookeeper.znode.rootserver .................................................................. 42 zookeeper.znode.acl.parent .................................................................. 43 hbase.zookeeper.dns.interface ........................................................... 43 hbase.zookeeper.dns.nameserver ......................................................... 43 hbase.zookeeper.peerport ....................................................................... 44 hbase.zookeeper.leaderport .................................................................. 44 hbase.zookeeper.useMulti ....................................................................... 44 hbase.zookeeper.property.initLimit ............................................... 45 hbase.zookeeper.property.syncLimit ............................................... 45 hbase.zookeeper.property.dataDir .................................................... 46 hbase.zookeeper.property.clientPort ............................................. 46 hbase.zookeeper.property.maxClientCnxns ................................... 46 hbase.client.write.buffer ..................................................................... 47

3

Apache Hbase最新官网指南中文翻译 详细配置调优篇

hbase.client.pause ...................................................................................... 47 hbase.client.retries.number ................................................................ 48 hbase.client.max.total.tasks .............................................................. 48 hbase.client.max.perserver.tasks .................................................... 49 hbase.client.max.perregion.tasks .................................................... 49 hbase.client.scanner.caching .............................................................. 49 hbase.client.keyvalue.maxsize ........................................................... 50 hbase.client.scanner.timeout.period ............................................. 51 hbase.client.localityCheck.threadPoolSize ............................... 51 hbase.bulkload.retries.number ........................................................... 51 hbase.balancer.period .............................................................................. 52 hbase.normalizer.enabled ....................................................................... 52 hbase.normalizer.period .......................................................................... 52 hbase.regions.slop ...................................................................................... 53 hbase.server.thread.wakefrequency .................................................. 53 hbase.server.versionfile.writeattempts ...................................... 53 hbase.hregion.memstore.flush.size .................................................. 54 hbase.hregion.percolumnfamilyflush.size.lower.bound.min ................................................................................................................................. 54 hbase.hregion.preclose.flush.size .................................................. 55 hbase.hregion.memstore.block.multiplier ................................... 56 hbase.hregion.memstore.mslab.enabled ........................................... 56 hbase.hregion.max.filesize .................................................................. 57 hbase.hregion.majorcompaction ........................................................... 57 hbase.hregion.majorcompaction.jitter ........................................... 58 hbase.hstore.compactionThreshold .................................................... 59 hbase.hstore.flusher.count .................................................................. 59 hbase.hstore.blockingStoreFiles ....................................................... 60 hbase.hstore.blockingWaitTime ........................................................... 60 hbase.hstore.compaction.min ................................................................ 61 hbase.hstore.compaction.max ................................................................ 61 hbase.hstore.compaction.min.size .................................................... 61 hbase.hstore.compaction.max.size .................................................... 62 hbase.hstore.compaction.ratio ........................................................... 62 hbase.hstore.compaction.ratio.offpeak ........................................ 63 hbase.hstore.time.to.purge.deletes ............................................... 63 hbase.offpeak.start.hour ....................................................................... 63 hbase.offpeak.end.hour ............................................................................ 63 hbase.regionserver.thread.compaction.throttle ..................... 64 hbase.hstore.compaction.kv.max ......................................................... 64 hbase.storescanner.parallel.seek.enable ................................... 64 hbase.storescanner.parallel.seek.threads ................................. 65 hfile.block.cache.size ............................................................................ 65 hfile.block.index.cacheonwrite ......................................................... 65

4

Apache Hbase最新官网指南中文翻译 详细配置调优篇

hfile.index.block.max.size .................................................................. 65 hbase.bucketcache.ioengine .................................................................. 66 hbase.bucketcache.combinedcache.enabled ................................... 66 hbase.bucketcache.size ............................................................................ 66 hbase.bucketcache.sizes .......................................................................... 66 hfile.format.version ................................................................................. 67 hfile.block.bloom.cacheonwrite ......................................................... 67 io.storefile.bloom.block.size ........................................................... 67 hbase.rs.cacheblocksonwrite ................................................................ 68 hbase.rpc.timeout ........................................................................................ 68 hbase.cells.scanned.per.heartbeat.check ................................... 68 hbase.rpc.shortoperation.timeout .................................................... 68 hbase.ipc.client.tcpnodelay ................................................................ 69 hbase.regionserver.hostname ................................................................ 69 hbase.master.keytab.file ....................................................................... 69 hbase.master.kerberos.principal ....................................................... 70 hbase.regionserver.keytab.file ......................................................... 70 hbase.regionserver.kerberos.principal ........................................ 70 hadoop.policy.file ...................................................................................... 70 hbase.superuser ............................................................................................. 71 hbase.auth.key.update.interval ......................................................... 71 hbase.auth.token.max.lifetime ........................................................... 71 hbase.ipc.client.fallback-to-simple-auth-allowed .............. 71 hbase.ipc.server.fallback-to-simple-auth-allowed .............. 72 hbase.display.keys ...................................................................................... 72 hbase.coprocessor.enabled ..................................................................... 72 hbase.coprocessor.user.enabled ......................................................... 73 hbase.coprocessor.region.classes .................................................... 73 hbase.rest.port ............................................................................................. 73 hbase.rest.readonly ................................................................................... 74 hbase.rest.threads.max ............................................................................ 74 hbase.rest.threads.min ............................................................................ 74 hbase.rest.support.proxyuser .............................................................. 74 hbase.defaults.for.version.skip ....................................................... 75 hbase.coprocessor.master.classes .................................................... 75 hbase.coprocessor.abortonerror ......................................................... 75 hbase.online.schema.update.enable .................................................. 76 hbase.table.lock.enable .......................................................................... 76 hbase.table.max.rowsize .......................................................................... 76 hbase.thrift.minWorkerThreads ........................................................... 76 hbase.thrift.maxWorkerThreads ........................................................... 77 hbase.thrift.maxQueuedRequests ......................................................... 77 hbase.thrift.htablepool.size.max .................................................... 77 hbase.regionserver.thrift.framed .................................................... 78

5

百度搜索“77cn”或“免费范文网”即可找到本站免费阅读全部范文。收藏本站方便下次阅读，免费范文网，提供经典小说综合文库HBase官方指南(2015最新版本)-配置详解篇-for-baidu在线全文阅读。