HBase - KeyValue size too large
655842747_0004_m_000095_0 connecting to ZooKeeper ensemble=dvwhkhera114.dv.net:2181,dvwhkhera115.dv.net:2181,dvwhkhera112.dv.net:2181
2016-09-01 23:02:44,758 INFO [main] org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=dvwhkhera114.dv.net:2181,dvwhkhera115.dv.net:2181,dvwhkhera112.dv.net:2181 sessionTimeout=60000 watcher=attempt_1472655842747_0004_m_000095_00x0, quorum=dvwhkhera114.dv.net:2181,dvwhkhera115.dv.net:2181,dvwhkhera112.dv.net:2181, baseZNode=/hbase
2016-09-01 23:02:44,760 INFO [main-SendThread(dvwhkhera115.dv.net:2181)] org.apache.zookeeper.ClientCnxn: Opening socket connection to server dvwhkhera115.dv.net/172.16.30.115:2181. Will not attempt to authenticate using SASL (unknown error)
2016-09-01 23:02:44,760 INFO [main-SendThread(dvwhkhera115.dv.net:2181)] org.apache.zookeeper.ClientCnxn: Socket connection established, initiating session, client: /172.16.30.115:39906, server: dvwhkhera115.dv.net/172.16.30.115:2181
2016-09-01 23:02:44,779 INFO [main-SendThread(dvwhkhera115.dv.net:2181)] org.apache.zookeeper.ClientCnxn: Session establishment complete on server dvwhkhera115.dv.net/172.16.30.115:2181, sessionid = 0x256e0ad87f14cd1, negotiated timeout = 60000
2016-09-01 23:02:44,795 INFO [main] org.apache.zookeeper.ZooKeeper: Session: 0x256e0ad87f14cd1 closed
2016-09-01 23:02:44,795 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn: EventThread shut down
2016-09-01 23:02:44,873 INFO [main] org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x256e0ad87f14cd0
2016-09-01 23:02:44,888 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn: EventThread shut down
2016-09-01 23:02:44,888 INFO [main] org.apache.zookeeper.ZooKeeper: Session: 0x256e0ad87f14cd0 closed
2016-09-01 23:02:44,904 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.lang.IllegalArgumentException: KeyValue size too large
at org.apache.hadoop.hbase.client.HTable.validatePut(HTable.java:1567)
at org.apache.hadoop.hbase.client.BufferedMutatorImpl.validatePut(BufferedMutatorImpl.java:152)
at org.apache.hadoop.hbase.client.BufferedMutatorImpl.mutate(BufferedMutatorImpl.java:127)
at org.apache.hadoop.hbase.client.BufferedMutatorImpl.mutate(BufferedMutatorImpl.java:113)
at org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.write(TableOutputFormat.java:138)
at org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.write(TableOutputFormat.java:94)
at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:658)
at org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89)
at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java:112)
at org.apache.hadoop.hbase.mapreduce.Import$Importer.processKV(Import.java:209)
at org.apache.hadoop.hbase.mapreduce.Import$Importer.writeResult(Import.java:164)
at org.apache.hadoop.hbase.mapreduce.Import$Importer.map(Import.java:149)
at org.apache.hadoop.hbase.mapreduce.Import$Importer.map(Import.java:132)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGrou
<property>
<name>hbase.client.keyvalue.maxsize</name>
<value>10485760</value>
<source>hbase-site.xml</source>
</property>
10Mib
http://stackoverflow.com/questions/29819266/hbase-keyvalue-size-too-large
Have made chagne 20Mib