This article is a mirror article of machine translation, please click here to jump to the original article.

View: 9718|Reply: 3

I first learned about Hadoop and HBase big data

[Copy link]
Posted on 12/27/2018 3:04:25 PM | | | |
Recently, the company needs to use hbase to store a large amount of data, and the manager has taught us a lesson about the relevant knowledge.
Environment:

System:

CentOS Linux release 7.5.1804 (Core)

Command:



Java version:

java version "1.8.0_191"
Java(TM) SE Runtime Environment (build 1.8.0_191-b12)
Java HotSpot(TM) 64-Bit Server VM (build 25.191-b12, mixed mode)


Command:



Hadoop version:

Hadoop 2.8.3
SubversionThe hyperlink login is visible.-r b3fe56402d908019d99af1f1f4fc65cb1d1436a2
Compiled by jdu on 2017-12-05T03:43Z
Compiled with protoc 2.5.0
From source with checksum 9ff4856d824e983fa510d3f843e3f19d
This command was run using /home/itsvse/apache/hadoop-2.8.3/share/hadoop/common/hadoop-common-2.8.3.jar


Command:




HBase version:

2.1.1, rb60a92d6864ef27295027f5961cb46f9162d7637, Fri Oct 26 19:27:03 PDT 2018

hbase shell command:


The HBase shell can be started using the following command
[root@master ~]# find / -name "hbase"
/home/itsvse/apache/hbase-2.1.1/docs/testapidocs/org/apache/hadoop/hbase
/home/itsvse/apache/hbase-2.1.1/docs/testapidocs/org/apache/hbase
/home/itsvse/apache/hbase-2.1.1/docs/testapidocs/src-html/org/apache/hadoop/hbase
/home/itsvse/apache/hbase-2.1.1/docs/testapidocs/src-html/org/apache/hbase
/home/itsvse/apache/hbase-2.1.1/docs/apidocs/org/apache/hadoop/hbase
/home/itsvse/apache/hbase-2.1.1/docs/apidocs/org/apache/hbase
/home/itsvse/apache/hbase-2.1.1/docs/apidocs/src-html/org/apache/hadoop/hbase
/home/itsvse/apache/hbase-2.1.1/docs/apidocs/src-html/org/apache/hbase
/home/itsvse/apache/hbase-2.1.1/bin/hbase
/home/itsvse/apache/hbase-2.1.1/lib/ruby/hbase
[root@master ~]# cd /home/itsvse/apache/hbase-2.1.1/bin/
[root@master bin]# ./hbase shell
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/itsvse/apache/hadoop-2.8.3/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/itsvse/apache/hbase-2.1.1/lib/client-facing-thirdparty/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindingsfor an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]

HBase Shell
Use "help" to get list of supported commands.
Use "exit" to quit this interactive shell.
For Reference, please visit:http://hbase.apache.org/2.0/book.html#shell
Version 2.1.1, rb60a92d6864ef27295027f5961cb46f9162d7637, Fri Oct 26 19:27:03 PDT 2018
Took 0.0050 seconds                                                                                                                                                            
hbase(main):001:0>
hbase(main):002:0*
hbase(main):003:0* version
2.1.1, rb60a92d6864ef27295027f5961cb46f9162d7637, Fri Oct 26 19:27:03 PDT 2018
Took 0.0006 seconds                                                                                                                                                            
hbase(main):004:0>


Introduction

After the Hadoop installation is successfully started, run the jps command to check whether the process starts successfully, if it is successful (not tested).

[hadoop@master ~]$jps
The masternode will appear:
NameNode
JobTracker
SecondaryNameNode

slave1 node appears:
DateNode
TaskTracker

slave2node appears:
DateNode
TaskTracker


HBase version supported Hadoop version

S stands for support
X is not supported
NT stands for no test



Reference links:The hyperlink login is visible.

Some basic operation commands of HBase Shell are listed as follows:

nameCommand expressions
See what tables existlist
Create a tablecreate 'table name', 'column name 1', 'column name 2', 'column name N'
Add a recordput 'table name', 'row name', 'column name:', 'value'
View the recordget 'table name', 'row name'
View the total number of records in the tablecount 'table name'
Delete the recorddelete 'table name', 'row name', 'column name'
Delete a tableThe table must be blocked before the table can be deleted, the first step is disable 'table name' The second step is to drop 'table name'
View all recordsscan "table name"
See all the data in a certain column of a tablescan "table name" , ['column name:']
Update the recordIt is to rewrite it and revert


Understand

Hadoop Distributed File System (HDFS), HBase is a data storage project based on Hadoop, and Hive is used for data analysis.

(End)






Previous:Installing vim on CentOS 7 (not installed by default)
Next:Microsoft 2018 New Year's Eve gift package dry goods
 Landlord| Posted on 12/28/2018 3:15:53 PM |
Hadoop web port introduction:The hyperlink login is visible.
Links to the latest version:The hyperlink login is visible.

Daemon
Notes
NameNode
Default HTTP port is 50070.
ResourceManager
Default HTTP port is 8088.
MapReduce JobHistory Server
Default HTTP port is 19888.

The default port for HBase Web is: 16010


Posted on 1/6/2019 9:32:01 PM |
The altar master QQ gives a connection
 Landlord| Posted on 7/5/2019 12:06:12 PM |


Hadoop-3.1.1+ already supports HBase-2.2.x.

On February 6, 2019, Hadoop version 3.1.2 was released

The hyperlink login is visible.
Disclaimer:
All software, programming materials or articles published by Code Farmer Network are only for learning and research purposes; The above content shall not be used for commercial or illegal purposes, otherwise, users shall bear all consequences. The information on this site comes from the Internet, and copyright disputes have nothing to do with this site. You must completely delete the above content from your computer within 24 hours of downloading. If you like the program, please support genuine software, purchase registration, and get better genuine services. If there is any infringement, please contact us by email.

Mail To:help@itsvse.com