Monthly Archives: June 2017

kafka集群安装文档

1. kafka下载与安装 su – root wget http://www-us.apache.org/dist/kafka/0.10.1.0/kafka_2.11-0.10.1.0.tgz tar zxvf kafka_2.11-0.10.1.0.tgz sudo mv kafka_2.11-0.10.1.0 /usr/local/kafka sudo chown -R root:root /usr/local/kafka 2.常用指令 #创建Topic ./bin/kafka-topics.sh –zookeeper 127.0.0.1:2181 –replication-factor 1 –partition 250 –topic wgame_log –create #列出Topic ./bin/kafka-topics.sh –zookeeper 127.0.0.1:2181 –list #删除wgame_log ./bin/kafka-topics.sh –delete –zookeeper … Continue reading

Posted in 编程技术类 | Leave a comment

hbase集群安装文档

1. 一台机器上的配置文档 1.1 参考 hadoop集群文档完成hadoop的安装 hbase依赖于hadoop 1.2 hbase安装 cd /usr/local wget https://archive.apache.org/dist/hbase/hbase-0.98.8/hbase-0.98.8-hadoop2-bin.tar.gz sudo tar xzf hbase-0.98.8-hadoop2-bin.tar.gz sudo mv hbase-0.98.8-hadoop2 hbase sudo chown -R hduser:hadoop hbase 1.3 修改 hbase-env.sh 文件 cd /usr/local/hbase/conf 修改 vim hbase-env.sh export JAVA_HOME=/usr/java/jdk1.8.0_131 export HBASE_MANAGES_ZK=true 1.4 修改 … Continue reading

Posted in 编程技术类 | Leave a comment

Flume安装文档

下载与安装 wget http://archive.apache.org/dist/flume/1.7.0/apache-flume-1.7.0-bin.tar.gz tar -zxf apache-flume-1.7.0-bin.tar.gz sudo mv apache-flume-1.7.0-bin /usr/local/flume sudo chown -R hduser:hadoop /usr/local/flume vim ~/.bashrc export FLUME_HOME=/usr/local/flume export PATH=$PATH:$FLUME_HOME/bin source ~/.bashrc cd /usr/local/flume/conf cp flume-env.sh.template flume-env.sh cp flume-conf.properties.template flume-conf.properties vim flume-env.sh export JAVA_HOME=/usr/java/jdk1.8.0_131 export JAVA_OPTS=”-Xms100m -Xmx200m -Dcom.sun.management.jmxremote” 配置 … Continue reading

Posted in 编程技术类 | Leave a comment