kafka单独使用,kafka搭建使用

进入/home/appuser/application文件夹将kafka安装包上传至此处

解压安装包并改名

tar -xvf kafka_2.13-3.3.1.tgzmv kafka_2.13-3.3.1.tgz kafka

在kafka文件夹下创建zookeeper数据文件夹kafka和zookeeper的日志文件存放文件夹

mkdir zookeepermkdir logcd logmkdir zookeepermkdir kafka

修改相关配置文件

zookeeper.properties

authProvider.1org.apache.zookeeper.server.auth.SASLAuthenticationProviderrequireClientAuthSchemesasljaasLoginRenew3600000dataDir/home/appuser/application/kafka/zookeeper#zookeeper端口clientPort2282tickTime2000initLimit10syncLimit5server.0当前服务器ip:2999:3999

server.properties

broker.id0listenersSASL_PLAINTEXT://当前服务器ip:9092advertised.listenersSASL_PLAINTEXT://当前服务器ip:9092security.inter.broker.protocolSASL_PLAINTEXTsasl.enabled.mechanismsPLAINsasl.mechanism.inter.broker.protocolPLAINauthorizer.class.namekafka.security.authorizer.AclAuthorizerallow.everyone.if.no.acl.foundtruesuper.usersUser:adminzookeeper.set.acltruelog.dirs/home/appuser/application/kafka/log/kafkazookeeper.connect当前服务器ip:2282

密码校验

新建jaas.conf文件放置在kafka/config下

配置如下

Server {org.apache.kafka.common.security.plain.PlainLoginModule required  usernameadmin   passwordadmin1234   user_kafkaadmin1234   user_adminadmin1234;};Client {   org.apache.kafka.common.security.plain.PlainLoginModule requiredusernamekafkapasswordadmin1234;};KafkaServer {   org.apache.kafka.common.security.plain.PlainLoginModule required   usernamekafka  passwordadmin1234  user_adminadmin1234   user_kafkaadmin1234;};KafkaClient {   org.apache.kafka.common.security.plain.PlainLoginModule required   usernamekafka   passwordadmin1234;};

将jaas.conf文件加入到kafka启动脚本(/kafka//kafka-server-start.sh)和zookeeper启动脚本(/kafka//zookeeper-server-start.sh)中

if [ x$KAFKA_HEAP_OPTS  x ]; then   export KAFKA_HEAP_OPTS-Xmx1G -Xms1G -Djava.security.auth.login.config/home/appuser/application/kafka/config/jaas.conffiif [ x$KAFKA_HEAP_OPTS  x ]; then    export KAFKA_HEAP_OPTS-Xmx512M -Xms512M -Djava.security.auth.login.config/home/appuser/application/kafka/config/jaas.conffi

启动服务

进入kafka目录执行如下命令

nohup .//zookeeper-server-start.sh ./config/zookeeper.properties >./log/zookeeper/zookeeper.log 2>1 &nohup .//kafka-server-start.sh ./config/server.properties >./log/kafka/kafka.log 2>1 &