![]() But the problem is if first node is removed out of 3 nodes cluster is getting impacted badly with connection loss.Īnd I was trying one more solution like to have same zookeeper string across the cluster. As I mentioned earlier I am able to achieve Secure Nifi Clustering. zookeeper.start=trueĪnd the additional configurations from the Apache NiFi admin guide linked above. Which is all explained on the link I gave you ĪND once you decide who the member nodes of your zookeeper are then all the NiFi's regardless of wether they are zookeeper servers or not should have this property set:Īnd using your IP examples if you want 3 servers to be zookeeper servers, then I would expect this setting to be: zookeeper.properties=./conf/zookeeper.properties If it is set to true, then Nifi will start a zookeeper service too and will depend on this setting: In it it discusses howe to configure the NiFi to start up as an embedded zookeeper service and the settings needed to accomplish this.įor clarity port 2181 is the zookeeper listening port and depending on how many servers you configured to be your zookeeper servers based of this nifi.properties entry: This answer is very eloquently explained Īnd with that said please make sure you follow this guide: When in multi node we have a zookeeper ensemble and when we have that we need to maintain a quorum. So let's delve a little into zookeeper, we have zookeeper the service that can be single node or multi node. To me it seems that is what you are trying to connect to given the IP examples, so you are trying to use NiFi's embedded Zookeeper capability. With that said and to make things "flow" better, NiFi allows us to start an embedded zookeeper cluster. So just to be clear Apache Zookeeper can be considered an external service to help with state management / NiFi clustering Can anyone please help me out with this ? Thanks in advance. But only this is problem where I stuck and not able to move ahead. I am able to achieve all the clustering activity by taking reference of available resources and by doing some POC work. I am kind of new to the Nifi and working on clustering part. So now Node 2 and Node 3 is already down (like never started). So I am trying to setup same zookeeper string for all the node at once and trying to start server one by one. As Node 2 and Node 3 waiting for Node 1 which is down which turns into cluster failure. If Node 1 is up and running and I am turning of any other node than Node 1, then cluster is working without any issue.īut problem with above configuration is, if I am turning off the Node 1 (192.168.0.10), then cluster is failing with the connection loss status. I am able to setup the cluster by using below zookeeper string in the respective nodes,
0 Comments
Leave a Reply. |