Apache Falcon

Thursday March 20, 2014

Starting Apache Falcon in distributed mode

Apache Falcon can be deployed in two modes, Embedded mode and Distributed mode. Both the modes have there uses which are described below : 1. Embedded Mode : Embedded mode is also called standalone mode. This setup is useful when you have only one cluster from where you want data to be managed and processed. All the request like submit, delete, schedule etc go to the single server that is started.

To start falcon in distributed mode the following steps are required :

1. Build falcon in distributed mode 2. Edit startup property for falcon server / servers 3. Edit runtime property for falcon prism 4. Example

Step 1. Build falcon in distributed mode

Please follow the steps here for building falcon in distributed mode. If above step is successful you should have 3 ".tar.gz" files at the end ,one each for falcon prism, server and client in the target dirs.

Step 2. Edit startup property for falcon server

For starting falcon in distributed we need to provide logical names to servers we are starting. These names need to be mentioned in startup.properties for the given server. Add the following property in the "conf/startup.properties" in the server package you have untar.
         *.current.colo=< colo name >
Colo is a colocation or a physical data centre location where one or more clusters may be configured. If you are planning to start more than one server add the above in each of the conf/startup.properties . Remember the cole name you have mentioned here. Same name should be used in cluster.xml while submitted a cluster later via prism. Start the servers using the commands given here here

Step 3. Edit runtime property for falcon prism

Untar the falcon prism package. Once servers have been configured and started, prism need to be configured with information on where these servers are started. For that below two properties needs to be added to prism "conf/runtime.properties" .
*.all.colos=< colo name 1 >, < colo name 2 >
*.falcon.< colo name 1 >.endpoint=http://< hostname 1 >:15000
*.falcon.< colo name 2 >.endpoint=http://< hostname 2 >:15000
Start Falcon Prism using commands given here here

Example :

If you are configuring a falcon setup with 1 prism and 2 servers, with cluster name cluster1 and cluster2, below are the thing that needs to added : 1. edit server one startup.properties and add *.current.colo=colo1 2. edit server two startup.properties and add *.current.colo=colo2 3. Start the servers 4. edit prism runtime.properties and add
     *.all.colos=colo1, colo2
     *.falcon.colo1.endpoint=http://< hostname 1 >:15000
     *.falcon.colo2.endpoint=http://< hostname 2 >:15000
5. Start falcon prism.


By default falcon server start with its own activemq, if for any reason you dont want embedded activemq (like starting more than one server on same host) , it can be disabled. Step 1. Disable start of activemq in falcon server start script edit "bin/falcon-start" script and add FALCON_OPTS="-Dfalcon.embeddedmq=false" Step 2. In startup.properties of falcon server add your own activemq url


thanks for useful article its awesome and i shared it on : http://kiamo.ir thanks

Posted by Alireza on August 08, 2016 at 05:56 AM GMT #

Here you will be able to download free mozilla firefox with the help of https://foxdownload.org which will take you directly towards firefox browser and this browser provides you the exact results within few seconds. If you used this browser for once surely you will be loving it.

Posted by techzest23 on May 22, 2018 at 07:50 AM GMT #

I followed the steps for building falcon in distributed mode. I want to use in my <a href="https://www.petmalzeme.net/">petshop</a> site

Posted by Sare Damar on October 11, 2018 at 01:19 PM GMT #

I followed the steps for building falcon in distributed mode. I want to use in my site : https://www.petmalzeme.net/

Posted by Sare Damar on October 11, 2018 at 01:20 PM GMT #

Hey really such a great blog dear

Posted by http://nosoundwindows10.com/ on October 31, 2018 at 04:34 AM GMT #

Thanks for letting us know the steps in starting Falcon in distributed mode. This will surely help the website that I'm running. https://www.knoxvilleconcretepros.com

Posted by www.charlottefenceinstallation.com on October 31, 2018 at 07:49 AM GMT #

most of them use this website. https://freeeshopcodes.home.blog/

Posted by karuna on December 24, 2018 at 11:45 AM GMT #

Great information really useful.

Posted by aboutmens on January 12, 2019 at 06:08 AM GMT #

I simply want to tell you that I am new to weblog and definitely liked this blog site. I have been meaning to write something like this on my website and you have given me an idea https://www.freefirepc.com/ thanks for sharing

Posted by Henry Stok on February 21, 2019 at 05:42 PM GMT #

What a fantastic post!This is so chock full of useful information. I can't wait to dig deep and start utilizing the resources you have given me. Thanks again for sharing https://www.apexskins.net/apex-legends-settings apex game settings with us.

Posted by Husain Salam on February 21, 2019 at 05:45 PM GMT #

Your site fantastic, superior quality succeed... Most probably various should realize others despite that they don't take time to advise you. <a href='http://best-penis-pump.com/' >Bathmate HydroMax</a>

Posted by bathmate pump on March 11, 2019 at 07:41 AM GMT #

I really needed this info! Thanks so much for sharing! : )

Posted by Stamford Concrete on March 26, 2019 at 01:38 PM GMT #

Post a Comment:
Comments are closed for this entry.



Hot Blogs (today's hits)

Tag Cloud