Apache Samza

Tuesday December 22, 2015

Announcing the release of Apache Samza 0.10.0

I am very excited to announce that the much awaited Apache Samza 0.10.10 has been released. This is our third release as an Apache Top-level Project. Samza is a distributed stream processing framework that uses Apache Kafka for messaging, and Apache Hadoop YARN to provide fault tolerance, processor isolation, security, and resource management. The project graduated from Apache Incubator early this year in January. It was originally created at LinkedIn and still continues to be used in production. The project is currently under active development with contributions from a diverse group of contributors and commiters. Since the last release in July 2015, there has been a significant increase in the adoption of Samza in the industry (e.g. Samza is in production in Uber and Netflix. see PoweredBy).

A source download of the 0.10.0 release is available here. The release JARs are also available in Apache's Maven repository. See Samza's download page for details.

Overall, 130 JIRAs were resolved in this release. A few highlights:

  • Introduced Coordinator Stream to support large and dynamic configuration in a Samza job (SAMZA-348), along with a command-line tool to write to the Coordinator Stream (SAMZA-704)
  • Added support for Broadcast Stream (SAMZA-676)
  • Implemented host-affinity feature in Yarn for more robust recovery of stateful jobs (SAMZA-617)
  • Upgraded RocksDB JNI version to 3.13.1 (SAMZA-747), along with support for TTL (SAMZA-537)
  • Introduced HDFS producer (SAMZA-693) and ElasticSearch (SAMZA-654) producer, to allow writing directly from Samza to HDFS stores and ElasticSearch respectively
  • Implemented tools to better support troubleshooting of RocksDB stores in the job (SAMZA-598)
  • Fixed some performance and stability issues that got introduced (SAMZA-798, SAMZA-754, SAMZA-723)

Known issues in this release:

  • Negative RocksDB TTL is not handled properly (SAMZA-838)
  • Slow start of Samza jobs with large number of containers (SAMZA-843)
  • Incompatible change in Kafka producer that does not honor custom partitioners (SAMZA-839)

We've also made a lot of community progress during this release:

  • Added 3 more companies in the powered by page (Uber, State.com, Netflix)
  • 2 Successful meetups were held - one in July and the other in October
  • Accepted patches from 37 distinct contributors
  • 917 emails sent to the developer mailing list in past 3 months

There are a lot to exciting features to expect in our future release. Some of them are:

Starting 0.10.0 release, Samza will require java 1.7+ and Yarn 2.6.1+.

It’s a great time to get involved. You can start by running through the hello-samza tutorial, signing up for the mailing list, and grabbing some newbie JIRAs.

I'd like to close by thanking everyone who's been involved in the project. It's been a great experience to be involved in this community, and I look forward to its continued growth.

Comments:

release is expected in 2017 and here are exclusive updates and plot details about our favorite anime series

Posted by Kamisama Kiss Season 3 on August 04, 2017 at 12:09 PM GMT #

apache green is truly one of the best handcrafted software available on internet.. i am loving it

Posted by Thomas Green on December 02, 2017 at 09:12 AM GMT #

Good article!

Posted by run 3 game on December 07, 2017 at 07:21 AM GMT #

Very interesting is what you write. It is very important that what you write.

Posted by Kayla on May 07, 2018 at 08:39 AM GMT #

This text is perfect

Posted by Cherida on May 24, 2018 at 08:29 AM GMT #

release is expected in 2017 and here are exclusive updates and plot details about our favorite anime series

Posted by itunes login on May 25, 2018 at 05:31 PM GMT #

I am so exited to visit your post. thank you for sharing this great blog. there presented tutorial is very helpful for usb port connection in your system.

Posted by USB Port Stopped Working on June 09, 2018 at 06:43 AM GMT #

Congratulation on writing amazing information! I should think that the posting is a maximum standard articles and it meets all kinds of standards. Well-done.

Posted by Diana on June 29, 2018 at 11:23 PM GMT #

Hey. Right here is an issue for everyone who search for high excellence material. Will you look for an additional site? If you ask me I will express absolutely no. This page is ideal for me!

Posted by Victoria on June 29, 2018 at 11:24 PM GMT #

Hi publisher! Thank-you for staying there and publishing so perfectly articles. There is a person who love it and express thank you!

Posted by Monica on June 29, 2018 at 11:25 PM GMT #

In my viewpoint, not numerous bloggers have so numerous ideas to build unique, appealing blog posts. Many thanks for undertaking it and I really want you didn't lose the inspiration to write the new ones!

Posted by Veronica on June 29, 2018 at 11:26 PM GMT #

Hey everyone! It truly is very worthwhile document. I am amazed that you are so capable. I didn't confidence you!

Posted by Sara on July 03, 2018 at 10:15 PM GMT #

Congratulation on composing incredible articles! I must state that the posting is a high standard text and it fulfils all sorts of standards. Well done.

Posted by Diana on July 03, 2018 at 10:16 PM GMT #

Hi. Here is an issue for everyone who try to find big excellence articles. Will you seek different website? If you inquire me I will mention absolutely no. That website is greatest for myself!

Posted by Victoria on July 03, 2018 at 10:17 PM GMT #

Hi publisher! Thank-you for becoming here and posting so actually content. There is anyone who appreciate it and express thank you!

Posted by Monica on July 03, 2018 at 10:17 PM GMT #

Hey. There is a question for every one who seek high quality reports. Will you search for an additional blog? If you consult me I will state NO. That page is ideal for me!

Posted by Nicole on July 05, 2018 at 10:52 PM GMT #

Hi writer! Thank-you for getting here and posting so well posts. Here is someone who value it and mention thanks a lot!

Posted by Kelly on July 05, 2018 at 10:53 PM GMT #

In my view, not many bloggers own so numerous ideas to build latest, absorbing blog posts. Thanks for creating it and I hope you did not lose the determination to make the new ones!

Posted by Sara on July 05, 2018 at 10:54 PM GMT #

I totally agree with the earlier audience. I know the ideal determination and positive responses are wonderful basis to establish top quality content.

Posted by Diana on July 05, 2018 at 10:54 PM GMT #

Thank you very much. i think a lot of people are looking for such a content from you. hope you will have more share such.

Posted by bouncing balls on July 30, 2018 at 08:34 AM GMT #

Nice idea , now i know what to gift my girl best friend. thnx alot

Posted by red ball on July 30, 2018 at 08:34 AM GMT #

Post a Comment:
  • HTML Syntax: NOT allowed

Calendar

Search

Hot Blogs (today's hits)

Tag Cloud

Categories

Feeds

Links

Navigation