Apache Samza

Monday October 24, 2016

Announcing the release of Apache Samza 0.11.0

We are excited to announce that the Apache Samza 0.11.0 has been released.

Samza is a stable and mature Stream processing framework that has been powering real time applications across various companies in production for a few years now. Samza has industry leading support for stateful stream processing with cutting edge features like

  • Support for RocksDB based local state.
  • Incremental state checkpointing: This feature is unique compared to existing stream processing frameworks and allows Samza to support applications with large state very elegantly.
  • Minimal impact during application upgrades by minimizing state movement.
Deep support for local state allows a stateful application to scale up to 1.1 Million events/sec on a single SSD based machine.

The 0.11.0 release packs up several large improvements in runtime performance, operational stability and ease of use. Some of the key highlights include

  • Asynchronous API and processing (SAMZA-863, doc): Prior to this release, Samza only supported a synchronous single threaded process model. Increasing the number of containers (processes) to increase parallelism required a lot more memory resources. This inefficiency was more obvious for applications that make remote calls to external services/databases. With this new feature an application can increase parallelism very efficiently within a single container (process). In addition to a parallel processing model we now also support a purely asynchronous processing model which makes it a lot more efficient to perform remote I/O. In the absence of this support for async processing model, samza applications that wanted to process messages asynchronously would also had to handle the additional complexity of managing checkpointing (by disabling auto-checkpointing in Samza). With the new support for async processing, Samza will make sure that checkpointing is automatically performed only after the async calls have completed.
  • Separate Samza framework deployment from user jobs (SAMZA-849, doc): Typically in a large organization the team that manages the Samza cluster is not the same as the teams that are running applications on top of Samza. This feature allows upgrading the Samza framework without forcing developers to explicitly upgrade their running applications. With simple config changes, it supports canary, upgrade and rollback scenarios commonly required in organizations that run tens or hundreds of jobs.
  • Samza Rest API (SAMZA-865, doc): The REST API provides a rich set of operations for the users to interact with their running jobs. Samza REST API allows you to start, stop and list jobs, and also run periodic monitoring scripts. This API can be integrated with deployment tooling and job dashboard for better job management.
  • Disk monitoring (SAMZA-924): A Samza YARN cluster is used to run several stream processing applications on a shared set of physical machines. In such a multi-tenant environment it is critical to have some limits on the amount of disk space used by each job, especially to store application state. This feature introduces the measurement of the disk usage for selected job directories. The disk space usage will be gathered periodically and reported to Samza metrics. In the next release this feature will be extended to also enforce the disk quotas.
  • New metrics to troubleshoot and monitor performance issues: SAMZA-972 added holistic monitoring of memory in Samza applications. With SAMZA-963 we added the ability to troubleshoot performance issues better by isolating the time spent in the application from the time spent in accessing state.
Overall, 37 JIRAs were resolved in this release.

A source download of the 0.11.0 release is available here. The release JARs are also available in Apache's Maven repository. See Samza's download page for details.

Project Status
A total of 62 contributors have contributed to the Samza Project so far. In this release 21,473 lines of code were added/changed.

With this release we also add 3 new committers to the Apache Samza community.

Recent Community Activities
There has been a lot of activities from the community during this release time frame. Here are links to some of them.

Contribute!
There are a lot more exciting features to expect in our future release. Some of them are:

It’s a great time to get involved. You can start by running through the hello-samza tutorial, signing up for the mailing list, and grabbing some newbie JIRAs. Also, don’t miss out the upcoming meetup on November 2. Sign up now!

I'd like to close by thanking everyone who's been involved in the project. It's been a great experience to be involved in this community, and I look forward to its continued growth.

Comments:

Thank you for sharing. The update (Apache Samza 0.11.0) is very good.

Posted by Sunil Tripathi on October 25, 2016 at 11:27 AM GMT #

Nice post. Thank you for sharing.

Posted by Sunil on November 28, 2016 at 08:03 AM GMT #

Samza is a stable and mature Stream processing framework

Posted by Yahoo mail login on December 19, 2017 at 09:10 AM GMT #

Thank you very much for such great blog!

Posted by effie on September 20, 2018 at 08:22 AM GMT #

Here you will be able to grab information regarding turn off touch screen windows 10 as here we are having https://windowsclassroom.com/disable-touch-screen-windows-10 one of the best website which will display all information in the form of images so that you can easily seize.

Posted by Hard Work on September 24, 2018 at 07:41 AM GMT #

This is a nice update just like fmwhatsapp. It is now one of the finest whatsapp mods ever in the history since it has thousands of features and few more to be added in future. get it from https://www.fmwhatsapp.xyz/

Posted by raj on July 15, 2019 at 09:31 PM GMT #

This blog is definitely entertaining additionally factual. I have picked up helluva helpful tips out of this amazing blog. I ad love to visit it again and again. Thanks! https://hotmailhelper.com/

Posted by Hotmail Login on July 18, 2019 at 02:06 AM GMT #

It’s ok. In both images where she is against the yellow she clearly looks bored. I think the art direction could’ve been a bit better on this one. Nice colour.

Posted by good on July 19, 2019 at 10:07 PM GMT #

Show, projeto consistente Lucas :) COOL !

Posted by trogalnefol1972 on July 19, 2019 at 11:45 PM GMT #

Digging the color scheme Thanks a lot @laurence & keane @Katerina Yanshyna @Daniil Danilov @Arnaud Robles @Kevin Krautgartner

Posted by millpoticha1977 on July 20, 2019 at 08:42 AM GMT #

Nice work! @Pop & Pac Studio OH

Posted by cuspapota1972 on July 20, 2019 at 08:42 AM GMT #

Buen trabajo Absolutely loved the different shapes! You’re awesome my friend!

Posted by krathdeharna1977 on July 20, 2019 at 08:56 AM GMT #

Outstanding work!!! Interesting name! haha

Posted by thekocourwoe1981 on July 20, 2019 at 03:43 PM GMT #

wow this looks... edible Great and inspiring!

Posted by itimalam1980 on July 20, 2019 at 04:02 PM GMT #

Great job, let me know what you think of my work. :) Awsome.

Posted by clatazenvaj1982 on July 20, 2019 at 05:20 PM GMT #

Beautiful serie! wowoowow, these animations, typography! looks so solid together, great!

Posted by mseterinsym1978 on July 20, 2019 at 05:43 PM GMT #

The "pegs" that represent people was a very unique choice. The design captures Googles brand well. Really like the 1920's vibes to this!

Posted by lewaracbui1977 on July 20, 2019 at 06:08 PM GMT #

Really interesting and original project @Eiko Ojala , I like your vision and how you illustrate this important theme about climate change. Your all work is very nice so I am waiting for your next project.

Posted by mircurapo1980 on July 20, 2019 at 06:33 PM GMT #

Wow :D Such a fresh old school illustrations! You are amazing! Great work girl!! ;)

Posted by cyczecocall1976 on July 20, 2019 at 10:56 PM GMT #

Amazing work and great presentation! Congrats. You nailed the concept. Old fashioned, high quality.

Posted by destsecrutycz1974 on July 20, 2019 at 11:57 PM GMT #

love your design It's so cute!!

Posted by viesenrapad1986 on July 21, 2019 at 02:14 AM GMT #

Fantastic presentation!! Realizas workshop, talleres por Madrid ó alrededores?

Posted by iclasmangprot1977 on July 21, 2019 at 03:52 AM GMT #

super cool, would have just thought they where 3d models Wow I love the intricate details, and fun colors.

Posted by ecfragenib1986 on July 21, 2019 at 05:07 AM GMT #

Very Very nice use of emotion in this work. The expressions that the illustrations give off are those that all of us show when we are at our most peaceful. Bright and colorful. Very good work. Im impressed!

Posted by toorealrdarju1980 on July 21, 2019 at 05:44 AM GMT #

Great work! nicely done!

Posted by reromlonon1972 on July 21, 2019 at 06:20 AM GMT #

Wonderful!! ♥ amaaaaazing

Posted by guezietuba1986 on July 21, 2019 at 06:53 AM GMT #

wow excellent! love it. Damn *_*

Posted by starnuckingver1988 on July 21, 2019 at 07:26 AM GMT #

Очень круто) Thank you Mike.

Posted by agxabackme1981 on July 21, 2019 at 07:57 AM GMT #

Grear color! lovee it!!

Posted by postspoodelcred1971 on July 21, 2019 at 08:30 AM GMT #

Just awesome pictures Those photos are really amazing.

Posted by wilbbackmifor1985 on July 21, 2019 at 09:02 AM GMT #

Nice branding, well done. This is splendid work!

Posted by windmipasspa1979 on July 21, 2019 at 09:34 AM GMT #

Amaaaaaaaaazing Wow. Love, Death and Robots was a highlight of Netflix for me and this episode was pretty epic. Really nice work.

Posted by esberpator1984 on July 21, 2019 at 10:08 AM GMT #

Outstanding work!! Fabulous. Just fabulous. With such design, you want the restaurant to succeed.

Posted by feiletase1986 on July 21, 2019 at 10:41 AM GMT #

Nice work! :)

Posted by stuparmsifov1983 on July 21, 2019 at 11:14 AM GMT #

I can understand the gravity of this situation. So i will try to know more about it. https://seofirms.net/seo-companies

Posted by Jonga on July 25, 2019 at 05:30 AM GMT #

Post a Comment:
  • HTML Syntax: NOT allowed

Calendar

Search

Hot Blogs (today's hits)

Tag Cloud

Categories

Feeds

Links

Navigation