Apache Samza

Friday August 25, 2017

Announcing the release of Apache Samza 0.13.1

We are very excited to announce the release of Apache Samza 0.13.1
Samza has been powering real-time applications in production across several large companies (including LinkedIn, Netflix, Uber) for years now. Samza provides leading support for large-scale stateful stream processing with:

  • First class support for local state (with RocksDB store). This allows a stateful application to scale up to 1.1 Million events/sec on a single machine with SSD.
  • Support for incremental checkpointing of state instead of full snapshots. This enables Samza to scale to applications with very large state.
  • A fully pluggable model for input sources (e.g. Kafka, Kinesis, DynamoDB streams etc.) and output systems (HDFS, Kafka, ElastiCache etc.).
  • A fully asynchronous programming model that makes parallelizing remote calls efficient and effortless.
  • High level API for expressing complex stream processing pipelines in few lines of code.
  • Flexible deployment model for running the the applications in any hosting environment and with cluster managers other than YARN.
  • Features like canaries, upgrades and rollbacks that support extremely large deployments with minimal downtime.

Enhancements, Upgrades and Bug Fixes

This is a stability release to make Samza as an embedded library production ready. Samza as a library is part of Samza’s Flexible Deployment model; release fixes a number of outstanding bugs includes the following enhancements to existing features:
  • SAMZA-1165 Cleanup data created by ZkStandalone in ZK
  • SAMZA-1324 Add a metrics reporter lifecycle for JobCoordinator component of StreamProcessor
  • SAMZA-1336 Standalone session expiration propagation
  • SAMZA-1337 LocalApplicationRunner supports StreamTask
  • SAMZA-1339 Add standalone integration tests
This release also includes several bug-fixes and improvements for operational stability. Some notable ones are:
  • SAMZA-1282 Fix killed leader process issue when spinning up more containers than the number of tasks kills leader
  • SAMZA-1340 StreamProcessor does not propagate container failures from StreamTask
  • SAMZA-1346 GroupByContainerCount.balance() should guard against null LocalityManager
  • SAMZA-1347 GroupByContainerIds NPE if containerIds list is null
  • SAMZA-1358 task.class empty string should be ignored when app.class is configured
  • SAMZA-1361 OperatorImplGraph used wrong keys to store/retrieve OperatorImpl in the map
  • SAMZA-1366 ScriptRunner should allow callers to control the child process environment
  • SAMZA-1384 Race condition with async commit affects checkpoint correctness
  • SAMZA-1385 Fix coordination issues during stream creation in LocalApplicationRunner
Overall, 29 JIRAs were resolved in this release.
A source download of the 0.13.1 release is available here. The release JARs are also available in Apache’s Maven repository. See Samza’s download page for details and Samza’s feature preview for new features. We requires JDK version newer than 1.8.0_111 when running 0.13.1 release for users who are using Scala 2.12.

Community Developments

We’ve made great community progress since the last release (0.13.0). We presented Samza high level API features at the Cloud+Data NEXT Conference 2017 held in Silicon Valley, USA, and also gave a talk regarding the key features (Secret Kung Fu) of Samza at ArchSummit 2017 in Shenzhen, China, and a detailed study of stateful stream processing in VLDB 2017. Here are the details to these conferences. In industry, Samza got new adopters, including Redfin and VMWare.
As future development, we are continuing working on improving the new High Level API and flexible deployment features. Here is the list of the tasks for upcoming features and improvements.

Upcoming Samza Meetup

Don’t miss out the upcoming meetup on September 12, 2017. Sign up now!

Contribute

It’s a great time to get involved. You can start by reviewing the tutorials, signing up for the mailing list, and grabbing some newbie JIRAs.
I’d like to close by thanking everyone who’s been involved in the project. It’s been a great experience to be involved in this community, and I look forward to its continued growth.

Comments:

Awesome update. Loved it.

Posted by Vshare on September 22, 2017 at 05:02 AM GMT #

Nice release!

Posted by gomovies on November 22, 2017 at 04:30 AM GMT #

No any type of special permission is required and after go with it you will be eligible to play game online http://freerobuxgenerator.net. Thanks a lot for free robux generator allow me play online game.

Posted by ank on December 21, 2017 at 08:02 AM GMT #

Has Samza been powering real-time applications in production across several our small companies?

Posted by sonic games on March 27, 2019 at 09:19 AM GMT #

beachfront real estate in Orange County CA

Posted by Gerry Goodman on April 22, 2019 at 07:06 AM GMT #

Awesome update. This is a really useful version, thank you for sharing

Posted by Thongad Danny on April 23, 2019 at 04:04 AM GMT #

Love your work!! Hopeful to watch some tutorial on this for beginners like me :) Beautiful photography!

Posted by medicine on July 19, 2019 at 10:19 PM GMT #

This is such a great, unique interpretation of a classic story! Well done!

Posted by sahomemorr1974 on July 20, 2019 at 08:43 AM GMT #

I loved the different elements you portrayed in each one of your pieces. Especially the textures. Great character designs!

Posted by dsetreptecar1974 on July 20, 2019 at 03:50 PM GMT #

Hermosos colores! Que buen trabajo, mis respetos.

Posted by tihahoco1970 on July 20, 2019 at 04:08 PM GMT #

Oh, Kit-Kat. Love. Yum Yum Yum. Great Wrok

Posted by stacgenmubit1979 on July 20, 2019 at 05:28 PM GMT #

Unbelievable! Really impressive even if it seems simple as a breeze! Congratulations! Lol awesome photos but wth is this tower and why does it exist? loll

Posted by nabstohvica1984 on July 20, 2019 at 05:53 PM GMT #

amazing work. Thanks so much!

Posted by crafacneper1982 on July 20, 2019 at 06:14 PM GMT #

下次文字描述,别写到图里,在这个项目遍及里面写。方便看不懂中文的网友看剧情详解^_^ These are beautiful!

Posted by loarewneuling1976 on July 20, 2019 at 06:36 PM GMT #

Your book cover design is wonderful, may I ask what is this book about if you don't mind. This is stunning! Love it!!

Posted by presdinarja1976 on July 20, 2019 at 11:12 PM GMT #

@Eveling Salazar @Vébé ® @Ramon Li - thank you for your kind comments and support! Very interesting work! Color solution is excellent

Posted by oropulha1979 on July 21, 2019 at 12:04 AM GMT #

beautiful logotype and minimal design, love it! liked the characters so much

Posted by tisperpdogtcont1972 on July 21, 2019 at 12:54 AM GMT #

creative This is one of the coolest campaigns I've seen. Super dope work. Love the concepts behind each character

Posted by deocoazelsio1987 on July 21, 2019 at 04:05 AM GMT #

Love your color palette. :D Super!

Posted by pomisandtoutp1988 on July 21, 2019 at 05:11 AM GMT #

This looks awesome ! I like the color composition. Nice overall.

Posted by keytwymanffen1986 on July 21, 2019 at 05:51 AM GMT #

Fanstastic! love the colours!

Posted by crazanniriss1986 on July 21, 2019 at 06:25 AM GMT #

gre@tworldclasa6a5 beautiful, were you inspired by classical oriental art?

Posted by bankzapege1980 on July 21, 2019 at 06:58 AM GMT #

Beautiful and Cool project! @Alex Bernstein Gread job

Posted by stocunfasa1979 on July 21, 2019 at 07:30 AM GMT #

Ur really talented Awesome!! Please go to my page to see what i have :)

Posted by orjacoves1983 on July 21, 2019 at 08:02 AM GMT #

never seen anything like THIS. speechless :)

Posted by vamatbodo1970 on July 21, 2019 at 09:07 AM GMT #

Bold project execution! Beautiful patterns and textures

Posted by gaslekukboa1987 on July 21, 2019 at 09:39 AM GMT #

very well designed creative approach. Love it. Really nice and impulsive work of Art - like it!

Posted by pulchtefsembde1986 on July 21, 2019 at 10:13 AM GMT #

Excellent work!!! I want to know your opinion on my works!!! very nice work and great concept

Posted by wordfunmata1976 on July 21, 2019 at 10:45 AM GMT #

This looks very professional. Amazing! I would love to travel there :)

Posted by soyrearewan1982 on July 21, 2019 at 11:18 AM GMT #

Nice update! Thanks for your entry. Kurt - https://treeserviceashburnva.com | https://treeservicesalexandriava.com/

Posted by Kurt on September 20, 2019 at 02:05 PM GMT #

Post a Comment:
  • HTML Syntax: NOT allowed

Calendar

Search

Hot Blogs (today's hits)

Tag Cloud

Categories

Feeds

Links

Navigation