Apache Samza
Friday January 05, 2018
Announcing the release of Apache Samza 0.14.0
We are very excited to announce the release of Apache Samza 0.14.0
Samza has been powering real-time applications in production across several large companies (including LinkedIn, Netflix, Uber, Slack, Redfin, TripAdvisor, etc) for years now. Samza provides leading support for large-scale stateful stream processing with:
- First class support for local state (with RocksDB store). This allows a stateful application to scale up to 1.1 Million events/sec on a single machine with SSD.
- Support for incremental checkpointing of state instead of full snapshots. This enables Samza to scale to applications with very large state.
- A fully pluggable model for input sources (e.g. Kafka, Kinesis, DynamoDB streams etc.) and output systems (HDFS, Kafka, ElastiCache etc.).
- A fully asynchronous programming model that makes parallelizing remote calls efficient and effortless.
- High level API for expressing complex stream processing pipelines in a few lines of code.
- Flexible deployment model for running the the applications in any hosting environment and with cluster managers other than YARN.
- Features like canaries, upgrades and rollbacks that support extremely large deployments with minimal downtime.
New Features, Upgrades and Bug Fixes
The 0.14.0 release contains the following highly anticipated features:- Samza SQL
- Azure EventHubs producer, consumer and checkpoint provider
- AWS Kinesis consumer
Overall, 65 JIRAs were resolved in this release. For more details about this release, please check out the release notes.
Community Developments
We’ve made great community progress since the last release (0.13.1). We presented the unified data processing with Samza at the 2017 Big Data conference held in Spain and the Dataworks Summit in Sydney, and held a demo at @scale conference in San Jose. Here are the details to these conferences.- Nov 17, 2017 - Unified Stream Processing at Scale with Apache Samza (BigDataSpain 2017) (Slides)
- Sept 21, 2017 - Unified Batch & Stream Processing with Apache Samza (Dataworks Summit Sydney 2017) (Slides)
- Aug 31, 2017 - Demo of Stream Processing@LinkedIn (@scale conference 2017) (Slides)
Contribute
It’s a great time to get involved. You can start by reviewing the tutorials, signing up for the mailing list, and grabbing some newbie JIRAs.I’d like to close by thanking everyone who’s been involved in the project. It’s been a great experience to be involved in this community, and I look forward to its continued growth.
Posted at 05:38PM Jan 05, 2018
by xinyu in General |
Comments [30]
|
Posted by history bing delete on June 20, 2018 at 04:38 PM GMT #
Posted by Sewing Blogs on August 26, 2018 at 11:49 PM GMT #
Posted by Write my coursework online on January 02, 2019 at 12:18 PM GMT #
Posted by Sewing Machine Blog on February 04, 2019 at 06:13 AM GMT #
Posted by Mayra Kufman on February 04, 2019 at 12:30 PM GMT #
Posted by Mahi on March 04, 2019 at 02:42 PM GMT #
Posted by pec result of 8th class 2019 on March 30, 2019 at 12:41 PM GMT #
Posted by Mark Denial on May 29, 2019 at 11:23 AM GMT #
Posted by streaming langsung bola online on May 29, 2019 at 05:09 PM GMT #
Posted by asytcoabril1982 on July 20, 2019 at 04:46 PM GMT #
Posted by dunetmeboc1981 on July 20, 2019 at 05:29 PM GMT #
Posted by tikatecwork1984 on July 20, 2019 at 06:23 PM GMT #
Posted by prosusorog1982 on July 20, 2019 at 07:24 PM GMT #
Posted by trepedilstit1974 on July 20, 2019 at 11:28 PM GMT #
Posted by pochogunlo1975 on July 21, 2019 at 12:18 AM GMT #
Posted by lurycaredf1974 on July 21, 2019 at 01:15 AM GMT #
Posted by hampfunckahep1979 on July 21, 2019 at 02:55 AM GMT #
Posted by isidinhy1983 on July 21, 2019 at 04:48 AM GMT #
Posted by chafilbeaukhor1973 on July 21, 2019 at 05:20 AM GMT #
Posted by provgasabo1982 on July 21, 2019 at 06:01 AM GMT #
Posted by gemabame1978 on July 21, 2019 at 06:34 AM GMT #
Posted by deasbdrivjetce1981 on July 21, 2019 at 07:07 AM GMT #
Posted by wupdyconva1977 on July 21, 2019 at 07:39 AM GMT #
Posted by blowherwilbe1986 on July 21, 2019 at 08:11 AM GMT #
Posted by lighnoncfillcomp1982 on July 21, 2019 at 08:43 AM GMT #
Posted by cawatattni1989 on July 21, 2019 at 09:16 AM GMT #
Posted by petccagipa1979 on July 21, 2019 at 09:49 AM GMT #
Posted by spenextefind1981 on July 21, 2019 at 10:22 AM GMT #
Posted by quereltheme1975 on July 21, 2019 at 10:54 AM GMT #
Posted by factocert on August 12, 2019 at 06:42 AM GMT #