Apache Samza

Monday March 25, 2019

Announcing the release of Samza 1.1

We are thrilled to announce the release of Apache Samza 1.1.0

Today Samza forms the backbone of hundreds of real-time production applications across a multitude of companies, such as LinkedIn, VMWare, Slack, Redfin among many others. This release of Samza adds a variety of features and capabilities to Samza’s existing arsenal, coupled with improved documentation, code snippets, examples. Samza provides leading support for large-scale stateful stream processing with:

  • First class support for local state (with RocksDB store). This allows a stateful application to scale up to 1.1 Million events/sec on a single machine with SSD.
  • Support for incremental checkpointing of state instead of full snapshots. This enables Samza to scale to applications with very large state.
  • A fully asynchronous programming model that makes parallelizing remote calls efficient and effortless.
  • High level API for expressing complex stream processing pipelines in a few lines of code.
  • Beam Samza Runner that marries Beam’s best in class support for EventTime based windowed processing and sophisticated triggering with Samza’s stable and scalable stateful processing model.
  • A fully pluggable model for input sources (e.g. Kafka, Kinesis, DynamoDB streams etc.) and output systems (HDFS, Kafka, ElastiCache etc.).
  • A Table API that provides a common abstraction for accessing remote or local databases and allowing developers are able to "join" an input event stream with such a Table.
  • Flexible deployment model for running the the applications in any hosting environment and with cluster managers other than YARN.
  • Features like canaries, upgrades and rollbacks that support extremely large deployments with minimal downtime.

New Features, Upgrades and Bug Fixes

The 1.1.0 release brings the following features, upgrades, and capabilities:
  • We have created a new Samza Stream Processing video series on Youtube
  • New and improved documentation, code snippets, and examples for using the latest version of Samza with Apache Beam code samples

API enhancements and simplifications:

  • SAMZA-1981 Consolidate table descriptors to samza-api.
  • SAMZA-1998 Table API refactoring.
  • SAMZA-1980 Rename LocalStoreBackedTable to LocalTable.
  • SAMZA-2043 Consolidate ReadableTable and ReadWriteTable.
  • SAMZA-2012 Add API for wiring an external context through to application processing.
  • SAMZA-2026 Refactor remote table API to separate retry policy settings.
  • SAMZA-2041 Add system descriptors for HDFS and Kinesis.
  • SAMZA-2081 Samza SQL: Type system for Samza SQL.
  • SAMZA-2106 Samza App & Job Config Refactor.

State Store Restoration:

  • SAMZA-2018 State restore improvements using RocksDB writebatch API.

Standalone Improvements:

  • SAMZA-1973 Unify the TaskNameGrouper interface for yarn and standalone.
  • SAMZA-1952 StreamPartitionCountMonitor for standalone.

Other Upgrades and Bug-fixes:

  • SAMZA-1638 Recreate SystemProducer on KafkaCheckpointManager.writeCheckpoint failure.
  • SAMZA-1946 Problem with Race between TimerListener initialization and timers fired from init().
  • SAMZA-2004 Add ability to disable table metrics.
  • SAMZA-2013 Account for cycles in graph traversal within Execution Planner.
  • SAMZA-2015 Refactor timer handling in tables to be consistent with stores.
  • SAMZA-2072 Update guava to 23.0.
  • SAMZA-2090 Fix flush behavior for remote and hybrid tables.
  • SAMZA-2108 Check for host affinity config before resolving preferred host matching.
  • SAMZA-2109 Reduce default-buffer sizes for per-partition queues.
  • SAMZA-2118 Improve the shutdown sequence of AsyncRunLoop.
  • SAMZA-2119 Upgrading yarn-client version to 2.7.1.
  • SAMZA-2122 Fix the task caught-up logic which doesn't handle no incoming messages
The complete list of resolved Jira tickets for this release is found here. This release also includes improvements such as durable state in high-level API, Zookeeper-based deployment stability, and multi-stage batch processing, and bug fixes such as KafkaSystemProducer concurrent sends and flushes.

API Updates

The following imports for Table API have been updated:
  • Rename the import org.apache.samza.storage.kv.descriptors.BaseLocalStoreBackedTableDescriptor to org.apache.samza.storage.kv.descriptors.BaseLocalTableDescriptor
  • Rename the import org.apache.samza.table.remote.descriptors.RemoteTableDescriptor to org.apache.samza.table.descriptors.RemoteTableDescriptor
  • Rename the import org.apache.samza.table.caching.descriptors.CachingTableDescriptor to org.apache.samza.table.descriptors.CachingTableDescriptor

Configurations Updates

The job.name and job.id configs are now deprecated in favor of app.name and app.id configs respectively. A source download of Samza 1.1.0 is available here, and is also available in Apache’s Maven repository. Samza’s download page for details and Samza’s feature preview for new features.

Community Developments

A Stream Processing with Apache Kafka & Apache Samza meetup/symposium that was held on March 20th which had following presentation for Samza:
  • Apache Samza 1.0: Recent Advances and our plans for future in Stream Processing

Contribute

It’s a great time to get involved. You can start by reviewing the tutorials, signing up for the mailing list, and grabbing some newbie JIRAs. I’d like to close by thanking everyone who’s been involved in the project. It’s been a great experience to be involved in this community, and I look forward to its continued growth.

Comments:

Awesome news for apache samza, and this update have fix all issue.

Posted by ankita sharma on April 03, 2019 at 05:32 AM GMT #

Thanks for sharing this quality information with us. I will use your produce

Posted by return man 3 on May 13, 2019 at 01:59 AM GMT #

siapa pula dalot ini? Beli pemain mahal2 kalo cm jadi pelapis kang tono sama aja. Kok transfer2 terakhir ini sm incerannya banyak p3main antah berantah ya. https://fansbarcelona999.blogspot.com/2019/05/barcelona-menjalani-laga-liga-champions.html https://juventusindo.weebly.com/ https://www.storeboard.com/blogs/sports-and-fitness/fans-keren-manchester-united-indonesia/961863 https://fansliverpool.yolasite.com/ https://liverpool999.home.blog/2019/05/01/strategi-klopp-menangani-liverpool/ http://icalshare.com/calendars/8796 https://berandasehat.com/ahli-kunci-karawang/ Macam bango musim2 lalu aja. Sign sm ngeliriknya pemain "fm" semua. Pada delusi pemain murah tapi jago. Pretttt Dan transfer fred, ane si g harep lebih dr pemain ini. Inget kleberson n anderson? Yaabgitulah. Pemain kecil gini apa yg diharap dr skema prakmatis mou

Posted by siaran langsung bola on June 21, 2019 at 07:34 PM GMT #

I am glad to see this brilliant post, all the details are very helpful and useful for us, keep up to good work.

Posted by run 3 on June 25, 2019 at 02:24 AM GMT #

I agree with your opinion .Hope you share many things.

Posted by super fighters 2 on June 26, 2019 at 03:04 AM GMT #

Amazing work + + + Ok now i want some cheese.

Posted by lectsubsupu1975 on July 20, 2019 at 05:47 PM GMT #

solid Thanks @lena weisbek

Posted by thyhealreuchinc1979 on July 20, 2019 at 05:59 PM GMT #

like the type a lot you are well done! very good work

Posted by evanbiewai1987 on July 20, 2019 at 06:30 PM GMT #

Cute style Great concept, well done.

Posted by baupintistblan1984 on July 20, 2019 at 11:49 PM GMT #

Refined and modern in a pure french style. Magnificent ! Really cool concept with the shape!

Posted by boabrookanes1973 on July 21, 2019 at 12:38 AM GMT #

This is awesome! very high tech!

Posted by htentasrami1978 on July 21, 2019 at 01:56 AM GMT #

Those look great! Congratulations. Mad, brilliant and arm-pitt-hair-tastic! Great Job Cobb team!

Posted by dogsdomarew1985 on July 21, 2019 at 03:35 AM GMT #

@瓦社 (wa-she) I wish I knew hànzì or Kanji, you make everything look so beautiful!

Posted by diawordmacra1984 on July 21, 2019 at 05:01 AM GMT #

Parabéns!! What software you used to make these characters and animations?

Posted by tomcomesta1973 on July 21, 2019 at 05:34 AM GMT #

It is fantastic! Good looking hey!

Posted by hyawefiber1975 on July 21, 2019 at 06:14 AM GMT #

Details looks great! big like

Posted by liosovira1989 on July 21, 2019 at 06:47 AM GMT #

These are awesome! So beautifull !

Posted by meysadifru1971 on July 21, 2019 at 07:20 AM GMT #

It's strange when there's nothing happening at this time and place, especially if you don't shoot some beautiful works. love it

Posted by gekgawildle1976 on July 21, 2019 at 07:52 AM GMT #

Very Nice ! Great work @Vlora Berisha paleta metisiane

Posted by diarolpproscor1985 on July 21, 2019 at 08:23 AM GMT #

Образец того, как надо показывать работу над проектом )) Soooo beautiful :)

Posted by hoprelyne1972 on July 21, 2019 at 08:56 AM GMT #

Wow! Such a creative work :) nice .. too good

Posted by osanupsub1984 on July 21, 2019 at 09:28 AM GMT #

You are goddamn right! Nice work superb project! beautiful compositions and lights

Posted by enanunry1989 on July 21, 2019 at 10:02 AM GMT #

Sick!! I love this Great!

Posted by scanrousteren1980 on July 21, 2019 at 10:35 AM GMT #

Awful work. How much do you need to hate everything Ukrainian, so to draw! Cool :)

Posted by tiagreenobes1980 on July 21, 2019 at 11:08 AM GMT #

Post a Comment:
  • HTML Syntax: NOT allowed

Calendar

Search

Hot Blogs (today's hits)

Tag Cloud

Categories

Feeds

Links

Navigation