The Apache Software Foundation Blog

Friday February 24, 2017

The Apache News Round-up: week ending 24 February 2017

It's the last Friday in February, and we've had another smashing week:

ASF Board –management and oversight of the business and affairs of the corporation in accordance with the Foundation's bylaws.
 - Next Board Meeting: rescheduled to 27 February 2017. Board calendar and minutes available at http://apache.org/foundation/board/calendar.html

Community over Code --we have passed the 6,000 Apache Committer mark! https://projects.apache.org/timelines.html

Apache Incubator --the hub of innovation for projects and communities intending to become fully-fledged projects under the auspices of the ASF.
 - Welcome new podlings --http://incubator.apache.org/
   - Gobblin: a distributed data integration framework that simplifies common aspects of Big Data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.
   - MXNet: a Flexible and Efficient Library for deep learning.
   - Ratis: a Java implementation for RAFT consensus protocol.
 - Community Voting now underway for new Incubator logo http://incubator.apache.org/2017-logo-contest.html

ASF Infrastructure –our distributed team on four continents keeps the ASF's infrastructure running around the clock.
 - 7M+ weekly checks yield solid performance at 99.85% uptime http://status.apache.org/

ApacheCon™ –Tomorrow's Technology Today. https://s.apache.org/F7Hy
 - North America/MIA overview: 15 May - BarCamp Apache | 16-18 May - ApacheCon Core (DevOps, Servers, Web Frameworks, etc.) + Apache: Big Data, CloudStack Collaboration Conference, FlexJS Summit, Apache: IoT, TomcatCon, and more http://apachecon.com/
 - Travel Assistance applications close 8 March https://www.apache.org/travel/
 - Early registration and hotel incentives end 12 March http://events.linuxfoundation.org/events/apachecon-north-america | Apache Committers: register using your apache.org email + discount code to save even more.
 - Recordings from ApacheCon Europe 2016 are being uploaded at Feathercast http://feathercast.org

Apache Attic –provides process and solutions to make it clear when an Apache project has reached its end of life.
 - Apache Stratos retired http://mail-archives.apache.org/mod_mbox/www-announce/201702.mbox/%3CCALGG8z3ZAD6jO%3D_X5atr0E5DPbPYeSgZh8pG3u_Kcae4oPv%2Bmw%40mail.gmail.com%3E

Apache Arrow™ –a columnar in-memory analytics layer designed to accelerate Big Data.
 - Apache Arrow 0.2.0 released https://dist.apache.org/repos/dist/release/arrow/

Apache Bahir™ –extensions to distributed analytic platforms such as Apache Spark.
 - Apache Bahir 2.1.0 released http://bahir.apache.org

Apache Commons™ Validator –provides the building blocks for both client side validation and server side data validation.
 - Apache Commons Validator 1.6 released http://commons.apache.org/proper/commons-validator/download_validator.cgi

Apache Jackrabbit™ –a fully compliant implementation of the Content Repository for Java Technology API, version 2.0 (JCR 2.0) as specified in the Java Specification Request 283 (JSR 283).
 - Apache Jackrabbit 2.8.5 released http://jackrabbit.apache.org/downloads.html

Apache Kafka™ –a distributed, fault tolerant, publish-subscribe messaging.
 - Apache Kafka 0.10.2.0 released https://www.apache.org/dyn/closer.cgi?path=/kafka/0.10.2.0/kafka-0.10.2.0-src.tgz

Apache Lucene™ Solr –the popular, blazing-fast, open source enterprise search platform built on Apache Lucene.
 - Apache Solr Reference Guide for Solr 6.4 released https://dist.apache.org/repos/dist/release/lucene/solr/ref-guide/apache-solr-ref-guide-6.4.pdf

Apache Mynewt (incubating) –a community-driven module OS for constrained, embedded applications.
 - Apache Mynewt 1.0.0-b2-incubating released http://www.apache.org/dyn/closer.lua/incubator/mynewt/apache-mynewt-1.0.0-b2-incubating

Apache RocketMQ (incubating) –a fast, low latency, reliable, scalable, distributed, easy to use message-oriented middleware, especially for processing large amounts of streaming data.
 - Apache RocketMQ 4.0.0 incubating released https://www.apache.org/dyn/closer.cgi?path=incubator/rocketmq/4.0.0-incubating


Did You Know?

 - Did you know that over the past week 7% of all Apache code contributions were made by someone new to the ASF? http://community.apache.org/

 - Did you know that British Gas Connected Home manages its IoT data using Apache Cassandra, Kafka, and Spark? http://cassandra.apache.org/http://kafka.apache.org/http://spark.apache.org

 - Did you know that we'd love to hear how you #LoveApache? Feedback welcome! https://twitter.com/TheASF/status/831134005105979396


Apache Community Notices:

 - "Success at Apache" is a new monthly blog series that focuses on the processes behind why the ASF "just works". 1) Project Independence https://s.apache.org/CE0V 2) All Carrot and No Stick https://s.apache.org/ykoG 3) Asynchronous Decision Making https://s.apache.org/PMvk

 - Feedback from The Apache Software Foundation on the Free and Open Source Security Audit (FOSSA) https://s.apache.org/romf

 - ASF Operations Summary - Q2 FY2017 https://s.apache.org/oTOF

 - The list of Apache project-related MeetUps can be found at http://apache.org/events/meetups.html

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - ApacheCon North America + Apache: BigData, CloudStack Collaboration Conferenxe, FlexJS Summit, Apache: IoT, and TomcatCon will be held 16-18 May 2017 in Miami http://apachecon.com/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

 - Show your support for Apache with ASF-approved swag from http://www.zazzle.com/featherwear and http://s.apache.org/landsend --all proceeds benefit the ASF! 

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Friday February 17, 2017

The Apache News Round-up: week ending 17 February 2017

We've had another cracking week at the ASF. Let's take a peek at what happened:

ASF Board –management and oversight of the business and affairs of the corporation in accordance with the Foundation's bylaws.
 - Next Board Meeting: rescheduled to 27 February 2017. Board calendar and minutes available at http://apache.org/foundation/board/calendar.html

Community over Code --we have just passed the 6,000 Apache Committer mark! https://projects.apache.org/timelines.html

ASF Infrastructure –our distributed team on four continents keeps the ASF's infrastructure running around the clock.
 - 7M+ weekly checks yield "three nines" performance at 99.96% uptime http://status.apache.org/

ApacheCon™ –Tomorrow's Technology Today. https://s.apache.org/F7Hy
 - Travel Assistance applications close 8 March https://www.apache.org/travel/
 - Early registration and hotel incentives end 12 March http://events.linuxfoundation.org/events/apachecon-north-america
 - NEW: BarCamp Apache will be held on 15 May --be sure to plan your travels accordingly!
 - Apache Committers: remember to register using your apache.org address + discount code to save even more!
 - Recordings from ApacheCon Europe 2016 are being uploaded at Feathercast http://feathercast.org

Apache Geode™ –a data management platform that provides a database-like consistency model, reliable transaction processing and a shared-nothing architecture to maintain very low latency performance with high concurrency processing.
 - Apache Geode 1.1.0 released http://geode.apache.org/releases/

Apache Jena™ –an Open Source Java-based framework for building Semantic Web and Linked Data applications.
 - Apache Jena 3.2.0 released with Fuseki 2.5.0 http://jena.apache.org/download/

Apache Lucene™ –a high-performance, full-featured text search engine library written entirely in Java.
 - Apache Lucene 5.5.4 released http://www.apache.org/dyn/closer.lua/lucene/java/5.5.4
 - Apache Solr 5.5.4 released http://www.apache.org/dyn/closer.lua/lucene/solr/5.5.4
 - CVE-2017-3163 Apache Solr ReplicationHandler path traversal attack http://mail-archives.apache.org/mod_mbox/www-announce/201702.mbox/%3C73692BD4-E68A-48AC-895D-4A84B3EA4EF6%40apache.org%3E

Apache MyFaces™ Tobago –standards-based Open Source components library allows developers to quickly and easily create business Web applications without worrying about technical details.
 - The Apache Software Foundation Announces Apache® MyFaces™ Tobago 3 https://s.apache.org/2rTG

Apache OpenMeetings™ –provides video conferencing, instant messaging, white board, collaborative document editing and other groupware tools using API functions of the Red5 Streaming Server for Remoting and Streaming.
 - Apache OpenMeetings 3.2.0 released http://openmeetings.apache.org/downloads.html

Apache SINGA (incubating) –a general distributed deep learning platform for training big deep learning models over large datasets.
 - Apache SINGA 1.1.0 released http://singa.apache.org/en/downloads.html

Apache Storm™ –a distributed, fault-tolerant, and high-performance realtime computation system that provides strong guarantees on the processing of data.
 - Apache Storm 1.0.3 released http://storm.apache.org/downloads.html

Apache Traffic Server™ –a high-performance Web proxy cache that improves network efficiency and performance by caching frequently-accessed information at the edge of the network.
 - Apache Traffic Server 6.2.1 released http://trafficserver.apache.org/downloads


Did You Know?

 - Did you know that over the past 5 days there were 119,591 downloads of #Apache source distributions from 173 countries? 

 - Did you know that standalone tracks taking place alongside ApacheCon include Apache: Big Data, Flex Project Summit, TomcatCon, Apache: IoT, and CloudStack Collaboration Conference? Join us! http://apachecon.com/

 - Did you know that we've launched a new #LoveApache campaign on Twitter? Feedback welcome from individuals, projects, and organizations https://twitter.com/TheASF/status/831134005105979396


Apache Community Notices:

 - "Success at Apache" is a new monthly blog series that focuses on the processes behind why the ASF "just works". 1) Project Independence https://s.apache.org/CE0V 2) All Carrot and No Stick https://s.apache.org/ykoG 3) Asynchronous Decision Making https://s.apache.org/PMvk

 - Feedback from The Apache Software Foundation on the Free and Open Source Security Audit (FOSSA) https://s.apache.org/romf

 - ASF Operations Summary - Q2 FY2017 https://s.apache.org/oTOF

 - The list of Apache project-related MeetUps can be found at http://apache.org/events/meetups.html

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - ApacheCon North America + Apache: BigData, CloudStack Collaboration Conferenxe, FlexJS Summit, Apache: IoT, and TomcatCon will be held 16-18 May 2017 in Miami http://apachecon.com/

- Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

 - Show your support for Apache with ASF-approved swag from http://www.zazzle.com/featherwear and http://s.apache.org/landsend --all proceeds benefit the ASF! 

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Tuesday February 14, 2017

The Apache Software Foundation Announces Apache® MyFaces™ Tobago 3

Standards-based Open Source components library allows developers to quickly and easily create business Web applications without worrying about technical details 

Forest Hill, MD —14 February 2017— The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today the availability of Apache® MyFaces™ Tobago 3, the user interface components for creating business applications without the need for coding HTML, CSS, or JavaScript.

A sub-project of Apache MyFaces (the Open Source implementation of JavaServer Faces Web application framework that accomplishes the Model-View-Controller paradigm), Tobago is a component library for JavaServer Faces (JSF). The project was originally created at Atanion GmbH in 2002, and was donated to the Apache Incubator in 2005. Tobago graduated as Apache MyFaces sub-project in 2006.

"With a commitment to reduce the time and effort spent on development and deployment, the unofficial Tobago tagline is 'less magic, more standards'," said Udo Schnurpfeil, member of the Apache MyFaces Project Management Committee. "We are are happy that Tobago 3 helps users get their applications up and running even more quickly and easily."

By omitting the need to code HTML, CSS, or JavaScript, Tobago allows users to easily create business Web applications, and emulates the development process of conventional user interfaces (rather than the creation of Web pages) via:
  1. UI components abstracted from HTML, along with any layout information that does not belong to the general page structure. The final output format is determined by the client/user-agent;

  2. A theming mechanism that makes it easy to change the look-and-feel and provides special implementations for certain browsers; and

  3. A layout manager used to arrange the components automatically. This means that no manual laying out using HTML tables or other constructs is needed.

Under The Hood
Apache MyFaces Tobago 3's increased responsiveness and standardization makes it easier to integrate libraries and other projects. Features include:
  • Layout-management moved to CSS and JavaScript to natively achieve layout requirements and make rendering more efficient and responsive;

  • Themes using CSS library Bootstrap 4 make it easy to obtain a modern and rich design; and

  • Use of current technologies such as SCSS, CSS3, HTML5, AJAX, JSF and, Theming on pure CSS base further simplifies the development experience.

Apache Tobago dramatically reduces developer resources and programming time, providing individuals and organizations with improved productivity and ease of implementation.

"For over 10 years we have been working closely with the Tobago team. The close collaboration has been mutually beneficial. Currently we are working on more than 60 intranet applications based on Apache Tobago. We see the new features from Tobago 3 as a significant architectural leap - in particular the innovations with ajax, theming, and responsive design. We expect a fast project adoption - even with the associated migration costs," said Rainer Rohloff, Senior Software Architect at Norddeutsche Landesbank. "We look forward to working on additional projects with the Tobago team in the future."

"It's great to see many users adopt Tobago," added Schnurpfeil. "We welcome new developers and users to join us on our mailing lists, MeetUps, and community events."

Availability and Oversight
Apache MyFaces software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For downloads, release notes, documentation, and more information on Apache MyFaces, visit http://myfaces.apache.org/ and https://twitter.com/MyFacesTeam

About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server --the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 620 individual Members and 5,900 Committers successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official user conference, trainings, and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Alibaba Cloud Computing, ARM, Bloomberg, Budget Direct, Capital One, Cerner, Cloudera, Comcast, Confluent, Facebook, Google, Hortonworks, HP, Huawei, IBM, InMotion Hosting, iSigma, LeaseWeb, Microsoft, OPDi, PhoenixNAP, Pivotal, Private Internet Access, Produban, Red Hat, Serenata Flowers, WANdisco, and Yahoo. For more information, visit http://www.apache.org/ and https://twitter.com/TheASF

© The Apache Software Foundation. "Apache", "MyFaces", "Apache MyFaces", "Tobago", "Apache MyFaces Tobago", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #

Friday February 10, 2017

The Apache News Round-up: week ending 10 February 2017

It's Friday, and here's what has happened with the Apache community this past week:

ASF Board –management and oversight of the business and affairs of the corporation in accordance with the Foundation's bylaws.
 - Next Board Meeting: 15 February 2017. Board calendar and minutes available at http://apache.org/foundation/board/calendar.html

Success at Apache –our third installment in the new monthly blog series that focuses on the processes behind why the ASF "just works".
 - Asynchronous Decision Making by Bertrand Delacretaz https://s.apache.org/PMvk

ASF Infrastructure –our distributed team on four continents keeps the ASF's infrastructure running around the clock.
 - 7M+ weekly checks yield bouncy performance at 99.66% uptime http://status.apache.org/

ApacheCon™ –Tomorrow's Technology Today. https://s.apache.org/F7Hy
 - DEADLINES:
   - CFPs for all events --ApacheCon core, Apache: Big Data, Apache: IoT, CloudStack Collaboration Conference, Flex JS Summit, TomcatCon and more close 11 February https://blogs.apache.org/conferences/entry/final-notice-cfp-for-apachecon
   - Travel Assistance applications close 8 March https://www.apache.org/travel/
   - Early registration and hotel incentives end 12 March http://events.linuxfoundation.org/events/apachecon-north-america
   - Apache Committers: remember to register using your apache.org address + discount code to save even more!
 - Recordings from ApacheCon Europe 2016 are being uploaded at Feathercast http://feathercast.org

New logos/marks wanted –with the launch of the ASF's new visual identity last year, many Apache projects have been freshening up their looks. Calls are open for:
 - Apache Incubator https://s.apache.org/rFii and Apache OpenNLP https://issues.apache.org/jira/browse/OPENNLP-6

Apache Ant™ –a Java library and command-line tool that helps building software.
 - Apache Ant 1.9.9 and 1.10.1 released http://ant.apache.org/bindownload.cgi

Apache Beam™ –a unified programming model for both batch and streaming data processing, enabling efficient execution across diverse distributed execution engines and providing extensibility points for connecting to different technologies and user communities.
 - Apache Beam 0.5.0 released https://beam.apache.org/get-started/downloads/

Apache Commons™ Configuration –software library that provides a generic configuration interface which enables a Java application to read configuration data from a variety of sources.
 - Apache Commons Configuration 2.1.1 released http://commons.apache.org/proper/commons-configuration/download_text.cgi

Apache Commons™ JCS –a distributed, versatile caching system.
 - Apache Commons JCS 2.1 released https://commons.apache.org/proper/commons-jcs/download_jcs.cgi

Apache Jackrabbit™ –a fully compliant implementation of the Content Repository for Java(TM) Technology API, version 2.0 (JCR 2.0) as specified in the Java Specification Request 283 (JSR 283).
 - Apache Jackrabbit 2.6.8 and Jackrabbit Oak 1.4.13 released http://jackrabbit.apache.org/downloads.html

Apache Lucene™ –a high-performance, full-featured text search engine library written entirely in Java.
 - Apache Lucene 6.4.1 released http://www.apache.org/dyn/closer.lua/lucene/java/6.4.1
 - Apache Solr 6.4.1 released http://lucene.apache.org/solr/mirrors-solr-latest-redir.html

Apache MyFaces™ Core –a JavaServer Faces 2.2 implementation as specified by JSR-344.
 - Apache MyFaces Core v2.2.12 released http://myfaces.apache.org/download.html

Apache OpenNLP™ –a machine learning based toolkit for the processing of natural language text.
 - Apache OpenNLP 1.7.2 released http://opennlp.apache.org/cgi-bin/download.cgi

Apache Qpid™ Proton –a messaging library for the Advanced Message Queuing Protocol 1.0 (AMQP 1.0, ISO/IEC 19464).
 - Apache Qpid Proton 0.17.0 and Qpid Proton-J 0.17.0 released http://qpid.apache.org/download.html

Apache Ranger™ –Big Data security management framework for the Apache Hadoop ecosystem in use at ING, Protegrity, and Sprint, among other organizations.
 - The Apache Software Foundation Announces Apache® Ranger™ as a Top-Level Project https://s.apache.org/23CB

Apache Struts™ –an elegant, extensible framework for creating enterprise-ready Java Web applications.
 - Apache Struts 2.5.10 GA released http://struts.apache.org/download.html#struts-ga

Apache Tomcat™ –the Open Source software implementation of the Java Servlet, JavaServer Pages, Java Unified Expression Language, Java WebSocket and Java Authentication Service Provider Interface for Containers technologies.
 - Apache Tomcat 8.5.11 http://tomcat.apache.org/download-80.cgi

Apache Zeppelin™ –a collaborative data analytics and visualization tool for distributed, general-purpose data processing system such as Apache Spark, Apache Flink, etc.
 - Apache Zeppelin 0.7.0 released http://zeppelin.apache.org/download.html


Did You Know?

 - Did you know that the new ASF logo, launched one year ago, along with the new Apache feather and "Powered By" graphics are available for all to use? http://apache.org/foundation/press/kit/

 - Did you know that standalone tracks taking place alongside ApacheCon include Apache: Big Data, Flex Project Summit, TomcatCon, Apache: IoT, and CloudStack Collaboration Conference? Join us! http://apachecon.com/

 - Did you know that the India Goa Directorate of Agriculture uses Apache Wicket? http://wicket.apache.org/


Apache Community Notices:

 - "Success at Apache" is a new monthly blog series that focuses on the processes behind why the ASF "just works". 1) Project Independence https://s.apache.org/CE0V 2) All Carrot and No Stick https://s.apache.org/ykoG 3) Asynchronous Decision Making https://s.apache.org/PMvk

 - Feedback from The Apache Software Foundation on the Free and Open Source Security Audit (FOSSA) https://s.apache.org/romf

 - ASF Operations Summary - Q2 FY2017 https://s.apache.org/oTOF

 - The list of Apache project-related MeetUps can be found at http://apache.org/events/meetups.html

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - ApacheCon North America and Apache:BigData will be held 16-18 May 2017 in Miami http://apachecon.com/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

 - Show your support for Apache with ASF-approved swag from http://www.zazzle.com/featherwearand http://s.apache.org/landsend--all proceeds benefit the ASF! 

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Wednesday February 08, 2017

The Apache Software Foundation Announces Apache® Ranger™ as a Top-Level Project

Big Data security management framework for the Apache Hadoop ecosystem in use at ING, Protegrity, and Sprint, among other organizations.

Forest Hill, MD —8 February 2017— The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today that Apache® Ranger™ has graduated from the Apache Incubator to become a Top-Level Project (TLP), signifying that the project's community and products have been well-governed under the ASF's meritocratic process and principles.

The latest addition to the ASF’s more than three dozen projects in Big Data, Apache Ranger is a centralized framework used to define, administer and manage security policies consistently across Apache Hadoop components. Ranger also offers the most comprehensive security coverage, with native support for numerous Apache projects, including Atlas (incubating), HBase, HDFS, Hive, Kafka, Knox, NiFi, Solr, Storm, and YARN. 

"Graduating to a Top-Level Project reflects the maturity and growth of the Ranger Community," said Selvamohan Neethiraj, Vice President of Apache Ranger. "We are pleased to celebrate a great milestone and officially play an integral role in the Apache Big Data ecosystem."

Apache Ranger provides a simple and effective way to set access control policies and audit the data access across the entire Hadoop stack by following industry best practices. One of the key benefits of Ranger is that access control policies can be managed by security administrators from a single place and consistently across hadoop ecosystem. Ranger also enables the community to add new systems for authorization even outside Hadoop ecosystem, with a robust plugin architecture, that can be extended with minimal effort. In addition, Apache Ranger provides many advanced features, such as:
  • Ranger Key Management Service (compatible with Hadoop’s native KMS API to store and manage encryption keys for HDFS Transparent Data Encryption);
  • Dynamic column masking and row filtering;
  • Dynamic policy conditions (such as prohibition of toxic joins);
  • User context enrichers (such as geo-location and time of day mappings); and
  • Classification or tag based policies for Hadoop ecosystem components via integration with Apache Atlas.

"As early adopters of Apache Ranger and having contributed to Apache Ranger, we have come to rely upon Apache Ranger as a key part of our security infrastructure for data," said Ferd Scheepers, Chief Information Architect at ING. "We are therefore pleased to learn that the project has now graduated to a TLP project through the efforts of the Apache community. We believe that Apache Ranger represents the best-in-class Open Source security framework for authorization, encryption management, and auditing across Hadoop ecosystem. We laud the community's efforts in building an extensible and enterprise grade architecture for Apache Ranger, and for innovative features such as tag or classification based security (built in conjunction with Apache Atlas). We congratulate the Apache Ranger community on achieving this significant milestone and are confident Apache Ranger will evolve into the de-facto standard for security stack across the Hadoop ecosystem."

"As heavy users of Apache Ranger in production, we are pleased to see the project become a TLP through validation across community efforts," said Timothy R. Connor, Big Data & Advanced Analytics Manager at Sprint. "Apache Ranger has built a next generation ABAC model for authorization along with a robust data-centric Open Source security framework supporting advanced security capabilities such as dynamic row filtering and column masking. All of these point to Apache Ranger maturing into a robust and comprehensive security product for authorization, encryption management and auditing through the Apache community."

"It's great to see Apache Ranger become a TLP," said Dominic Sartorio, Senior Vice President of Products & Development at Protegrity. "Apache Ranger's comprehensive auditing and broad authorization coverage across the Hadoop ecosystem, along with its highly scalable and extensible architecture and rich set of APIs, integrates very well with Protegrity's fine grained data protection capabilities. Our continued collaboration with the Apache Ranger community will help meet the data security requirements of the next generation of enterprise-grade production Hadoop deployments."

"As organizations entrust their enterprise data to Open Source data platforms such as Apache Hadoop, there is a critical need to use the most innovative techniques to safeguard this data," said Alan Gates, Co-Founder of HortonWorks and Apache Ranger incubation mentor. "Apache Ranger community has taken the original, proprietary code base and used it to build a new and successful Apache project that employs an attribute-based approach to define and enforce authorization policies. This modern approach is a combination of subject, action, resource, and environment and goes beyond role-based access control techniques exclusively based on organizational roles - permissions mapping. It has been a pleasure to be their mentor in this process and help them learn the Apache way."

"More and more users are adopting Apache Ranger to secure data in the Hadoop ecosystem," added Neethiraj. "We look forward to welcoming new Ranger users to our mailing lists and community events."

Availability and Oversight
Apache Ranger software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For project updates, downloads, documentation, and ways to become involved with Apache Ranger, visit https://ranger.apache.org/ and @ApacheRanger.

About the Apache Incubator
The Apache Incubator is the entry path for projects and codebases wishing to become part of the efforts at The Apache Software Foundation. All code donations from external organizations and existing external projects wishing to join the ASF enter through the Incubator to: 1) ensure all donations are in accordance with the ASF legal standards; and 2) develop new communities that adhere to our guiding principles. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF. For more information, visit http://incubator.apache.org/

About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server --the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 620 individual Members and 5,900 Committers successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official user conference, trainings, and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Alibaba Cloud Computing, ARM, Bloomberg, Budget Direct, Capital One, Cash Store, Cerner, Cloudera, Comcast, Confluent, Facebook, Google, Hortonworks, HP, Huawei, IBM, InMotion Hosting, iSigma, LeaseWeb, Microsoft, OPDi, PhoenixNAP, Pivotal, Private Internet Access, Produban, Red Hat, Serenata Flowers, Target, WANdisco, and Yahoo. For more information, visit http://www.apache.org/ and https://twitter.com/TheASF

© The Apache Software Foundation. "Apache", "Ranger", "Apache Ranger", "HBase", "Apache HBase", "HDFS", "Apache HDFS", "Hive", "Apache Hive", "Kafka", "Apache Kafka", "Knox", "Apache Knox", "NiFi", "Apache NiFi", "Solr", "Apache Solr", "Storm", "Apache Storm", "YARN", "Apache YARN", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #


Monday February 06, 2017

Success at Apache: Asynchronous Decision Making

by Bertrand Delacretaz

Asynchronous decision making is a key enabler of our geographically and culturally distributed Open source teams. In this post I'll explain the ingredients that make it work at the ASF.

I became active in the ASF in 2001 via Gianugo Rabellino - he was the one who started the discussions with Apache Fop about me donating the jfor XLS-FO to RTF converter that I had developed earlier. It was already too late to uninvent RTF which is a terrible format, but I digress. I am currently a member of the Board of Directors of the ASF and have been doing a lot of thinking (and presentations) about what makes the ASF tick in terms of collaboration and Shared Neurons.

If synchronous decision-making meetings were required in ASF projects, even using remote channels like IRC or videoconference, we would move forward at a snail-like pace, as just finding a time where all stakeholders are available is almost impossible in an environment that has no managers and no central schedule.

Meetings are also very expensive when you are working on a maker's schedule, as described by Paul Graham [1]. Frequent meetings ruin the productivity of craftsmen, and there's lots of craftmanship in our industry, especially when you're building leading edge stuff.

So, what's needed to enable people to make collective decisions asynchronously, without requiring meetings?

The first thing you need is a central asynchronous communications channel. Which technology you use for that doesn't really matter, but it has to allow everybody to get the same information, and provide a usable way of having threaded discussions, where you can branch off on a topic while ignoring other topics being discussed on the same channel. This can be as simple as a whiteboard if people often visit the same place, or as elaborate as web-based forums, accessible from any mobile device so you can bother^H^H^H^H^H reach people everywhere. At the ASF we use plain mailing lists for that, very successfully when people use them with the right discipline (see the appendix below). Archiving this channel is very useful, to allow newcomers to get a feel for how things work as well as documenting the reasoning that led to each decision and avoid having to repeat things over and over.

The second required tool is a way to build consensus, where you avoid deadlocks and make sure decisions go forward. Unanimity in decisions is ideal of course, but the second best is consensus, defined as widespread agreement among people who have decision power. Requiring unanimity or allowing vetoes in decisions can block progress, so at the ASF vetoes only apply to a very limited set of decisions types, as defined by our voting rules [4]. In companies, decision power can be based on hierarchy to break deadlocks. That has to happen sometimes, but abusing it can cause employees to lose their autonomy and purpose, which kills your team in the long term.

To keep track of each decision, a case management system is ideal. You could work without that, depending on your team's size and the number of decisions that you take, but it's very convenient to be able to discuss the details of a given decision and keep associated information in a single place. You don't need complex software for that, at the ASF we use fairly simple issue trackers. Those are Web-based systems where each case is handled on a single page, with a history of comments and actions. Some non-urgent or very hard decisions can take a long time to reach closure, and it's very useful to keep their history in a single place, if only to avoid having to explain them again to new members of the team. In a low tech environment you could just use a single sheet of paper to briefly document each decision with the key points that led to it, and keep those in binders or physical files.

A nice side effect of using case management software is that each decision gets a simple unique identifier, like FOO-123 for the 123th ticket of the FOO project. This removes any ambiguity as to which issue one's discussing, by mentioning those identifiers in conversations.

So, in summary, the following should allow your group to make decisions asynchronously, without requiring meeting and with a written trace of everything that happens:

  • An archived asynchronous communications channel, where everybody can get the same information and threaded discussions can take place.
  • A way of building consensus, including fair rules for breaking deadlocks.
  • If possible, a case management system to keep track of each decision's details, in a much cleaner way than the often messy discussions that happen on the asynchronous channel. 

Semi-asynchronous decision making at the ASF

I've been a member of the ASF's Board of Directors for a few terms now and I'm still impressed by how efficient our monthly phone conferences are. The meeting regularly lasts only 60 to 90 minutes, during which we approve around 50 project reports, vote on a few resolutions and often address a few discussion items.

Besides a few simple things like good phone discipline and a side channel for less important comments (and jokes), the main reason this meeting is so efficient is that almost everything is decided in advance.

Board members are expected to read the project reports before the meeting, and a dead simple case management system (described below) helps discuss issues in advance, and find out which reports require a more extensive discussion.

Assuming the majority of board members have read the reports in advance, and flagged them as ok or requiring discussion, we don't need any housekeeping time during the meeting. Everybody shows up with a clear view of where difficult discussions might arise, so they have time to prepare for that, including asking others for clarification before the meeting so we can resolve any outstanding issues without delay.

The case management system that we use for this is extremely simple, but in terms of enabling asynchronous (or rather semi-asynchronous) decision making it fullfills its role. Our meeting agenda consists of a single text file in our source control system, with a simple structure that provides for a small discussion space for each report that we have to approve and each resolution that we need to vote on.

The agenda file structure looks roughly like this:

Call to order
Roll call
Officer reports
Project reports, headers and discussion space
Board Resolutions with discussion space
Appendix: Full Project reports and other supporting material

And a project report header and discussion space is as simple as this:

E. Apache Blazinator Project [Bob Blazer / Bertrand]
  See Attachment E
  [ Blazinator.
    approved: bd, mm, dd, db, jc, ldv
    comments:
      bd:  Not sure why LEGAL-123 blocks their release
      ldv: They are waiting for the committer to supply
           an updated iCLA as the received one was 
           incomplete.
      bd:  Ok, thanks, approving the report then.
    ]

This simple block of structured text builds a very simple "case management system" for the case of approving the Blazinator report.

The "approved" line indicates which board members have approved the report, on a single line so that simple text-based tools can validate and count the approvals.

The "comments" section allows stakeholders to comment on the report (which is found in an appendix later in the text file), and reply to each other's comments to hopefully reach closure before the meeting. If this happens, approving this report takes almost no time in the meeting, the chairman can just list the project names ("case identifiers" according to the above terminology) of such pre-approved reports, asking if anybody's opposed to approving them.

Combined with the ASF board's mailing list, this builds a very simple and very efficient system for semi-asynchronous decision making. Most decisions are taken before the meeting, and the participants can spend their time where it actually adds value as opposed to exchanging boring status information during the meeting.

Try it yourself!

Many ASF and other Open Source projects release world-changing software while having no or very few meetings, demonstrating that these techniques work.

If you're bogged down with inefficient or useless meetings, I suggest that you try applying these principles to a meaningful subset of your decision making activities. People will need to hone their skills to work efficiently in this way, but the rewards can be huge for distributed teams.

Appendix: Mailing lists at the ASF

At the ASF we use mailing lists as our central asynchronous communications channel, based on our if it didn't happen on the dev mailing list, it didn't happen rule [2]. Mailing lists might be seen as tools of the past when you compare them with the latest shiny tools, but they remain a ubiquitous way of communicating in loosely coupled remote groups, especially when used with a strong discipline of Precise Quoting [3] and paying attention to meaningful subject lines. Unfortunately I hear some "modern" email clients make a mess of that quoting - just stay away from them.

References

[1] http://www.paulgraham.com/makersschedule.html - Paul Graham, Maker's Schedule, Manager's Schedule, July 2009

[2] https://community.apache.org/apache-way/apache-project-maturity-model.html - The Apache Project Maturity Model, ASF community development team, 2015.

[3] http://s.apache.org/gianugo_quoting_2002 - Gianugo Rabellino "[OT/Rant] Quoting", message to the cocoon-dev mailing list, January 2002

[4] http://www.apache.org/foundation/voting.html - ASF voting rules, created in 1999 probably, or even earlier among the Apache Group.

 # # #

"Success at Apache" is a new monthly blog series that focuses on the processes behind why The Apache Software Foundation (ASF) "just works". First article: Project Independence https://s.apache.org/CE0V Second article: "All Carrot and No Stick" https://s.apache.org/ykoG

Friday February 03, 2017

The Apache News Round-up: week ending 3 February 2017

Hello, February! Here's what the Apache community has been working on this week:

ASF Board –management and oversight of the business and affairs of the corporation in accordance with the Foundation's bylaws.
 - Next Board Meeting: 15 February 2017. Board calendar and minutes available at http://apache.org/foundation/board/calendar.html

ASF Infrastructure –our distributed team on four continents keeps the ASF's infrastructure running around the clock.
 - 7M+ weekly checks yield ongoing "three nines" performance at 99.93% uptime http://status.apache.org/

ApacheCon™ –Tomorrow's Technology Today. https://s.apache.org/F7Hy
 - DEADLINES:
   - CFPs close 11 February http://apachecon.com/
   - Travel Assistance applications close 8 March https://www.apache.org/travel/
   - Early registration and hotel rates end 12 March http://events.linuxfoundation.org/events/apachecon-north-america
   - Apache Committers: remember to register using your apache.org address + discount code to save even more!
 - Recordings from ApacheCon Europe 2016 are being uploaded at Feathercast http://feathercast.org

New logos/marks wanted –with the launch of the ASF's new visual identity last year, many Apache projects have been freshening up their looks. Calls are open for:
 - Apache Incubator https://s.apache.org/rFii and Apache OpenNLP https://issues.apache.org/jira/browse/OPENNLP-6

Apache Atlas (incubating) –a scalable and extensible set of core foundational governance services - enabling enterprises to effectively and efficiently meet their compliance requirements within Hadoop and allows integration with the whole enterprise data ecosystem.
 - Apache Atlas 0.7.1-incubating released http://www.apache.org/dyn/closer.cgi/incubator/atlas/0.7.1-incubating/

Apache Bahir™ –provides extensions to distributed analytic platforms such as Apache Spark.
 - Apache Bahir 2.0.2 released http://bahir.apache.org

Apache Jackrabbit™ –a fully compliant implementation of the Content Repository for Java(TM) Technology API, version 2.0 (JCR 2.0) as specified in the Java Specification Request 283 (JSR 283).
 - Apache Jackrabbit 2.4.7 and Jackrabbit Oak 1.6.0 released http://jackrabbit.apache.org/downloads.html

Apache Log4j™ –a well-known framework for logging application behavior
 - Apache Log4j 2.8 released https://logging.apache.org/log4j/2.x/

Apache OpenMeetings™ –provides video conferencing, instant messaging, white board, collaborative document editing and other groupware tools using API functions of the Red5 Streaming Server for Remoting and Streaming.
 - Apache OpenMeetings 3.1.5 released http://openmeetings.apache.org/downloads.html

Apache POI™ –a Java library for reading and writing Microsoft Office files 
 - Apache POI 3.16 beta 2 released https://www.apache.org/dyn/closer.lua/poi/dev/RELEASE-NOTES-3.16-beta2.txt

Apache Syncope™ –an Open Source system for managing digital identities in enterprise environments, implemented in Java EE technology.
 - Apache Syncope 2.0.2 released http://syncope.apache.org/downloads.html

Apache UIMA™ –a component architecture and framework for the analysis of unstructured content like text, video and audio data.
 - Apache UIMA Java SDK 3.0.0-alpha released http://uima.apache.org


Did You Know?

 - Did you know that Apache OpenNLP, a machine learning based toolkit for processing natural language text, can be used with Apache Lucene/Solr to tag words with part-of-speech, extract named entities, and more? https://opennlp.apache.org/

 - Did you know that standalone tracks taking place alongside ApacheCon include Apache: Big Data, Flex Project Summit, TomcatCon, Apache: IoT, and CloudStack Collaboration Conference? Join us! http://apachecon.com/

 - Did you know that Apache CouchDB has its own weekly news round-up? https://blog.couchdb.org/2017/02/02/couchdb-weekly-news-february-2-2017/

Apache Community Notices:

 - "Success at Apache" is a new monthly blog series that focuses on the processes behind why the ASF "just works". 1) Project Independence https://s.apache.org/CE0V 2) "All Carrot and No Stick" https://s.apache.org/ykoG

 - Feedback from The Apache Software Foundation on the Free and Open Source Security Audit (FOSSA) https://s.apache.org/romf

 - ASF Operations Summary - Q2 FY2017 https://s.apache.org/oTOF

 - The list of Apache project-related MeetUps can be found at http://apache.org/events/meetups.html

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - ApacheCon North America and Apache:BigData will be held 16-18 May 2017 in Miami http://apachecon.com/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

 - Show your support for Apache with ASF-approved swag from http://www.zazzle.com/featherwearand http://s.apache.org/landsend--all proceeds benefit the ASF! 

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Calendar

Search

Hot Blogs (today's hits)

Tag Cloud

Categories

Feeds

Links

Navigation