The Apache Software Foundation Blog

Friday February 23, 2018

The Apache News Round-up: week ending 23 February 2018

We're closing out the month with the following activities from the Apache community:

ASF Board –management and oversight of the business affairs of the corporation in accordance with the Foundation's bylaws.
 - Next Board Meeting: 21 March. Board calendar and minutes http://apache.org/foundation/board/calendar.html

ApacheCon™ –the ASF's official global conference series.
 - Travel Assistance applications now being accepted for ApacheCon/Montreal https://www.apache.org/travel/
 - CFP is open for ApacheCon 24-29 September in Montreal http://apachecon.com/
 - CFP is also open for the Apache Roadshow Europe 13-14 June in Berlin http://apachecon.com/euroadshow18/

Apache Community Development –helps newcomers take their first steps towards being a part of the Apache community.
 - We are proud to be a Google Summer of Code Mentoring Organization for the 13th consecutive year. Students: learn how to get started with dozens of Apache projects at https://community.apache.org/gsoc.html

ASF Infrastructure –our distributed team on three continents keeps the ASF's infrastructure running around the clock.
 - 7M+ weekly checks yield zippity performance at 99.97% uptime. http://status.apache.org/

ASF Operations Factoid –this week, 406 Apache contributors changed 872,446 lines of code over 2,838 commits. Top 5 contributors, in order, are: Dewayne Richardson, Andi Huber, Dan Kirkwood, Daniel Sun, and Dan Haywood.

Apache Arrow™ –a cross-language development platform for in-memory data.
 - Apache Arrow JavaScript 0.3.0 released http://arrow.apache.org/

Apache Beam™ –a programming model, SDKs, and runners for defining and executing data processing pipelines.
 - Apache Beam 2.3.0 released https://beam.apache.org/

Apache Geode™ –low latency, high concurrency data management solutions.
 - CVE-2017-15696 Apache Geode configuration request authorization vulnerability http://mail-archives.apache.org/mod_mbox/www-announce/201802.mbox/%3CCAEwge-GQLV_9Y56psCejkhA-B3jx4amnQP5AoVwURbzn%3DDCZOw%40mail.gmail.com%3E

Apache Groovy™ –a multi-facet programming language for the JVM.
 - Apache Groovy 2.5.0-beta-3 released https://groovy.apache.org/

Apache Jackrabbit™ Oak –a scalable, high-performance hierarchical content repository designed for use as the foundation of modern world-class Web sites and other demanding content applications.
 - Apache Jackrabbit Oak 1.4.20 released http://jackrabbit.apache.org/

Apache jclouds™ –an Open Source multi-cloud toolkit for the Java platform that gives you the freedom to create applications that are portable across clouds while giving you full control to use cloud-specific features.
 - Apache jclouds 2.1.0 released http://jclouds.apache.org/

Apache NetBeans (incubating) –a development environment, tooling platform and application framework.
 - Apache NetBeans (incubating) 9.0 Beta released http://netbeans.apache.org/

Apache Storm™ –a distributed, fault-tolerant, and high-performance realtime computation system that provides strong guarantees on the processing of data.
 - Apache Storm 1.0.6, 1.1.2, and 1.2.0 released http://storm.apache.org

Apache Tomcat™ –an Open Source software implementation of the Java Servlet, JavaServer Pages, Java Unified Expression Language, Java WebSocket and JASPIC technologies.
 - CVE-2018-1304 Security constraints mapped to context root are ignored http://mail-archives.apache.org/mod_mbox/www-announce/201802.mbox/%3C2a8f2292-2aee-d8fa-9ccc-d1f9b20d0eed%40apache.org%3E
 - CVE-2018-1305 Security constraint annotations applied too late http://mail-archives.apache.org/mod_mbox/www-announce/201802.mbox/%3C8b41c43e-20cd-10d0-5e2e-e3947bd26a32%40apache.org%3E

Apache Wicket™ –an Open Source Java component oriented Web application framework that powers thousands of web applications and Web sites for governments, stores, universities, cities, banks, email providers, and more.
 - Apache Wicket 8.0.0-M9 released http://wicket.apache.org


Did You Know?

 - Did you know why companies sponsor ApacheCon? https://feathercast.apache.org/2016/05/09/why-did-you-sponsor-apachebigdata/

 - Did you know that German business management consultancy Ecomify uses Apache OFBiz? http://ofbiz.apache.org/

 - Did you know that Apache Zeppelin will be holding a get together at Strata 2018 in San Jose? http://zeppelin.apache.org/

Apache Community Notices:

 - The Apache Software Foundation 2018 Vision Statement https://s.apache.org/zqC3

 - Apache in 2017 - By The Digits https://s.apache.org/h8do

 - Foundation Statement –Apache Is Open. https://s.apache.org/PIRA

 - "Success at Apache" focuses on the processes behind why the ASF "just works". 1) Project Independence https://s.apache.org/CE0V 2) All Carrot and No Stick https://s.apache.org/ykoG 3) Asynchronous Decision Making https://s.apache.org/PMvk4) Rule of the Makers https://s.apache.org/yFgQ 5) JFDI --the unconditional love of contributors https://s.apache.org/4pjM 6) Meritocracy and Me https://s.apache.org/tQQh 7) Learning to Build a Stronger Community https://s.apache.org/x9Be 8) Meritocracy. https://s.apache.org/DiEo 9) Lowering Barriers to Open Innovation https://s.apache.org/dAlg 10) All My Roads Led to Apache https://s.apache.org/l9OO 11) Scratch Your Own Itch. https://s.apache.org/7Amk 12) What a Long Strange (and Great) Trip It's Been https://s.apache.org/gVuN 13) A Newbie's Narrative https://s.apache.org/A72H

 - Please follow/like/re-tweet the ASF on social media: @TheASF on Twitter and on LinkedIn at https://www.linkedin.com/company/the-apache-software-foundation

 - Do friend and follow us on the Apache Community Facebook page https://www.facebook.com/ApacheSoftwareFoundation/and Twitter account https://twitter.com/ApacheCommunity

 - The list of Apache project-related MeetUps can be found at http://apache.org/events/meetups.html

 - Apache CloudStack will be holding their first German Meetup on 28 February 2018 in Frankfurt https://www.meetup.com/german-CloudStack-user-group/events/246861772/?eventId=246861772

 - Members of the Apache community will be presenting at DataWorks Summit 16-19 April 2018 in Berlin https://dataworkssummit.com/

 - Open Expo Europe - 6-7 June 2018 in Madrid https://openexpoeurope.com/

 - Meet members of the Apache community at Open Expo Madrid 6-7 June 2018 http://www.openexpo.es/en/

 - We're teaming up with Berlin Buzzwords - 10-12 June 2018 (Apache Lounge dates: 11-12 June) https://berlinbuzzwords.de/

 - The 2018 Apache EU Roadshow will be held during FOSS Backstage in Berlin 13-14 June 2018 https://foss-backstage.de/

 - Apache Big Data project communities will be participating at DataWorks Summit 17-21 June 2018 in San Jose https://dataworkssummit.com/

 - ASF Quarterly Report: Operations Summary Q2 FY2018 https://s.apache.org/j1GJ

 - ASF Annual Report is available at https://s.apache.org/FY2017AnnualReport

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Friday February 16, 2018

The Apache News Round-up: week ending 16 February 2018

Happy Friday --let's review what the collective Apache community has been up to:

ASF Board –management and oversight of the business affairs of the corporation in accordance with the Foundation's bylaws.
 - The Apache Software Foundation 2018 Vision Statement https://s.apache.org/zqC3
 - Next Board Meeting: 21 February. Board calendar and minutes http://apache.org/foundation/board/calendar.html

ApacheCon™ –the ASF's official global conference series.
 - Travel Assistance applications now being accepted for ApacheCon/Montreal https://www.apache.org/travel/
 - CFP is open for ApacheCon 24-29 September in Montreal http://apachecon.com/
 - CFP is also open for the Apache Roadshow Europe 13-14 June in Berlin http://apachecon.com/euroadshow18/

ASF Infrastructure –our distributed team on three continents keeps the ASF's infrastructure running around the clock.
 - 7M+ weekly checks yield sensational performance at 99.95% uptime. http://status.apache.org/

ASF Operations Factoid –this week, 547 Apache contributors changed 1,185,183 lines of code over 3,568 commits. Top 5 contributors, in order, are: Christopher Collins; Duo Zhang, Felix Schumacher, Andrea Cosentino, and Dan Haywood.

Apache CloudStack™ –Open Source enterprise Cloud orchestration platform.
 - The Apache Software Foundation Announces Apache® CloudStack® v4.11 https://s.apache.org/CloudStack411

Apache Commons™ Compress –defines an API for working with compression and archive formats.
 - Apache Commons Compress 1.16.1 released http://commons.apache.org/

Apache Curator™ –a Java/JVM client library for Apache ZooKeeper that includes a high-level API framework and utilities to make using Apache ZooKeeper much easier and more reliable.
 - Apache Curator 4.0.1 released http://curator.apache.org/

Apache Jackrabbit™ Oak –a scalable, high-performance hierarchical content repository designed for use as the foundation of modern world-class Web sites and other demanding content applications.
 - Apache Jackrabbit Oak 1.6.9 released http://jackrabbit.apache.org/

Apache JMeter™ –pure Java application for load and functional testing.
 - Apache JMeter 4.0 released http://jmeter.apache.org/
 - CVE-2018-1297: Apache JMeter uses an unsecure RMI connection in Distributed mode http://mail-archives.apache.org/mod_mbox/www-announce/201802.mbox/%3CCAH9fUpaNzk5am8oFe07RQ-kynCsQv54yB-uYs9bEnz7tbX-O7g%40mail.gmail.com%3E
 - CVE-2018-1287: Apache JMeter binds RMI server to wildcard in distributed mode (based on RMI) http://mail-archives.apache.org/mod_mbox/www-announce/201802.mbox/%3CCAH9fUpYsFx1%2Brwz1A%3Dmc7wAgbDHARyj1VrWNg41y9OySuL1mqw%40mail.gmail.com%3E

Apache JSPWiki™ –a feature-rich and extensible WikiWiki engine built around the standard JEE components (Java, servlets, JSP).
 - Apache JSPWiki 2.10.3 released http://jspwiki.apache.org/

Apache Oozie™ – a workflow scheduler system to manage Apache Hadoop jobs.
 - Apache Oozie 4.3.1 released http://oozie.apache.org
 - CVE-2017-15712: Apache Oozie Server vulnerability http://mail-archives.apache.org/mod_mbox/www-announce/201802.mbox/%3CCABBupGWtC2vN-JzXWeuDaN-_bP6yzRJhK%2BDAfr%3DgSGLZJGbFCQ%40mail.gmail.com%3E

Apache Phoenix™ –enables OLTP and operational analytics for Apache Hadoop by providing a relational database layer leveraging Apache HBase as its backing store. 
 - Apache Phoenix 5.0.0-alpha released https://phoenix.apache.org/

Apache Qpid™ –AMQP enterprise messaging implementation.
 - Apache Qpid Dispatch 0.8.1 released http://qpid.apache.org
 - CVE-2017-15699: Apache Qpid Dispatch Router Denial of Service Vulnerability when specially crafted frame is sent to the Router http://mail-archives.apache.org/mod_mbox/www-announce/201802.mbox/%3CCAO30oQd%3DUw5ovTGPX-NNEeMdrURYsxceXoHcULoJF4rToi6BMA%40mail.gmail.com%3E

Apache Tomcat™ –an Open Source software implementation of the Java Servlet, JavaServer Pages, Java Unified Expression Language, Java WebSocket and JASPIC technologies.
- Apache Tomcat 7.0.85, 8.0.50, 8.5.28, and 9.0.5 released http://tomcat.apache.org/

Apache Wicket™ –an Open Source Java component oriented Web application framework that powers thousands of web applications and Web sites for governments, stores, universities, cities, banks, email providers, and more.
 - Apache Wicket 7.10.0 released http://wicket.apache.org


Did You Know?

 - Did you know that over the past decade, the ASF's Travel Assistance Committee has provided travel support to enable dozens of individuals across the globe to attend ApacheCon? https://www.apache.org/travel/

 - Did you know that the CFP for our Apache Roadshow Europe's host event, FOSS Backstage, closes on 18 February? https://foss-backstage.de/call-papers

 - Did you know that members of the Apache Big Data community will be on the "SMACK 2.0: Emerging Data Pipelines" panel at Index Developer Conference 20-22 February/San Francisco? https://developer.ibm.com/indexconf/sessions/#!/?id=5559 Sign up by 20 February and save $70 using discount code CD3ALEXY

Apache Community Notices:

 - Apache in 2017 - By The Digits https://s.apache.org/h8do

 - Foundation Statement –Apache Is Open. https://s.apache.org/PIRA

 - "Success at Apache" focuses on the processes behind why the ASF "just works". 1) Project Independence https://s.apache.org/CE0V 2) All Carrot and No Stick https://s.apache.org/ykoG 3) Asynchronous Decision Making https://s.apache.org/PMvk4) Rule of the Makers https://s.apache.org/yFgQ 5) JFDI --the unconditional love of contributors https://s.apache.org/4pjM 6) Meritocracy and Me https://s.apache.org/tQQh 7) Learning to Build a Stronger Community https://s.apache.org/x9Be 8) Meritocracy. https://s.apache.org/DiEo 9) Lowering Barriers to Open Innovation https://s.apache.org/dAlg 10) All My Roads Led to Apache https://s.apache.org/l9OO 11) Scratch Your Own Itch. https://s.apache.org/7Amk 12) What a Long Strange (and Great) Trip It's Been https://s.apache.org/gVuN 13) A Newbie's Narrative https://s.apache.org/A72H

 - Please follow/like/re-tweet the ASF on social media: @TheASF on Twitter and on LinkedIn at https://www.linkedin.com/company/the-apache-software-foundation

 - Do friend and follow us on the Apache Community Facebook page https://www.facebook.com/ApacheSoftwareFoundation/and Twitter account https://twitter.com/ApacheCommunity

 - The list of Apache project-related MeetUps can be found at http://apache.org/events/meetups.html

 - Members of the Apache Big Data community will be at the Index Developer Conference 20-22 February/San Francisco. Sign up by 20 February and save $70 using discount code CD3ALEXY https://developer.ibm.com/indexconf/sessions/#!/?id=5559 

 - The Apache Tinkerpop community will be holding a MeetUp on Gremlin on 21 February in New York https://www.meetup.com/DataStax-UserGroup-NewYork/events/246762770/

 - Apache CloudStack will be holding their first German Meetup on 28 February 2018 in Frankfurt https://www.meetup.com/german-CloudStack-user-group/events/246861772/?eventId=246861772

 - Members of the Apache community will be presenting at DataWorks Summit 16-19 April 2018 in Berlin https://dataworkssummit.com/

 - Open Expo Europe - 6-7 June 2018 in Madrid https://openexpoeurope.com/

 - Meet members of the Apache community at Open Expo Madrid 6-7 June 2018 http://www.openexpo.es/en/

 - We're teaming up with Berlin Buzzwords - 10-12 June 2018 (Apache Lounge dates: 11-12 June) https://berlinbuzzwords.de/

 - The 2018 Apache EU Roadshow will be held during FOSS Backstage in Berlin 13-14 June 2018 https://foss-backstage.de/

 - Apache Big Data project communities will be participating at DataWorks Summit 17-21 June 2018 in San Jose https://dataworkssummit.com/

 - ASF Quarterly Report: Operations Summary Q2 FY2018 https://s.apache.org/j1GJ

 - ASF Annual Report is available at https://s.apache.org/FY2017AnnualReport

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Monday February 12, 2018

The Apache Software Foundation Announces Apache® CloudStack® v4.11

Mature Open Source Enterprise Cloud platform powers billions of dollars in transactions for the world's largest Cloud providers.

Wakefield, MA —12 February 2018— The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today Apache® CloudStack® v4.11, the latest version of the turnkey enterprise Cloud orchestration platform.

Apache CloudStack is the proven, highly scalable, and easy-to-deploy IaaS platform used for rapidly creating private, public, and hybrid Cloud environments. Thousands of large-scale public Cloud providers and enterprise organizations use Apache CloudStack to enable billions of dollars worth of business transactions annually across their clouds.

"This is another great release," said Wido den Hollander, Vice President of Apache CloudStack. "The community has worked very hard to develop great new features and many enhancements to CloudStack. Together we are making the project better every single day."

Apache CloudStack v4.11 features more than 250 new capabilities, such as improved integration, stability, storage, networking support, and performance. Highlights include:

  • new Host HA framework with an HA provider for KVM powered clouds;
  • new certificate authority framework to support ongoing  work in container & application clusters;
  • integration with Prometheus;
  • a connector for Cloudian Hyperstore S3 storage;
  • deeper integration with Nuage SDN; and
  • Layer 2 Networking capabilities.


The full list of new features can be found in the project release notes at http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.11.0.0/

"This release has been driven by the people operating CloudStack clouds,” said Rohit Yadav, Apache CloudStack v4.11 Release Manager. "I would like to thank the contributors across all of these organizations for supporting this release, which reflects both the user-driven nature of our community and the Apache CloudStack project's commitment to continue to be the most stable, easily deployable, scalable Open Source platform for IaaS. Along with great new features, v4.11 brings several important structural changes such as better support for systemd and Java 8, migration to embedded Jetty, and a new and optimized Debian 9 based systemvm template."

Apache CloudStack powers numerous elastic Cloud computing services, including solutions that have ranked as Gartner Magic Quadrant leaders. Highlighted in the Forrester Q4 2017 Enterprise Open Source Cloud Adoption report, Apache CloudStack "sits beneath hundreds of service provider clouds", including Fortune 5 multinational corporations. A list of known Apache CloudStack users are available at http://cloudstack.apache.org/users.html

"Apache CloudStack release 4.11 has impressive new content," said Kris Sterckx, CloudStack development lead at Nuage Networks. "More than any previous release, v4.11 leverages the value of Nuage Networks SDN with Nuage 5.0 support, SDN managed networks, per-interface DHCP options support and automation support for migrating deployed Apache CloudStack clouds from traditional Linux bridge networking to SDN/OVS based networking."

"At Interoute, we depend on Apache Cloudstack to help us deliver innovative and reliable IaaS services to our global customers," said Alex Mattioli, Chief Cloud Architect at Interoute. "The functionality in the 4.11 release shows that Cloudstack continues to be the most operator-focused IaaS platform available for large service providers, with a development community who are able to quickly develop what the market wants. Many of the features in this release have been created directly based on the needs of Interoute and our customers."

"Apache CloudStack 4.11 continues to bring innovative features and functionality to market through collaborative Open Source development," said Simon Weller, Director of Technology at Education Networks America. "We're particularly excited by the Host-HA framework, which brings a much greater level of hypervisor automation to KVM based service providers."

"Feedback from our community helps us solve real-world problems and strengthens our development process," added den Hollander. "I look forward to Apache CloudStack users and developers continuing to work closely together to make future releases even better!"

Catch Apache CloudStack in action 28 February 2018 at the German CloudStack Meetup in Frankfurt.

Availability and Oversight
Apache CloudStack software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For downloads, documentation, and ways to become involved with Apache CloudStack, visit http://cloudstack.apache.org/ and https://twitter.com/CloudStack

About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server --the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 680 individual Members and 6,500 Committers across six continents successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official user conference, trainings, and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Aetna, Alibaba Cloud Computing, ARM, Baidu, Bloomberg, Budget Direct, Capital One, Cash Store, Cerner, Cloudera, Comcast, Facebook, Google, Hortonworks, Huawei, IBM, Inspur, iSIGMA, ODPi, LeaseWeb, Microsoft, PhoenixNAP, Pivotal, Private Internet Access, Red Hat, Target, Union Investment, and Yahoo. For more information, visit http://apache.org/ and https://twitter.com/TheASF

© The Apache Software Foundation. "Apache", "CloudStack", "Apache CloudStack", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #

Friday February 09, 2018

The Apache News Round-up: week ending 9 February 2018

We've had a great week! Here's what happened::

"Success at Apache" –the blog series from the Apache Community that focuses on why the ASF "just works".
 - A Newbie's Narrative by Kuhu Shukla https://s.apache.org/A72H

ASF Board –management and oversight of the business affairs of the corporation in accordance with the Foundation's bylaws.
 - The Apache Software Foundation 2018 Vision Statement https://s.apache.org/zqC3
 - Next Board Meeting: 21 February. Board calendar and minutes http://apache.org/foundation/board/calendar.html

ApacheCon™ –the ASF's official global conference series.
 - CFP is open for ApacheCon 24-29 September in Montreal http://apachecon.com/
 - CFP is also open for the Apache Roadshow Europe 13-14 June in Berlin http://apachecon.com/euroadshow18/

ASF Infrastructure –our distributed team on three continents keeps the ASF's infrastructure running around the clock.
 - 7M+ weekly checks yield ace stunning performance at 100% uptime! Go Infra! http://status.apache.org/

ASF Operations Factoid –this week, 524 Apache contributors changed 947,241 lines of code over 3,263 commits. Top 5 contributors, in order, are: Duo Zhang, Jean-Baptiste Onofré, Daniel Sun, Alex Harui, and Andrea Cosentino.

Apache Attic™ –provides process and solutions to make it clear when an Apache project has reached its end of life.
 - Apache ACE retired http://attic.apache.org/projects/ACE.html

Apache Allura™ –an Open Source implementation of a software forge, a Web site that manages source code repositories, bug reports, discussions, wiki pages, blogs, and more for any number of individual projects.
 - Apache Allura 1.8.0 released http://allura.apache.org/
 - CVE-2018-1299 Apache Allura directory traversal vulnerability http://mail-archives.apache.org/mod_mbox/www-announce/201802.mbox/%3Cecde8662-12c8-e921-f169-e7bd64967e31%40apache.org%3E

Apache Ant™ –a Java library and command-line tool that helps building software.
 - Apache Ant 1.9.10 and 1.10.2 released http://ant.apache.org/
 - CVE-2017-5645: Apache Ant 1.9.9 and 1.10.1 - Apache Log4j 1.2.13 security vulnerability http://mail-archives.apache.org/mod_mbox/www-announce/201802.mbox/%3C003501d39fe4%24bbe519f0%2433af4dd0%24%40org%3E

Apache Atlas™ –a scalable and extensible set of core foundational governance services.
 - Apache Atlas 0.8.2 released http://atlas.apache.org/

Apache Commons™ Compress –defines an API for working with compression and archive formats.
 - Apache Commons Compress 1.16 released http://commons.apache.org/compress/

Apache Geode™ –low latency, high concurrency Big Data management solutions.
 - Apache Geode 1.4.0 http://geode.apache.org/

Apache Jackrabbit™ –a fully compliant implementation of the Content Repository for Java Technology API, version 2.0 (JCR 2.0) as specified in the Java Specification Request 283 (JSR 283).
 - Apache Jackrabbit 2.17.1 and 2.16.1 released http://jackrabbit.apache.org/

Apache Knox™ –a REST API Gateway for providing secure access to the data and processing resources of Apache Hadoop clusters.
 - Apache Knox 1.0.0 released http://knox.apache.org/

Apache Lens™ –provides a Unified Analytics interface.
 - Apache Lens 2.7.1 released http://lens.apache.org/

Apache OODT™ –a software framework as well as an architectural style for the rapid construction of scientific data systems.
 - Apache OODT 1.2.1 released http://oodt.apache.org/

Apache Qpid™ –AMQP enterprise messaging implementation.
 - Apache Qpid Broker-J 7.0.1 released http://qpid.apache.org
 - [CVE-2018-1298] Apache Qpid Broker-J Denial of Service Vulnerability with PLAIN and XOAUTH2 SASL mechanisms http://mail-archives.apache.org/mod_mbox/www-announce/201802.mbox/%3CCAP3WMuQ9dfe%3D3FCtqoZ1Q4xkFZZ%2Bogdqn6KVxyb_O4s5rLBwuw%40mail.gmail.com%3E

Apache Sling™ –a framework for RESTful Web-applications based on an extensible content tree.
 - Apache Sling 10 released https://sling.apache.org/

Apache Struts™ –an elegant, extensible framework for creating enterprise-ready Java Web applications.
 - New version of the Apache Struts Maven Archetypes released http://struts.apache.org/maven-archetypes/


Did You Know?

 - Did you know that the ASF's original project --the HTTP Web Server-- is celebrating its 23rd anniversary this month? Many happy returns, httpd! http://httpd.apache.org/

 - Did you know that Apache Community Development (ComDev) publishes a monthly blog newsletter? Read up on the latest issue at https://s.apache.org/yBJh

 - Did you know that Apache Ignite has a user survey underway? Share your experience, contribute to the project's growth, and win $50 gift cards! https://www.surveymonkey.com/r/IgniteSurvey18


Apache Community Notices:

 - Apache in 2017 - By The Digits https://s.apache.org/h8do

 - Foundation Statement –Apache Is Open. https://s.apache.org/PIRA

 - "Success at Apache" focuses on the processes behind why the ASF "just works". 1) Project Independence https://s.apache.org/CE0V 2) All Carrot and No Stick https://s.apache.org/ykoG 3) Asynchronous Decision Making https://s.apache.org/PMvk4) Rule of the Makers https://s.apache.org/yFgQ 5) JFDI --the unconditional love of contributors https://s.apache.org/4pjM 6) Meritocracy and Me https://s.apache.org/tQQh 7) Learning to Build a Stronger Community https://s.apache.org/x9Be 8) Meritocracy. https://s.apache.org/DiEo 9) Lowering Barriers to Open Innovation https://s.apache.org/dAlg 10) All My Roads Led to Apache https://s.apache.org/l9OO 11) Scratch Your Own Itch. https://s.apache.org/7Amk 12) What a Long Strange (and Great) Trip It's Been https://s.apache.org/gVuN 13) A Newbie's Narrative https://s.apache.org/A72H


 - Please follow/like/re-tweet the ASF on social media: @TheASF on Twitter and on LinkedIn at https://www.linkedin.com/company/the-apache-software-foundation

 - Do friend and follow us on the Apache Community Facebook page https://www.facebook.com/ApacheSoftwareFoundation/and Twitter account https://twitter.com/ApacheCommunity

 - The list of Apache project-related MeetUps can be found at http://apache.org/events/meetups.html

 - The Apache Tinkerpop community will be holding a MeetUp on Gremlin on 21 February in New York https://www.meetup.com/DataStax-UserGroup-NewYork/events/246762770/

 - Apache CloudStack will be holding their first German Meetup on 28 February 2018 in Frankfurt https://www.meetup.com/german-CloudStack-user-group/events/246861772/?eventId=246861772

 - Members of the Apache community will be presenting at DataWorks Summit 16-19 April 2018 in Berlin https://dataworkssummit.com/

 - Open Expo Europe - 6-7 June 2018 in Madrid https://openexpoeurope.com/

 - Meet members of the Apache community at Open Expo Madrid 6-7 June 2018 http://www.openexpo.es/en/

 - We're teaming up with Berlin Buzzwords - 10-12 June 2018 (Apache Lounge dates: 11-12 June) https://berlinbuzzwords.de/

 - The 2018 Apache EU Roadshow will be held during FOSS Backstage in Berlin 13-14 June 2018 https://foss-backstage.de/

- Apache Big Data project communities will be participating at DataWorks Summit 17-21 June 2018 in San Jose https://dataworkssummit.com/

 - ASF Quarterly Report: Operations Summary Q2 FY2018 https://s.apache.org/j1GJ

 - ASF Annual Report is available at https://s.apache.org/FY2017AnnualReport

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Monday February 05, 2018

Success at Apache: A Newbie’s Narrative

by Kuhu Shukla

As I sit at my desk on a rather frosty morning with my coffee, looking up new JIRAs from the previous day in the Apache Tez project, I feel rather pleased. The latest community release vote is complete, the bug fixes that we so badly needed are in and the new release that we tested out internally on our many thousand strong cluster is looking good. Today I am looking at a new stack trace from a different Apache project process and it is hard to miss how much of the exceptional code I get to look at every day comes from people all around the globe. A contributor leaves a JIRA comment before he goes on to pick up his kid from soccer practice while someone else wakes up to find that her effort on a bug fix for the past two months has finally come to fruition through a binding +1.

Yahoo – which joined AOL, HuffPost, Tumblr, Engadget, and many more brands to form the Verizon subsidiary Oath last year – has been at the frontier of open source adoption and contribution since before I was in high school. So while I have no historical trajectories to share, I do have a story on how I found myself in an epic journey of migrating all of Yahoo jobs from Apache MapReduce to Apache Tez, a then new DAG based execution engine.

Oath grid infrastructure is through and through driven by Apache technologies be it storage through HDFS, resource management through YARN, job execution frameworks with Tez and user interface engines such as Hive, Hue, Pig, Sqoop, Spark, Storm. Our grid solution is specifically tailored to Oath's business-critical data pipeline needs using the polymorphic technologies hosted, developed and maintained by the Apache community.

On the third day of my job at Yahoo in 2015, I received a YouTube link on An Introduction to Apache Tez. I watched it carefully trying to keep up with all the questions I had and recognized a few names from my academic readings of Yarn ACM papers. I continued to ramp up on YARN and HDFS, the foundational Apache technologies Oath heavily contributes to even today. For the first few weeks I spent time picking out my favorite (necessary) mailing lists to subscribe to and getting started on setting up on a pseudo-distributed Hadoop cluster. I continued to find my footing with newbie contributions and being ever more careful with whitespaces in my patches. One thing was clear – Tez was the next big thing for us. By the time I could truly call myself a contributor in the Hadoop community nearly 80-90% of the Yahoo jobs were now running with Tez. But just like hiking up the Grand Canyon, the last 20% is where all the pain was. Being a part of the solution to this challenge was a happy prospect and thankfully contributing to Tez became a goal in my next quarter.

The next sprint planning meeting ended with me getting my first major Tez assignment – progress reporting. The progress reporting in Tez was non-existent – "Just needs an API fix,"  I thought. Like almost all bugs in this ecosystem, it was not easy. How do you define progress? How is it different for different kinds of outputs in a graph? The questions were many.

I, however, did not have to go far to get answers. The Tez community actively came to a newbie's rescue, finding answers and posing important questions. I started attending the bi-weekly Tez community sync up calls and asking existing contributors and committers for course correction. Suddenly the team was much bigger, the goals much more chiseled. This was new to anyone like me who came from the networking industry, where the most open part of the code are the RFCs and the implementation details are often hidden. These meetings served as a clean room for our coding ideas and experiments. Ideas were shared, to the extent of which data structure we should pick and what a future user of Tez would take from it. In between the usual status updates and extensive knowledge transfers were made. 

Oath uses Apache Pig and Apache Hive extensively and most of the urgent requirements and requests came from Pig and Hive developers and users. Each issue led to a community JIRA and as we started running Tez at Oath scale, new feature ideas and bugs around performance and resource utilization materialized. Every year most of the Hadoop team at Oath travels to the Hadoop Summit where we meet our cohorts from the Apache community and we stand for hours discussing the state of the art and what is next for the project. One such discussion set the course for the next year and a half for me.

We needed an innovative way to shuffle data. Frameworks like MapReduce and Tez have a shuffle phase in their processing life cycle wherein the data from upstream producers is made available to downstream consumers. Even though Apache Tez was designed with a feature set corresponding to optimization requirements in Pig and Hive, the Shuffle Handler Service was retrofitted from MapReduce at the time of the project's inception. With several thousands of jobs on our clusters leveraging these features in Tez, the Shuffle Handler Service became a clear performance bottleneck. So as we stood talking about our experience with Tez with our friends from the community, we decided to implement a new Shuffle Handler for Tez. All the conversation points were tracked now through an umbrella JIRA TEZ-3334 and the to-do list was long. I picked a few JIRAs and as I started reading through I realized, this is all new code I get to contribute to and review. There might be a better way to put this, but to be honest it was just a lot of fun! All the white boards were full, the team took walks post lunch and discussed how to go about defining the API. Countless hours were spent debugging hangs while fetching data and looking at stack traces and Wireshark captures from our test runs. Six months in and we had the feature on our sandbox clusters. There were moments ranging from sheer frustration to absolute exhilaration with high fives as we continued to address review comments and fixing big and small issues with this evolving feature.

As much as owning your code is valued everywhere in the software community, I would never go on to say “I did this!” In fact, “we did!” It is this strong sense of shared ownership and fluid team structure that makes the open source experience at Apache truly rewarding. This is just one example. A lot of the work that was done in Tez was leveraged by the Hive and Pig community and cross Apache product community interaction made the work ever more interesting and challenging. Triaging and fixing issues with the Tez rollout led us to hit a 100% migration score last year and we also rolled the Tez Shuffle Handler Service out to our research clusters. As of last year we have run around 100 million Tez DAGs with a total of 50 billion tasks over almost 38,000 nodes.

In 2018 as I move on to explore Hadoop 3.0 as our future release, I hope that if someone outside the Apache community is reading this, it will inspire and intrigue them to contribute to a project of their choice. As an astronomy aficionado, going from a newbie Apache contributor to a newbie Apache committer was very much like looking through my telescope - it has endless possibilities and challenges you to be your best.

Kuhu Shukla is a software engineer at Oath and did her Masters in Computer Science at North Carolina State University. She works on the Big Data Platforms team on Apache Tez, YARN and HDFS with a lot of talented Apache PMCs and Committers in Champaign, Illinois. A recent Apache Tez Committer herself she continues to contribute to YARN and HDFS and spoke at the 2017 Dataworks Hadoop Summit on "Tez Shuffle Handler : Shuffling At Scale With Apache Hadoop". Prior to that she worked on Juniper Networks' router and switch configuration APIs. She likes to participate in open source conferences and women in tech events. In her spare time she loves singing Indian classical and jazz, laughing, whale watching, hiking and peering through her Dobsonian telescope.

= = =

"Success at Apache" is a monthly blog series that focuses on the processes behind why the ASF "just works". 1) Project Independence https://s.apache.org/CE0V 2) All Carrot and No Stick https://s.apache.org/ykoG 3) Asynchronous Decision Making https://s.apache.org/PMvk 4) Rule of the Makers https://s.apache.org/yFgQ 5) JFDI --the unconditional love of contributors https://s.apache.org/4pjM 6) Meritocracy and Me https://s.apache.org/tQQh 7) Learning to Build a Stronger Community https://s.apache.org/x9Be 8) Meritocracy. https://s.apache.org/DiEo 9) Lowering Barriers to Open Innovation https://s.apache.org/dAlg 10) Scratch your own itch. https://s.apache.org/Apah 11) What a Long Strange (and Great) Trip It's Been https://s.apache.org/gVuN 12) A Newbie's Narrative https://s.apache.org/A72H

# # #  

Friday February 02, 2018

The Apache News Round-up: week ending 2 February 2018

Hello, February. Let's review what the Apache community have been busy with over the past week:

ASF Board –management and oversight of the business affairs of the corporation in accordance with the Foundation's bylaws.
 - The Apache Software Foundation 2018 Vision Statement https://s.apache.org/zqC3
 - Next Board Meeting: 21 February. Board calendar and minutes http://apache.org/foundation/board/calendar.html

ApacheCon™ –the ASF's official global conference series.
 - The Apache® Software Foundation Announces ApacheCon™ and Supporting Global Events https://s.apache.org/O3B3

ASF Infrastructure –our distributed team on three continents keeps the ASF's infrastructure running around the clock.
 - 7M+ weekly checks yield ace spectacular at 99.99% uptime http://status.apache.org/

ASF Operations Factoid –this week, 524 Apache contributors changed 1,300,623 lines of code over 3,553 commits. Top 5 contributors, in order, are: Nick Couchman, Benoit Tellier, Duo Zhang, Yang Li, and Jean-Baptiste Onofré.

Apache BookKeeper™ –a scalable, fault-tolerant, and low-latency storage service optimized for real-time workloads.
 -Apache BookKeeper 4.6.1 released https://bookkeeper.apache.org/

Apache Jackrabbit™ –a fully compliant implementation of the Content Repository for Java Technology API, version 2.0 (JCR 2.0) as specified in the Java Specification Request 283 (JSR 283).
 - Apache Jackrabbit 2.17.1 released http://jackrabbit.apache.org/

Apache Kibble™ –Open Source tools used for collecting, aggregating and visualizing software project activity.
 - The Apache Software Foundation Announces Apache® Kibble™ as a Top-Level Project https://s.apache.org/wMMa

Apache NiFi™ –supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic.
 - Apache NiFi MiNiFi C++ 0.4.0 released https://nifi.apache.org/minifi

Apache POI™ –APIs for manipulating various file formats based upon Open Office XML (ECMA-376) and Microsoft's OLE 2 Compound Document formats using pure Java.
 - CVE-2017-12626 – Denial of Service Vulnerabilities in Apache POI http://mail-archives.apache.org/mod_mbox/www-announce/201801.mbox/%3C1190211676.1193152.1516995087060%40mail.yahoo.com%3E

Apache Qpid™ –a messaging library for the Advanced Message Queuing Protocol 1.0 (AMQP 1.0, ISO/IEC 19464).
 - Apache Qpid JMS 0.29.0 and Proton 0.20.0 released http://qpid.apache.org/

Apache Sqoop™ –a tool designed for efficiently transferring bulk data between Apache Hadoop and structured datastores, such as relational databases.
 - Apache Sqoop 1.4.7 released http://sqoop.apache.org/

Apache Tomcat™ –an Open Source software implementation of the Java Servlet, JavaServer Pages, Java Unified Expression Language, Java WebSocket and JASPIC technologies.
 - CVE-2017-15698 Apache Tomcat Native Connector - OCSP check omitted http://mail-archives.apache.org/mod_mbox/www-announce/201801.mbox/%3C6fa14400-328f-a4a5-7f24-5cd40868bf78%40apache.org%3E
 - CVE-2017-15706 Apache Tomcat Incorrectly documented CGI search algorithm http://mail-archives.apache.org/mod_mbox/www-announce/201801.mbox/%3Ce5f20acd-4241-505d-f340-d62b6dd2d306%40apache.org%3E

Apache Yetus™ –a collection of libraries and tools that enable contribution and release processes for software projects.
 - Apache Yetus 0.7.0 released https://yetus.apache.org/


Did You Know?

 - Did you know that the ASF's original project --the HTTP Web Server-- is celebrating its 23rd anniversary this month? Many happy returns, httpd! http://httpd.apache.org/

 - Did you know that Apache Spark has won an InfoWorld Technology of the Year award? https://www.infoworld.com/article/3252231/application-development/technology-of-the-year-2018-the-best-hardware-software-and-cloud-services.html

 - Did you know that the Åland Islands Library uses Apache Wicket? http://wicket.apache.org/


Apache Community Notices:

 - Apache in 2017 - By The Digits https://s.apache.org/h8do

 - Foundation Statement –Apache Is Open. https://s.apache.org/PIRA

 - "Success at Apache" focuses on the processes behind why the ASF "just works". 1) Project Independence https://s.apache.org/CE0V 2) All Carrot and No Stick https://s.apache.org/ykoG 3) Asynchronous Decision Making https://s.apache.org/PMvk4) Rule of the Makers https://s.apache.org/yFgQ 5) JFDI --the unconditional love of contributors https://s.apache.org/4pjM 6) Meritocracy and Me https://s.apache.org/tQQh 7) Learning to Build a Stronger Community https://s.apache.org/x9Be 8) Meritocracy. https://s.apache.org/DiEo 9) Lowering Barriers to Open Innovation https://s.apache.org/dAlg 10) All My Roads Led to Apache https://s.apache.org/l9OO 11) Scratch Your Own Itch. https://s.apache.org/7Amk 12) What a Long Strange (and Great) Trip It's Been https://s.apache.org/gVuN

 - Please follow/like/re-tweet the ASF on social media: @TheASF on Twitter and on LinkedIn at https://www.linkedin.com/company/the-apache-software-foundation

 - Do friend and follow us on the Apache Community Facebook page https://www.facebook.com/ApacheSoftwareFoundation/and Twitter account https://twitter.com/ApacheCommunity

 - The list of Apache project-related MeetUps can be found at http://apache.org/events/meetups.html

 - The ASF will be back at FOSDEM in Brussels 3-5 February 2018. We'll see you there! https://fosdem.org/2018/

 - The ASF is a Developer Week Community Partner 3-7 February in San Franciso https://blogs.apache.org/comdev/entry/apache-software-foundation-community-sponsor

 - The Apache Tinkerpop community will be holding a MeetUp on Gremlin on 21 February in New York https://www.meetup.com/DataStax-UserGroup-NewYork/events/246762770/

 - Apache CloudStack will be holding their first German Meetup on 28 February 2018 in Frankfurt https://www.meetup.com/german-CloudStack-user-group/events/246861772/?eventId=246861772

 - Open Expo Europe - 6-7 June 2018 in Madrid https://openexpoeurope.com/

 - Meet members of the Apache community at Open Expo Madrid 6-7 June 2018 http://www.openexpo.es/en/

 - We're teaming up with Berlin Buzzwords - 10-12 June 2018 (Apache Lounge dates: 11-12 June) https://berlinbuzzwords.de/

 - The 2018 Apache EU Roadshow will be held during FOSS Backstage in Berlin 13-14 June 2018 https://foss-backstage.de/

 - ASF Quarterly Report: Operations Summary Q2 FY2018 https://s.apache.org/j1GJ

 - ASF Annual Report is available at https://s.apache.org/FY2017AnnualReport

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Calendar

Search

Hot Blogs (today's hits)

Tag Cloud

Categories

Feeds

Links

Navigation