The Apache Software Foundation Blog

Tuesday February 19, 2019

The Apache® Software Foundation Announces Apache Arrow™ Momentum

Open Source Big Data in-memory columnar layer adopted by dozens of Open Source and commercial technologies; exceeded 1,000,000 monthly downloads within first three years as an Apache Top-Level Project

Wakefield, MA —19 February 2019— The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, today announced momentum with Apache® Arrow™, the Open Source Big Data in-memory columnar layer.

Since the founding of the project in January 2016, Apache Arrow has quickly become the defacto standard for representing and processing analytical data in memory, accelerating analytical processing and interchange by more than 100x.

"When we became a Top-Level Project, we projected that the majority of the world's data will be processed through Arrow within the next decade," said Jacques Nadeau, Vice President of Apache Arrow. "In just three years time, we are proud to see Arrow's substantial industry adoption and increased value across a wide range of analytical, machine learning, and artificial intelligence workloads."

Highlights of Apache Arrow's success include:

Industry Adoption —more than 20 major technologies adopted Arrow to accelerate in-memory analytics, including Apache Spark, NVIDIA RAPIDS, pandas, and Dremio, among others. A list of known Open Source and commercial implementations can be found at https://arrow.apache.org/powered_by/

Millions of Downloads —leveraging and integrating Apache Arrow into many other technologies has bolstered downloads to more than 1,000,000 each month.

New Language Support —as a cross-language development platform, supporting multiple programming languages is paramount. Apache Arrow has grown from supporting one language to eleven different languages today; they include C++, Java, Python, R, C#, Javascript, and Ruby, among others.

Seamless Data Format Support —Arrow supports different data types, both simple and nested, located in arbitrary memory such as regular system RAM, memory-mapped files or on-GPU memory. In addition, it can ingest data from popular storage formats such as Apache Parquet, CSV files, Apache ORC, JSON, and more.

Major Code Donations —Apache Arrow's new features and expanded functionality are due in part to code and component donations that include:
  • C# Library
  • Gandiva LLVM-based Expression Compiler
  • Go Library
  • Javascript Library
  • Plasma Shared Memory Object Store
  • Ruby Libraries (Apache Arrow and Apache Parquet)
  • Rust Libraries (Parquet and DataFusion Query Engine)
Community and Contributor Growth —over the past 12 months, nearly 300 individuals have submitted more than 3,000 contributions that have grown the Apache Arrow code base by 300,000 lines of code. The Arrow community is welcoming approximately 10 new contributors each month.


In January the project announced its most recent release, Apache Arrow 0.12.0, which reflects more than 600 enhancements developed during Q4 2018. The Apache Arrow community is actively working on a number of impactful new initiatives that include solving high performance analytical problems and allowing for more efficient data distribution across entire clusters.

"Apache Arrow's rapid industry adoption and developer community growth supports our original thesis of the importance of a language-independent open standard for columnar data," said Wes McKinney, member of the Apache Arrow Project Management Committee, and creator of Python's pandas project. "Additionally, we are seeing productive collaborations take place not only between programming languages but also between the database systems and data science worlds. We look forward to welcoming more data system developers into our community."

About Apache Arrow
Apache Arrow is a cross-language development platform for in-memory data. It specifies a standardized language-independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations on modern hardware. It also provides computational libraries and zero-copy streaming messaging and interprocess communication. Languages currently supported include C, C++, C#, Go, Java, JavaScript, MATLAB, Python, R, Ruby, and Rust.

Availability and Oversight
Apache Arrow software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For downloads, documentation, and ways to become involved with Apache Arrow, visit http://arrow.apache.org/

About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server --the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 730 individual Members and 7,000 Committers across six continents successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official global conference series. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Aetna, Alibaba Cloud Computing, Anonymous, ARM, Baidu, Bloomberg, Budget Direct, Capital One, Cerner, Cloudera, Comcast, Facebook, Google, Handshake, Hortonworks, Huawei, IBM, Indeed, Inspur, LeaseWeb, Microsoft, Oath, ODPi, Pineapple Fund, Pivotal, Private Internet Access, Red Hat, Target, Tencent, Union Investment, and Workday. For more information, visit http://apache.org/ and https://twitter.com/TheASF

© The Apache Software Foundation. "Apache", "Arrow", "Apache Arrow", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #

Monday January 28, 2019

The Apache Software Foundation Welcomes Amazon Web Services (AWS) as its Newest Sponsor

The Apache Software Foundation (ASF) today welcomed Amazon Web Services (AWS), the latest company to sponsor the ASF at the Platinum level.

"We are pleased to have AWS as a Platinum Sponsor," said ASF Chairman Phil Steitz. "In addition to helping support the ASF’s day-to-day operations through a Platinum sponsorship, AWS has been a Silver-level Targeted Sponsor providing the ASF Infrastructure team with AWS Cloud credits over the past two years. More than 350 Apache projects and their communities directly benefit from the generosity of ASF Sponsors."

AWS joins the following Sponsors:

Platinum level --Cloudera, Comcast, Facebook, Google, LeaseWeb, Microsoft, Oath, Pineapple Fund, and Tencent;

Gold level --Anonymous, ARM, Bloomberg, Handshake, Hortonworks, Huawei, IBM, Indeed, Pivotal, and Union Investment;

Silver level --Aetna, Alibaba Cloud Computing, Baidu, Budget Direct, Capital One, Cerner, Inspur, ODPi, Private Internet Access, Red Hat, and Target;

Bronze level --Airport Rentals, The Blog Starter, Bookmakers, Cash Store, Casino Bonus, Casino2k, Cloudsoft, Emerio, Footprints Recruiting, HostChecka.com, HostingAdvice.com, HostPapa Web Hosting, The Linux Foundation, Mobile Slots, Mutuo Kredit, Online Holland Casino, RX-M, SCAMS.info, Site Builder Report, Talend, The Best VPN, Twitter, and Web Hosting Secret Revealed.

For more information on becoming a Sponsor of the ASF, please see http://apache.org/foundation/sponsorship.html

# # #

Wednesday January 23, 2019

The Apache Software Foundation Announces Apache® Hadoop® v3.2.0

Pioneering Open Source distributed enterprise framework powers US$166B Big Data ecosystem

Wakefield, MA —23 January 2019— The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, today announced Apache® Hadoop® v3.2.0, the latest version of the Open Source software framework for reliable, scalable, distributed computing.

Now in its 11th year, Apache Hadoop is the foundation of the US$166B Big Data ecosystem (source: IDC) by enabling data applications to run and be managed on large hardware clusters in a distributed computing environment. "Apache Hadoop has been at the center of this big data transformation, providing an ecosystem with tools for businesses to store and process data on a scale that was unheard of several years ago," according to Accenture Technology Labs.

"This latest release unlocks the powerful feature set the Apache Hadoop community has been working on for more than nine months," said Vinod Kumar Vavilapalli, Vice President of Apache Hadoop. "It further diversifies the platform by building on the cloud connector enhancements from Apache Hadoop 3.0.0 and opening it up for deep learning use-cases and long-running apps."

Apache Hadoop 3.2.0 highlights include:
  • ABFS Filesystem connector —supports the latest Azure Datalake Gen2 Storage;
  • Enhanced S3A connector —including better resilience to throttled AWS S3 and DynamoDB IO;
  • Node Attributes Support in YARN —helps to tag multiple labels on the nodes based on its attributes and supports placing the containers based on expression of these labels;
  • Storage Policy Satisfier  —supports HDFS (Hadoop Distributed File System) applications to move the blocks between storage types as they set the storage policies on files/directories; 
  • Hadoop Submarine —enables data engineers to easily develop, train and deploy deep learning models (in TensorFlow) on very same Hadoop YARN cluster;
  • C++ HDFS client —helps to do async IO to HDFS which helps downstream projects such as Apache ORC;
  • Upgrades for long running services —supports in-place seamless upgrades of long running containers via YARN Native Service API (application program interface) and CLI (command-line interface).

"This is one of the biggest releases in Apache Hadoop 3.x line which brings many new features and over 1,000 changes," said Sunil Govindan, Apache Hadoop 3.2.0 release manager. "We are pleased to announce that Apache Hadoop 3.2.0 is available to take your data management requirements to the next level. Thanks to all our contributors who helped to make this release happen."

Apache Hadoop is widely deployed at numerous enterprises and institutions worldwide, such as Adobe, Alibaba, Amazon Web Services, AOL, Apple, Capital One, Cloudera, Cornell University, eBay, ESA Calvalus satellite mission, Facebook, foursquare, Google, Hortonworks, HP, Huawei, Hulu, IBM, Intel, LinkedIn, Microsoft, Netflix, The New York Times, Rackspace, Rakuten, SAP, Tencent, Teradata, Tesla Motors, Twitter, Uber, and Yahoo. The project maintains a list of educational and production users, as well as companies that offer Hadoop-related services at https://wiki.apache.org/hadoop/PoweredBy

Global Knowledge hails, "...the open-source Apache Hadoop platform changes the economics and dynamics of large-scale data analytics due to its scalability, cost effectiveness, flexibility, and built-in fault tolerance. It makes possible the massive parallel computing that today's data analysis requires."

Hadoop is proven at scale: Netflix captures 500+B daily events using Apache Hadoop. Twitter uses Apache Hadoop to handle 5B+ sessions a day in real time. Twitter’s 10,000+ node cluster processes and analyzes more than a zettabyte of raw data through 200B+ tweets per year. Facebook’s cluster of 4,000+ machines that store 300+ petabytes is augmented by 4 new petabytes of data generated each day. Microsoft uses Apache Hadoop YARN to run the internal Cosmos data lake, which operates over hundreds of thousands of nodes and manages billions of containers per day.

Transparency Market Research recently reported that the global Hadoop market is anticipated to rise at a staggering 29% CAGR with a market valuation of US$37.7B by the end of 2023.

Apache Hadoop remains one of the most active projects at the ASF: it ranks #1 for Apache project repositories by code commits, and is the #5 repository by size (3,881,797 lines of code).

"The Apache Hadoop community continues to go from strength to strength in further driving innovation in Big Data," added Vavilapalli. "We hope that developers, operators and users leverage our latest release in fulfilling their data management needs."

Catch Apache Hadoop in action at the Strata conference, 25-28 March 2019 in San Francisco, and dozens of Hadoop MeetUps held around the world, including on 30 January 2019 at LinkedIn in Sunnyvale, California.

Availability and Oversight
Apache Hadoop software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For downloads, documentation, and ways to become involved with Apache Hadoop, visit http://hadoop.apache.org/ and https://twitter.com/hadoop

About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server --the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 730 individual Members and 7,000 Committers across six continents successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official global conference series. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Aetna, Alibaba Cloud Computing, Anonymous, ARM, Baidu, Bloomberg, Budget Direct, Capital One, Cerner, Cloudera, Comcast, Facebook, Google, Handshake, Hortonworks, Huawei, IBM, Indeed, Inspur, LeaseWeb, Microsoft, Oath, ODPi, Pineapple Fund, Pivotal, Private Internet Access, Red Hat, Target, Tencent, and Union Investment. For more information, visit http://apache.org/ and https://twitter.com/TheASF

© The Apache Software Foundation. "Apache", "Hadoop", "Apache Hadoop", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #

Tuesday January 08, 2019

The Apache Software Foundation Announces Apache® Airflow™ as a Top-Level Project

Open Source Big Data workflow management system in use at Adobe, Airbnb, Etsy, Google, ING, Lyft, PayPal, Reddit, Square, Twitter, and United Airlines, among others.

Wakefield, MA —8 January 2019— The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today Apache® Airflow™ as a Top-Level Project (TLP).

Apache Airflow is a flexible, scalable workflow automation and scheduling system for authoring and managing Big Data processing pipelines of hundreds of petabytes. Graduation from the Apache Incubator as a Top-Level Project signifies that the Apache Airflow community and products have been well-governed under the ASF's meritocratic process and principles.

"Since its inception, Apache Airflow has quickly become the de-facto standard for workflow orchestration," said Bolke de Bruin, Vice President of Apache Airflow. "Airflow has gained adoption among developers and data scientists alike thanks to its focus on configuration-as-code. That has gained us a community during incubation at the ASF that not only uses Apache Airflow but also contributes back. This reflects Airflow’s ease of use, scalability, and power of our diverse community; that it is embraced by enterprises and start-ups alike, allows us to now graduate to a Top-Level Project."

Apache Airflow is used to easily orchestrate complex computational workflows. Through smart scheduling, database and dependency management, error handling and logging, Airflow automates resource management, from single servers to large-scale clusters. Written in Python, the project is highly extensible and able to run tasks written in other languages, allowing integration with commonly used architectures and projects such as AWS S3, Docker, Apache Hadoop HDFS, Apache Hive, Kubernetes, MySQL, Postgres, Apache Zeppelin, and more. Airflow originated at Airbnb in 2014 and was submitted to the Apache Incubator March 2016.

Apache Airflow is in use at more than 200 organizations, including Adobe, Airbnb, Astronomer, Etsy, Google, ING, Lyft, NYC City Planning, Paypal, Polidea, Qubole, Quizlet, Reddit, Reply, Solita, Square, Twitter, and United Airlines, among others. A list of known users can be found at https://github.com/apache/incubator-airflow#who-uses-apache-airflow

"Adobe Experience Platform is built on cloud infrastructure leveraging open source technologies such as Apache Spark, Kafka, Hadoop, Storm, and more," said Hitesh Shah, Principal Architect of Adobe Experience Platform. "Apache Airflow is a great new addition to the ecosystem of orchestration engines for Big Data processing pipelines. We have been leveraging Airflow for various use cases in Adobe Experience Cloud and will soon be looking to share the results of our experiments of running Airflow on Kubernetes." 

"Our clients just love Apache Airflow. Airflow has been a part of all our Data pipelines created in past 2 years acting as the ring-master and taming our Machine Learning and ETL Pipelines," said Kaxil Naik, Data Engineer at Data Reply. "It has helped us create a Single View for our client's entire data ecosystem. Airflow's Data-aware scheduling and error-handling helped automate entire report generation process reliably without any human-intervention. It easily integrates with Google Cloud (and other major cloud providers) as well and allows non-technical personnel to use it without a steep learning curve because of Airflow’s configuration-as-a-code paradigm."

"With over 250 PB of data under management, PayPal relies on workflow schedulers such as Apache Airflow to manage its data movement needs reliably," said Sid Anand, Chief Data Engineer at PayPal. "Additionally, Airflow is used for a range of system orchestration needs across many of our distributed systems: needs include self-healing, autoscaling, and reliable [re-]provisioning."

"Since our offering of Apache Airflow as a service in Sept 2016, a lot of big and small enterprises have successfully shifted all of their workflow needs to Airflow," said Sumit Maheshwari, Engineering Manager at Qubole. "At Qubole, not only are we a provider, but also a big consumer of Airflow as well. For example, our whole Insight and Recommendations platform is built around Airflow only, where we process billions of events every month from hundreds of enterprises and generate insights for them on big data solutions like Apache Hadoop, Apache Spark, and Presto. We are very impressed by the simplicity of Airflow and ease at which it can be integrated with other solutions like clouds, monitoring systems or various data sources."

"At ING, we use Apache Airflow to orchestrate our core processes, transforming billions of records from across the globe each day," said Rob Keevil, Data Analytics Platform Lead at ING WB Advanced Analytics. "Its feature set, Open Source heritage and extensibility make it well suited to coordinate the wide variety of batch processes we operate, including ETL workflows, model training, integration scripting, data integrity testing, and alerting. We have played an active role in Airflow development from the onset, having submitted hundreds of pull requests to ensure that the community benefits from the Airflow improvements created at ING.  We are delighted to see Airflow graduate from the Apache Incubator, and look forward to see where this exciting project will be taken in future!"

"We saw immediately the value of Apache Airflow as an orchestrator when we started contributing and using it," said Jarek Potiuk, Principal Software Engineer at Polidea. "Being able to develop and maintain the whole workflow by engineers is usually a challenge when you have a huge configuration to maintain. Airflow allows your DevOps to have a lot of fun and still use the standard coding tools to evolve your infrastructure. This is 'infrastructure as a code' at its best."

"Workflow orchestration is essential to the (big) data era that we live in," added de Bruin. "The field is evolving quite fast and the new data thinking is just starting to make an impact. Apache Airflow is a child of the data era and therefore very well positioned, and is also young so a lot of development can still happen. Airflow can use bright minds from scientific computing, enterprises, and start-ups to further improve it. Join the community, it is easy to hop on!"

Availability and Oversight
Apache Airflow software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For downloads, documentation, and ways to become involved with Apache Airflow, visit http://airflow.apache.org/ and https://twitter.com/ApacheAirflow

About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server --the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 730 individual Members and 7,000 Committers across six continents successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official user conference, trainings, and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Aetna, Alibaba Cloud Computing, Anonymous, ARM, Baidu, Bloomberg, Budget Direct, Capital One, Cerner, Cloudera, Comcast, Facebook, Google, Handshake, Hortonworks, Huawei, IBM, Indeed, Inspur, LeaseWeb, Microsoft, Oath, ODPi, Pineapple Fund, Pivotal, Private Internet Access, Red Hat, Target, Tencent, and Union Investment. For more information, visit http://apache.org/ and https://twitter.com/TheASF

© The Apache Software Foundation. "Apache", "Airflow", "Apache Airflow", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #

Tuesday January 01, 2019

Apache in 2018 - By The Digits

It's been a great year for the Apache community at-large. With nearly 200M lines of code under the ASF's stewardship, our ongoing success is the result of community-led development "The Apache Way", executed through the collaborative efforts of more than 300 Apache projects and their communities. Highlights include:

Apache Projects https://projects.apache.org/
  • Total number of projects + sub-projects - 328 (not including Apache Labs initiatives)
  • Top-Level Projects - 198
  • Podlings in the Apache Incubator - 51
  • Other groups, including operations/support - 62

Community/People —http://home.apache.org/
  • Apache Committers - 7,032 (6,693 active)
  • ASF Members (individuals) - 730
  • New Members elected - 44

Apache Projects/Code —https://projects.apache.org/statistics.html

3,208 Apache Committers changed 78,493,228 lines of code over 201,220 commits. We also  welcomed 4,638 new code contributors and 15,861 new issue/pull request contributors.

 Top 5 Apache Code Committers 

  1. Andrea Cosentino (2,508 commits; 237,224 lines changed)
  2. Jean-Baptiste Onofré (2,098 commits; 1,208,851 lines changed)
  3. Duo Zhang (1,956 commits; 809,085 lines changed)
  4. Mark Thomas (1,823 commits; 179,883 lines changed)
  5. Tilman Hausherr (1,736 commits; 81,940 lines changed)

Top 5 Apache Project Repositories by Commits
  1. Hadoop
  2. HBase
  3. Beam
  4. Camel
  5. Flink
Top 5 Apache Project Repositories by Size (Lines of Code)
  1. OpenOffice (7,822,699)
  2. NetBeans (7,741,506)
  3. Flex (whiteboard: 5,233,722; SDK 3,933,522)
  4. Mynewt (documentation: 4,381.072)
  5. Hadoop (3,881,797)

"If it didn't happen on-list, it didn't happen." https://lists.apache.org/
  • Total number of mailing lists 1,131
  • 19,435 authors sent 1,497,005 emails on 505,793 topics
Top 5 most active Apache user@ mailing lists
  1. Flink
  2. Lucene
  3. Ignite
  4. Cassandra
  5. Kafka
Top 5 most active Apache dev@ mailing lists
  1. Beam
  2. Ignite
  3. Kafka
  4. Tomcat
  5. James

Contributor License Agreements and Software Grants —https://www.apache.org/licenses/

We welcomed an average of 387 new code contributors and 1,250 new people filing issues each month. Individuals who are granted write access to the Apache repositories must submit an Individual Contributor License Agreement (ICLA). Corporations that have assigned employees to work on Apache projects as part of an employment agreement may sign a Corporate CLA (CCLA) for contributing intellectual property via the corporation. Individuals or corporations donating a body of existing software or documentation to one of the Apache projects need to execute a formal Software Grant Agreement (SGA) with the ASF. 
  • ICLAs signed - 831
  • CCLAs signed - 35
  • Software Grants submitted - 25

Sponsorship and Individual Support —http://apache.org/foundation/contributing.html

Thank you to our hundreds of individual donors and Sponsors whose generous support helps offset the ASF's day-to-day operating expenses that include Infrastructure, Accounting, Fundraising, Marketing & Publicity, and more.
  • Platinum: Cloudera, Comcast, Facebook, Google, LeaseWeb, Microsoft, Oath, Pineapple Fund, and Tencent Cloud.

  • Gold: Anonymous, ARM, Bloomberg, Handshake, Hortonworks, Huawei, IBM, Indeed, Pivotal, and Union Investment.

  • Silver: Aetna, Alibaba Cloud Computing, Baidu, Budget Direct, Capital One, Cerner, Inspur, ODPi, Private Internet Access, Red Hat, and Target.

  • Bronze: Airport Rentals, Best VPN, The Blog Starter, Bookmakers, Cash Store, Casino Bonus, Casino2k, Cloudsoft, Emerio, Footprints Recruiting, HostChecka.com, HostingAdvice.com, HostPapa Web Hosting, The Linux Foundation, Mobile Slots, Mutuo Kredit AG, Online Holland Casino, RX-M, SCAMS.info, Site Builder Report, Talend, The Best VPN, Twitter, and Web Hosting Secret Revealed.

ASF Targeted Sponsors provide the Foundation with contributions for specific activities or programs.
  • Targeted Platinum: DLA Piper, Microsoft, Oath, OSU Open Source Labs, and Sonatype.

  • Targeted Gold: Atlassian, The CrytpoFund, Datadog, PhoenixNAP, and Quenda.

  • Targeted Silver: Amazon Web Services, HotWax Systems, and Rackspace.

  • Targeted Bronze: Bintray, Education Networks of America, Google, Hopsie, No-IP, PagerDuty, Peregrine Computer Consultants Corporation, Sonic.net, SURFnet, and Virtru.


Together, our Members, Committers, contributors, users, supporters, and sponsors continue to build on our mission of providing Open Source software for the public good and are helping keep Apache software accessible to everyone.

Wishing you the best in 2019!

# # #

Wednesday December 12, 2018

The Apache Software Foundation Announces Apache® Griffin™ as a Top-Level Project

Open Source Big Data quality solution in use at eBay, Expedia, Huawei, JD.com, Meituan, PayPal, Pingan Bank, PPDAI, VIP.com, VMWare, and more.

Wakefield, MA —12 December 2018— The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today Apache® Griffin™ as a Top-Level Project (TLP).

Apache Griffin is a robust Open Source Big Data quality solution for distributed data systems at any scale. It provides a unified process to measure data quality from different perspectives, as well as building and validating trusted data assets in both streaming or batch contexts. Griffin originated at eBay and entered the Apache Incubator in December 2016.

"We are very proud of Griffin reaching this important milestone," said William Guo, Vice President of Apache Griffin. "By actively improving Big Data quality, Griffin helps build trusted data assets, therefore boosting your confidence in your business." 

Apache Griffin enables data scientists/analysts to handle data quality issues by:
  • Defining –specifying data quality requirements such as accuracy, completeness, timeliness, profiling, etc.;

  • Measuring –source data ingested into the Griffin computing cluster will apply data quality measurement based on user-defined requirements; and

  • Applying Metrics –data quality reports as metrics will be exported to designated destination.

In addition, Griffin allows users to easily onboard new requirements into the platform and write comprehensive logic to further define their data quality. 

Apache Griffin is in use in high volume, high demand environments at 163.com/Netease, eBay, Expedia, Huawei, JD.com, Meituan, PayPal, Pingan Bank, PPDAI, VIP.com, and VMWare, among others.

"eBay contributed Griffin to the Apache Incubator in December 2016 to ensure its future development in a community-driven manner. It started with the idea on how eBay could address the data quality issue across multiple systems, especially in streaming context," said Vivian Tian, VP of eBay, GM - China Center of Excellence. "Griffin brings data quality solution to data ecosystem and ensure data applications have a solid quality foundation. We are extremely happy to see Griffin graduate as an Apache Top Level Project, and look forward to continued innovation and collaboration with the Apache community."

"We have been using Apache Griffin for about two years, monitoring 1000+ tables with data quality metrics, and are very happy to see it graduate to a Top-Level Project," said Chao Zhu, Senior Director at VIPshop Finance. "Apache Griffin and its data quality DSL can help us easily identify data quality issues instantly on our big data platform. In addition, Apache Griffin's architecture is highly extensible. We are looking forward to using it in real time data quality management system. We also look forward to contribute some of our minor enhancement to Griffin back to the community."

"We appreciate the Griffin project which really helps so much in our daily data jobs.After years of struggling with the complexity of data quality issues, we turned to Apache Griffin for a new platform that would simplify our data quality pipeline," said Jianfeng Liu, Director of Real-time Data Department at PPDAI. "Because of Apache Griffin's unified model for both batch and stream processing, we've been able to replace legacy systems with one solution that works seamlessly in our production environment. Griffin DSLs have allowed us to dramatically simplify our pipeline and to reduce our efforts a lot. I'm very proud and excited to see that the project is graduating."

"Apache Griffin is one of the best data quality solutions which my team has been used so far. It has been an exciting journey seeing the Griffin community evolve rapidly. And many people iteratively adopting it and contributing to newer capabilities," said Austin Sun, Senior Engineering Manager, Enterprise Service Platform at PayPal. "In PayPal risk domain, we benefit a lot from Apache Griffin to provide high quality data to make precise decision and protect our customer. In addition to PayPal risk, I knew there are several other corporates also leverages core capability from Griffin as their data quality solution. It’s my great honor to witness Griffin grows to a top level project. Way to go, Griffin."

"Apache Griffin project is yet another showcase how community over code can work for projects coming out from internal usages of companies into the open source," said Henry Saputra, ASF member and Incubator Mentor for Apache Griffin. "I am proud to be the part of the projects and mentors for the project when it was being contributed from eBay, in addition to several other projects already donated to ASF such as Apache Kylin and Eagle. The team has worked tremendously hard to adapt the Apache Way, and also shown great respect for the open source community in all the processes for design, development, and release processes.As a Top-Level Project I believe the PMC will help lead the project to much more success in the future."

"Graduation is not the end, it is the beginning of another journey. We hope to take Apache Griffin to the next level with a wider set of features and users," added Guo. "We welcome anyone to join our efforts by helping with product design, documentation, code, technical discussions or promoting Apache Griffin in The Apache Way."

Availability and Oversight
Apache Griffin software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For downloads, documentation, and ways to become involved with Apache Griffin, visit http://griffin.apache.org/ and https://twitter.com/apachegriffin

About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server --the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 730 individual Members and 6,800 Committers across six continents successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official user conference, trainings, and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Aetna, Alibaba Cloud Computing, Anonymous, ARM, Baidu, Bloomberg, Budget Direct, Capital One, Cerner, Cloudera, Comcast, Facebook, Google, Handshake, Hortonworks, Huawei, IBM, Indeed, Inspur, LeaseWeb, Microsoft, Oath, ODPi, Pineapple Fund, Pivotal, Private Internet Access, Red Hat, Target, Tencent, and Union Investment. For more information, visit http://apache.org/ and https://twitter.com/TheASF

© The Apache Software Foundation. "Apache", "Griffin", "Apache Griffin", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #

Thursday November 29, 2018

The Apache Software Foundation Operations Summary: August - October 2018

FOUNDATION OPERATIONS SUMMARY

Second Quarter, Fiscal Year 2019 (August - October 2018)

"There have been no signs Apache will stop growing."
Nick Ismail, InformationAge

> Conferences and Events: During Q2, we conducted one event, and were in the midst of planning three others.

  • ApacheCon North America 2018, September 24-27 | Montreal, Canada — This event was our 30th ApacheCon, and celebrated the 20th anniversary of the first ApacheCon in San Francisco in 1998. This was an intentionally smaller event, produced mostly in house, with the assistance of volunteer producer Ruth Suehle, as well as a cast of characters from around the Foundation. We had roughly 350 in attendance, and were able to turn a small profit on the entire venture. Video from the event may be viewed at https://s.apache.org/oUA1 (Keynotes) and audio from the event may be found at https://feathercast.apache.org/ (the rest of the presentations). Keynotes included Cliff Schmidt, Myrle Krantz, Bridget Kromhout, and Dave Neuman, and Fred Reiss, all of whom delivered inspiring talks about the role of open source in making the world a better place, with an emphasis on how open source helps the underprivileged of the world. Bertrand Delacretaz delivered the traditional State Of The Feather address on behalf of the Foundation.

  • Apache North America Road Show, December 4 | Fairfax, VA — During this quarter, we were actively working towards the Apache North America Roadshow, which will be held at George Mason University on December 4th of this year. This event is led by Kevin McGrail, in conjunction with GMU. You can read more about this event at http://www.apachecon.com/usroadshow18/

  • ApacheCon North America 2019 — During this quarter we were investigating venues for ApacheCon North America 2019, which will celebrate the 20th anniversary of the ASF. We expect to announce dates and venue in the coming quarter.

  • ApacheCon EU 2019 — During this quarter we were in discussion with a producer in Europe for the production of ApacheCon EU 2019, which is tentatively planned to be in Berlin. Details, dates, and venue should be announced in the coming quarter.


Sponsorship: as always, if you are interested in sponsoring ApacheCon, or other Apache events, we encourage you to get in touch with the sponsorship team, who can provide you with all active prospectuses at that time.

> Community Development: During this quarter our focus was helping prepare for and support ApacheCon NA in Montreal as well as participation in various other events.

During August one of our key activities was coordinating and setting up a central logo page and repository for high resolution logos for every single ASF project http://www.apache.org/logos/ . It was a great way to collaborate with all our projects on achieving a common goal. We now have the most recent versions of all ASF project logos available in various formats. Feedback and participation from projects was extremely positive and we now have a great resource for communities to use for marketing materials as well as reinforcing the Apache brand.

Our main focus in September was to help provide support for ApacheCon NA in Montreal. As usual we coordinated the Apache booth which is always a popular central meeting place throughout the conference. As well as speaking to conference attendees, we also had promotional material and giveaways.

We are continuing to be active in external events. During September we participated at Solutions Hamburg and for the first time had an Apache booth at the event. Once again we received very positive feedback and interest from attendees wanting to learn more about ASF activities. 

It has been nearly two years since we ran the Committer Diversity survey and in October we started discussions around re-running it. The community has been very positive and are very supportive of organizing another survey to understand how and if committer diversity has changed. It is hoped to get this done during the next quarter.

We are still receiving many requests to participate at various events and are looking running smaller Apache Roadshow style events as a way to reach audiences that may not have the capacity to attend ApacheCon.

Our mailing list subscriptions have increased this quarter and traffic is also higher reflecting the continued participation and interest, our discussions have created.

> Committers and Contributions: Over the past quarter, 1,656 contributors committed 50,346 changes that amount to 17,789,994 lines of code across Apache projects. The top 5 contributors during this timeframe were: David Moravek (920 commits), Radu Cotescu (718 commits), Andrea Cosentino (561 commits), Derek Gelinas (484 commits), and Jean-Baptiste Onofré (483 commits).

All individuals who are granted write access to the Apache repositories must submit an Individual Contributor License Agreement (ICLA). Corporations that have assigned employees to work on Apache projects as part of an employment agreement may sign a Corporate CLA (CCLA) for contributing intellectual property via the corporation. Individuals or corporations donating a body of existing software or documentation to one of the Apache projects need to execute a formal Software Grant Agreement (SGA) with the ASF. 

During Q1 FY2019, the ASF Secretary processed 182 ICLAs, 12 CCLAs, and 4 Software Grants. History of Apache committer growth can be seen at https://projects.apache.org/timelines.html

> Brand Management: Operations — The work of the Brand Management team falls broadly into one of three categories:

  • trademark transfers and registrations
  • granting permission to use our marks
  • addressing potential infringements of our marks

The volume of work has remained steady this quarter. Registrations and transfers are lengthy processes and the previous work to put in place a task tracking system continues to pay dividends. 

This quarter has seen the usual collection of requests to use Apache marks for user groups, events, merchandise and publications with nearly all requests being granted, subject to our Trademark Usage Policy. 

Registrations — The transfer of the NETBEANS mark in the EU completed this quarter. The transfer of the US registration is still in progress. We also also working on the agreements to transfer the marks associated with a number of other podlings. These typically span multiple jurisdictions so can take a while to complete.

We are working with counsel to address a number of external registrations that overlap with our own. While progress is being made, this too is a lengthy process and we expect that the issues currently being worked on will not be resolved until well into next calendar year.

Infringements Potential infringements are brought to our attention from both internal and external sources. The majority of infringements we see are accidental and our project communities are able to resolve these quickly and informally with occasional input from the Brand Management team. A small number of issues take longer to resolve. After last quarter's successes in resolving two of these more complex issues, this quarter has seen a small uptick in the number of complex issues we are tracking.

And finally…The Brand Management team  welcomes your comments and suggestions as well as any questions you might have. Please see https://www.apache.org/foundation/marks/contact for our contact details.


> Infrastructure:
 Infrastructure had a great quarter, as this was our yearly gathering at ApacheCon. This year, it was held in Montreal, and we arrived from all corners to discuss work, do some team bonding, and knock out a large number of action items helped by sitting across the table from each other.

Our most interesting item this quarter is that we posted a job opening, and will be working to hire additional teammates. Our last round of hiring was two years ago, yet with the growth of the Foundation, the additional help is very much needed.

The rest of the quarter has been spent with typical activity, across Jenkins, email and gitbox. Jenkins saw a lot of work focusing on disk space issues, the new master we deployed last quarter, and continued upgades to support the many projects using Jenkins. We made significant progress on preparing our new email infrastructure, to move us away from decade-old hardware and a tricky software install. Email is such a critical service to our communities, that we are approaching this migration process with the utmost care. Lastly, we improved many features around our "gitbox" service (close integration with GitHub), such that we hope to migrate all projects within the next quarter or two, and decommission our old git servers.

> Financial Statement:



> Fundraising:
 The Fundraising team has continued building upon the success of previous quarters. We are happy to report that event fundraising is nearly complete for the year and we are ahead of projected budget.

We are delighted to announce Tencent has joined us as a platinum sponsor as well as the return of Alibaba as a silver sponsor this quarter. 

In late September we added three new ambassadors/sponsor relations team members:

  • Ted Liu
  • Craig Russell
  • Bob Paulin

ApacheCon NA 2018 was a wonderful opportunity to meet personally with sponsors and friends of the foundation. We thank those who attended the sponsor lunch as well as everyone who made the event such a success!

We continue to drive out efficiencies in our procedures and systems. The team has begun working on system integrations to automate access to data managed by the Fundraising team. We also continue to watch for and drive out fraudster use of the individual donation platform (Hopsie). Focus on maturing our sponsor relations practice and procedures continues as well.

The recently published targeted sponsorship policy continues to evolve. We have added notes indicating that endorsements are not acceptable per the policy and are working on a draft of a revised policy after feedback and conversation since initial publishing. More to come soon!

The finance team has been considering ideas for securing our financial future via establishing some sort of restricted fund or endowment. Because our sponsors are so important to us, we reached out to several seeking thoughts and opinions. We are happy to report that the feedback was positive and highly valuable. More discussions with sponsors may come as we continue to support the finance team in their evaluations.

= = = 

Thank you to all our Sponsors!

  • PLATINUM: Cloudera, Comcast, Facebook, Google, LeaseWeb, Microsoft, Pineapple Fund, Oath, Tencent
  • GOLD: Anonymous, ARM, Bloomberg, Handshake, Hortonworks, Huawei, IBM, Indeed, ODPi, Pivotal
  • SILVER: Aetna, Alibaba Cloud Computing, Baidu, Budget Direct, Capital One, Cerner, Inspur, Private Internet Access, Red Hat, Target, Union Investment
  • BRONZE: Airport Rentals, Best VPN, The Blog Starter, Bookmakers, Cash Store, Casino Bonus, Casino2k, Cloudsoft, Emerio, HostChecka.com, HostingAdvice.com, HostPapa Web Hosting, The Linux Foundation, Mobile Slots, SCAMS.info, Site Builder Report, Talend, The Best VPN, Twitter, Web Hosting Secret Revealed
  • TARGETED PLATINUM: DLA Piper, Microsoft, Oath, OSU Open Source Labs, Sonatype
  • TARGETED GOLD: Atlassian, The CrytpoFund, Datadog, PhoenixNAP, Quenda
  • TARGETED SILVER: Amazon Web Services, HotWax Systems, Rackspace
  • TARGETED BRONZE: Bintray, Education Networks of America, Google, Hopsie, No-IP, PagerDuty, Peregrine Computer Consultants Corporation, Sonic.net, SURFnet, Virtru 

To Sponsor The Apache Software Foundation, visit http://apache.org/foundation/sponsorship.html . To make a one-time or monthly recurring donation, please visit https://donate.apache.org/

# # #

Report prepared by Sally Khudairi, Vice President Marketing & Publicity, with contributions by Rich Bowen, Vice President Conferences; Sharan Foga, Vice President Community Development; Mark Thomas, Vice President Brand Management; Greg Stein, ASF Infrastructure Administrator; Tom Pappas, Vice President Finance; and Daniel Ruggeri and Kevin McGrail, Vice Presidents Fundraising.

For more information, subscribe to the announce@apache.org mailing list and visit http://www.apache.org/, the ASF Blog at http://blogs.apache.org/, the @TheASF on Twitter, and https://www.linkedin.com/company/the-apache-software-foundation.

(c) The Apache Software Foundation 2018.

Tuesday November 27, 2018

Support Apache: Individual Giving and Corporate Gifts Campaigns

Giving Tuesday is here, kicking off our end-of-year Individual Giving and Corporate Gifts campaigns.


It's one of our favorite times of the year, as giving back feels so good. Here's how you can help:

Individual Donations.

  • Giving to Apache is easy! Click https://donate.apache.org/ to make a one-time or monthly recurring donation using a debit/credit card, ACH electronic transfer, or PayPal. You'll also receive a receipt for your tax-deductible contribution via email.

  • Purchasing Programs. Those of you who shop from Amazon can start your retail journey at https://smile.amazon.com/ so a portion of your purchase will be donated to the ASF. Now that's smart shopping!

  • Additional Options. If you'd rather mail us a check or send a Bitcoin donation or explore other contribution options, please visit http://apache.org/foundation/contributing.html

Corporate Gifts.

Employers of all sizes can feel good as well! This includes companies such as:

  • Bloomberg, whose employee volunteer and giving program provides numerous service opportunities year-round for a wide variety of philanthropic activities. Employees who have earned 25 or 50 hours of volunteer time can request that a donation of $2,500 or $5,000 be made to their select charity with whom has an established relationship Bloomberg Philanthropies. This is the second year that the ASF is among the candidate organizations that employees can donate their hours to as part of their "Dollars For Your Hours" program.

  • Microsoft, who works through volunteer matching platform Benevity to allow their developers to contribute to Open Source projects and communities that they are passionate about. The program donates $25 per volunteer hour, which enables Microsoft developers to contribute back to the ASF while logging hours towards for matching. The Apache Software Foundation has benefited from this and their "Tech Talent for Good" program for several years.

Some organizations contribute to the ASF in the form of a cash donation --whether it's a one-time gift or recurring monthly made at https://donate.apache.org/ , or a matching gifts program, where the company matches the financial donation of an employee to the ASF. We have received contributions that reflected dollar-for-dollar matches, sometimes multiple times the contribution made by employees.

Corporate Sponsorship is also a great way to support the ASF on an annual basis. Those wishing to quickly become a Sponsor using a credit card, ACH transfer, or PayPal may easily do so at https://donate.apache.org/ ; otherwise we invite interested parties to review our Sponsorship program at http://apache.org/foundation/sponsorship.html or contact us at fundraising(at)apache(dot)org.

We thank you in advance for your generous consideration. Through your support, the ASF is able to continue to develop, incubate, and steward 350+ Open Source projects and their communities and keep Apache for everyone. For more information on the ASF's operations and how we put your donated dollars at work, please see our Annual Report for FY2018 https://s.apache.org/FY2018AnnualReport .

# # # 

Wednesday October 31, 2018

The Apache Software Foundation Announces Apache® Subversion® v1.11.0

Popular Open Source version control system used by millions across an array of applications worldwide.

Wakefield, MA —31 October 2018— The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today Apache® Subversion® v1.11.0, the latest version of the popular centralized software version control system.

Apache Subversion is characterized by its reliability as a safe haven for valuable data; the simplicity of its model and usage; and its ability to support the needs of a wide variety of users and projects, from individuals to large-scale enterprise operations.

"Subversion 1.11 is the first release which follows our new six-month release cycle," said Stefan Sperling, Vice President of Apache Subversion. "Subversion 1.11 provides iterative improvements of features released in Subversion 1.10, and will be supported for six months."

Apache Subversion v1.11.0 highlights include:

  • More robust shelving of changes in the working copy;
  • Interactive conflict resolution supports more conflict situations involving moved files and directories; and
  • New command to write out a view specification describing the current working copy shape.


Based on the new release cycle, Apache Subversion 1.10 is now considered a long-term support (LTS) release, with a planned support period of four years. The next LTS release will be Subversion 1.14, which is anticipated 18 months from now.

"Our new release plan gives users who value stability plenty of time to schedule upgrades between LTS releases, while users who prefer quick access to new features will be able to get updated approximately every 6 months," added Sperling. "Several new client-side features are marked ‘experimental’ in this 1.11 release. We encourage all our users to test these features and provide feedback."

Availability and Oversight
Apache Subversion software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For downloads, documentation, and ways to become involved with Apache Subversion, visit http://subversion.apache.org/

About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server --the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 730 individual Members and 6,800 Committers across six continents successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official user conference, trainings, and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Aetna, Anonymous, ARM, Bloomberg, Budget Direct, Capital One, Cerner, Cloudera, Comcast, Facebook, Google, Handshake, Hortonworks, Huawei, IBM, Indeed, Inspur, LeaseWeb, Microsoft, Oath, ODPi, Pineapple Fund, Pivotal, Private Internet Access, Red Hat, Target, and Union Investment. For more information, visit http://apache.org/ and https://twitter.com/TheASF

© The Apache Software Foundation. "Apache", "Subversion", "Apache Subversion", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #

Wednesday October 24, 2018

The Apache Software Foundation Announces Apache® ServiceComb™ as a Top-Level Project

Open Source microservices framework in use at CeeWa Intelligent Technology, Huawei Cloud, iSoftStone, itcast, MedSci Medicine, Pactera, PICC, Tongji University, among others.

Wakefield, MA —24 October 2018— The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today Apache® ServiceComb™ as a Top-Level Project (TLP).

Apache ServiceComb is an Open Source microservices software framework that enables developers to easily build and manage microservices-based applications efficiently and conveniently. The project was originally developed at Huawei and was donated to the Apache Incubator in November 2017.

"We are very proud that ServiceComb has arrived at this important milestone," said Willem Jiang, Vice President of Apache ServiceComb. “ServiceComb has evolved from a microservices software development kit to a full microservices solution in less than a year. While incubating in Apache, the number of ServiceComb users grew rapidly, and new developers are constantly coming in. It is amazing to grow at such a high rate."

As a one-stop microservices solution, Apache ServiceComb contains 3 sub-projects:
  1. Java-Chassis - an out-of-the-box Java microservices SDK that includes four parts: service contract, programming model, running model and communication model, with a complete set of microservices governance abilities such as load balancing, fallback, rate limiting, and call stack tracing. Microservices governance and business logic are isolated.

  2. Service-Center - a high-performance, highly available, stateless Golang implementation of the Service Discovery and Registration Center based on Etcd, which provides real-time service instance registration, real-time service instance notification, and inter-service testing based on contract.

  3. Saga - provides an eventual consistency solution for distributed transactions which could be a pain point of microservices.

Apache ServiceComb's highlights include:
  • Asynchronous kernel - both synchronous and asynchronous programming models based on VertX effectively ensures high performance and low latency, both in traditional enterprise applications or in emerging businesses such as e-commerce, Internet, and IoT, to avoid avalanche effect when reaching peak loads.

  • Out-of-the-box experience - developers using the scaffolding website start.servicecomb.io, can launch microservices-based projects with integrated service registration, discovery, communication and microservices governance capabilities, and centralized configuration by default.

  • Open API - automatic code generation and isolating logic code from governance streamlines the DevOps pipeline, enabling different teams to efficiently and independently develop and manage code, test, and document using bidirectional contract files and OpenAPI.

Apache ServiceComb is in use at dozens of organizations, including CeeWa Intelligent Technology, Huawei Cloud, iSoftStone, itcast, MedSci Medicine, Pactera, PICC, and Tongji University, among others.

"In 2015, Huawei Cloud launched microservices-related services, and this is the original code base of ServiceComb," said Liao Zhenqin, General Manager of Huawei Cloud PaaS Product Department. "Apache ServiceComb is the core of Huawei Cloud microservices engine CSE. It is the defacto standard at Huawei, and is widely used on many major products, including Huawei Consumer Cloud, Huawei Cloud Core, Huawei EI, among others. We are very happy to see ServiceComb's rapid progress at in the Apache Incubator, and encourage more engineers to continue to accept and contribute to Open Source by becoming a part of the Apache Software Foundation volunteer community."

Huawei Consumer Cloud depends on Apache ServiceComb's high performance, low latency, and asynchronous technology to implement a 1,500+ node scale microservices that supports 400 million online mobile phone users. Using ServiceComb, the queries-per-second more than doubled, while reducing latency by 45%.

"We use Apache ServiceComb to build our 'intelligent brain' for drone control. ServiceComb is an out-of-the-box microservices solution, which provides the microservices governance abilities without any coding," said Zhou Sujian,  Chief Architect of CeeWa Intelligent Technology. "Compared with using or implementing a traditional RPC framework, a lot of development resources are saved. With ServiceComb, both the team development and the node deployment efficiency are doubled, which are very exciting. We are also very happy to see ServiceCombs work on integrating Open Source distributed tracing systems such as Apache Zipkin, Apache SkyWalking and Prometheus, which greatly improved our cross-node chain tracing ability, and the team's efficiency to locate and solve problems."

"As microservices architecture is not a single-point technical issue, we need to response the rapid change of technology, organization, and processes flow," said Bao Yongwei, Vice President of Product Engineering Center at iSoftstone Smart City Technology. "Apache ServiceComb Java-Chassis does a good job, its core is implemented entirely on service contract which is based on OpenAPI that can help us automatically generate service skeleton code. This allows our teams to smoothly integrate our Smart City business system into microservices. We are very happy to see that our employees actively participate in the ServiceComb project and learned the Apache Way of open development with the Apache community. Apache ServiceComb is a star project, we strongly believe that participating in the ServiceComb community will help improve our software engineers' abilities."

"Apache ServiceComb has a solid community and a comprehensive technology background. The project's commitment to making it easier for enterprises to embrace microservices and cloud computing is impressive," said Yu Yang, Dean of itcast Institute. "Itcast selected ServiceComb as a microservices technology teaching material for education and training based on its good concepts on microservices design, excellent technical practice and perfect community documentation."

"Graduating as an Apache Top-Level Project demonstrates that all contributors have a place with Apache ServiceComb, whether they were part of the project before it arrived at the Apache Incubator or joined the community during the incubation process," added Jiang. "It is a pleasure to collaborate with volunteers in this open, equal, and diverse environment. We welcome new ServiceComb contributors to help with code development,  evangelizing on innovations in microservices, promoting community development 'the Apache Way', and other ways of participating."

Availability and Oversight
Apache ServiceComb software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For downloads, documentation, and ways to become involved with Apache ServiceComb, visit http://servicecomb.apache.org/ and https://twitter.com/ServiceComb

About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server --the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 730 individual Members and 6,800 Committers across six continents successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official user conference, trainings, and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Aetna, Anonymous, ARM, Bloomberg, Budget Direct, Capital One, Cerner, Cloudera, Comcast, Facebook, Google, Handshake, Hortonworks, Huawei, IBM, Indeed, Inspur, LeaseWeb, Microsoft, Oath, ODPi, Pineapple Fund, Pivotal, Private Internet Access, Red Hat, Target, and Union Investment. For more information, visit https://apache.org/ and https://twitter.com/TheASF

© The Apache Software Foundation. "Apache", "ServiceComb", "Apache ServiceComb", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #

Tuesday October 23, 2018

The Apache Software Foundation Announces Apache® HTTP Server v2.4.37

Milestone release of world’s most popular Web server now faster, more secure, and more efficient with TLS and OpenSSL support

Wakefield, MA —23 October 2018— The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today Apache® HTTP Server 2.4.37, the latest version of the world's most popular Web server.

Apache HTTP Server is an Open Source HTTP server for modern operating systems that include UNIX, Microsoft Windows, Mac OS X, and Netware. For more than 23 years, the award-winning server software has been lauded as a secure, efficient, and extensible server that provides HTTP services observing the current HTTP standards.

"The Apache HTTP Server 2.4.37 represents a continuing marvel of a journey through Open Source history," said Daniel Gruno, Vice President of Apache HTTP Server. "More than four thousand people have contributed directly to the project during its lifetime, and one dare say many more will contribute, as we continue a steady pace at the very forefront of Web server software engineering."

Apache HTTP Server v2.4.37 features Transport Layer Security (TLS) 1.3 support when linked with a supporting OpenSSL (software library/toolkit for the TLS and Secure Sockets Layer protocols). Highlights include:
  • Improved Speed —shorter handshake time for quicker connections;
  • Enhanced Security —removed/deprecated less secure features for protection now and into the future; and
  • Upgraded Efficiency —integrated state-of-the-art protocols such as TLS 1.3 with HTTP/2 for reduced overhead and added performance.

The full list of new features and changes is available in the project release notes at https://www.apache.org/dist/httpd/CHANGES_2.4

"Keeping pace with the major browsers and servers, this release is another step in our collective journey to a more secure Internet," said Daniel Ruggeri, Apache HTTP Server committer and v2.4.37 Release Manager. "We are in an exciting time in the Web technology space, and are proud to keep a great server on top of its game. We look forward to feedback and shipping more releases with killer features!"

The Apache HTTP Server has long been the server of choice for Websites of all sizes, and played an integral role in the growth of the commercial development of the World Wide Web. It remains the most popular Web server on the planet since April 1996.

"If I had to pinpoint the number one feature of the Apache HTTP Server Project and its long successful run, it is the community and self-driving mechanisms," added Gruno. "For nearly two decades, our community-first focus has given people the ability to come to us with a problem they need to solve, or piece of new technology that makes sense to them, and work with the community towards that goal —independent from who they are or who they work for or represent— and have it implemented and released with the The Apache Software Foundation guarding their backs. We encourage those in the HTTP sphere with an itch to scratch to step forward and leverage this advantage as we continue to serve the users of the Apache HTTP Server."

Availability and Oversight
Apache HTTP Server software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For downloads, documentation, and ways to become involved with Apache HTTP Server, visit https://httpd.apache.org/ and https://twitter.com/apache_httpd

About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server --the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 730 individual Members and 6,800 Committers across six continents successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official user conference, trainings, and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Aetna, Anonymous, ARM, Bloomberg, Budget Direct, Capital One, Cerner, Cloudera, Comcast, Facebook, Google, Handshake, Hortonworks, Huawei, IBM, Indeed, Inspur, LeaseWeb, Microsoft, Oath, ODPi, Pineapple Fund, Pivotal, Private Internet Access, Red Hat, Target, and Union Investment. For more information, visit https://apache.org/ and https://twitter.com/TheASF

© The Apache Software Foundation. "Apache", "Apache HTTP Server", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #

Tuesday September 25, 2018

The Apache Software Foundation Announces Apache® Pulsar™ as a Top-Level Project

Open Source distributed publish-and-subscribe messaging system in use at MercadoLibre, Oath, One Click Retail, STICorp, TaxiStartup, Yahoo Japan Corporation, and Zhaopin.com, and more.

Wakefield, MA —25 September 2018— The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today Apache® Pulsar™ as a Top-Level Project (TLP).

Apache Pulsar is a next-generation, Open Source distributed publish-and-subscribe messaging system designed for scalability, flexibility, and no data loss.

"We are very proud of Pulsar reaching this important milestone. This is the testament to all work done over the years by all the contributors, before and after starting our journey within The Apache Software Foundation," said Matteo Merli, Vice President of Apache Pulsar. "During the incubation process, it has been amazing to see the community grow and the project mature at such a high pace. The last year has seen the evolution of Pulsar from a its original messaging core into an integrated platform for data in motion. We are thrilled to continue drive the innovation in this exciting and fast moving space."

Pulsar is a highly scalable, low latency messaging platform running on commodity hardware. It provides simple pub-sub and queue semantics over topics, lightweight compute framework, automatic cursor management for subscribers, and cross-datacenter replication. The project was originally developed at Yahoo (now part of Oath), and was submitted to the Apache Incubator June 2017. 

The initial goal for Pulsar was to create a multi-tenant scalable messaging system that could serve as a unified platform for a wide set of very demanding use cases. Thanks to the original design we have been able to iterate and expand the scope of the project, adding lightweight compute and a connector frameworks that allow users to process data and integrate with external systems, all from within Pulsar. 

The unique architecture of Pulsar, which separates the serving and storage layers, leveraging Apache BookKeeper as the storage component, has proven to be a key strong point. The two layers architecture enables Pulsar to offer a vastly simplified approach to the cluster operations, allowing operators to easily expand clusters and replace failed nodes, or by providing a much higher write and read availability. 

Apache Pulsar is in use at MercadoLibre, Oath, One Click Retail, STICorp, TaxiStartup, Yahoo Japan Corporation, and Zhaopin.com, among others.

"Launching Pulsar at Yahoo in 2015, our goal has always been to make Pulsar widely used and well-integrated with other large-scale open source software," said Joe Francis, Director, Storage and Messaging, Oath. "We are excited for Pulsar's graduation and to see the growth of its vibrant open-source developer community within The Apache Software Foundation. At Oath we run Apache Pulsar at scale across many major products — including Yahoo Mail, Yahoo Finance, Yahoo Sports and Oath Ad Platforms — and in multiple data centers across the globe, with full mesh replication. Pulsar will continue to be an integral part of our tech stack, in streaming and also as a bridge between public and private clouds in our hybrid cloud strategy."

"At Zhaopin.com, we have used Apache Pulsar to build our enterprise event bus, because it has many enterprise features to address the shortcomings of existing messaging systems, such as message durability, low latency," said Hui Li, Director of Infrastructure Group at Zhaopin. "We also contributed a few exciting features to Pulsar, and are planning to work with the community to contribute more. It's been thrilling to watch the community grow, and I'm very proud and excited to see that the project is graduating. Pulsar has a bright future, and I'm looking forward to what's to come."

"We have used Apache Pulsar as a centralized pub-sub messaging platform for many of our services/applications. It has remarkable features; multi-tenancy and horizontal scalability that allows us to deal with a large number of services/applications on a single system, and durability, high throughput and low latency bring reliable real-time pub-sub messaging to users," said Nozomi Kurihara, Manager of Messaging Platform team at Yahoo Japan Corporation. "We're very excited with the graduation of Pulsar, and strongly believe it will play a significant role in the next generation of stream processing. We will continue to contribute by sending more pull-requests and by holding community events etc. in our aspirations for continued growth."

"After two years of struggling with the complexity of other technologies, we turned to Apache Pulsar for a new platform that would simplify our data pipeline," said Jowanza Joseph, Principal Software Engineer at One Click Retail. "Because of Pulsar's unique combination of messaging and stream processing, we've been able to replace multiple systems with one solution that works seamlessly in our Kubernetes environment. Pulsar functions has allowed us to dramatically simplify our stream processing pipeline and to reduce the cost associated with production grade stream processing systems. Seeing Pulsar become a top-level Apache project is a great milestone that validates our confidence in the current and future innovations of Pulsar and the Pulsar community."

"With the graduation, we hope to take the Apache Pulsar project and community to the next level and to reach a wider set of users and contributors, with the ultimate goal of building a strong ecosystem," added Merli. "We welcome anyone to join our efforts by helping with code, documentation or technical discussions in our forums."

Catch Apache Pulsar in action at ApacheCon North America 24-27 September 2018.

Availability and Oversight

Apache Pulsar software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For downloads, documentation, and ways to become involved with Apache Pulsar, visit http://pulsar.apache.org/ and https://twitter.com/apache_pulsar .

About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server --the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 730 individual Members and 6,800 Committers across six continents successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official user conference, trainings, and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Aetna, Anonymous, ARM, Bloomberg, Budget Direct, Capital One, Cerner, Cloudera, Comcast, Facebook, Google, Hortonworks, Huawei, IBM, Indeed, Inspur, LeaseWeb, Microsoft, Oath, ODPi, Pineapple Fund, Pivotal, Private Internet Access, Red Hat, Target, and Union Investment. For more information, visit http://apache.org/ and https://twitter.com/TheASF

© The Apache Software Foundation. "Apache", "Pulsar", "Apache Pulsar", "BookKeeper", "Apache BookKeeper", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #

Thursday September 20, 2018

The Apache® Software Foundation Welcomes Tencent as its Newest Sponsor at the Platinum Level

Joins ASF Platinum Sponsors Cloudera, Comcast, Facebook, Google, LeaseWeb, Microsoft, Oath, and Pineapple Fund in supporting the ASF's Mission of Providing Software For the Public Good

Wakefield, MA —20 September 2018— The Apache® Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today sponsorship by Tencent at the Platinum level.

Tencent is the first company from China to become a Platinum Sponsor of the ASF. Numerous individuals employed by Tencent are active contributors to several Apache projects, including Hadoop, HBase, Hive, MXNet (incubating), Parquet, and Spark.

"We are pleased to welcome Tencent, whose generosity, along with that of our other sponsors, offsets our day-to-day operating costs," said ASF Chairman Phil Steitz. "Sponsoring the ASF helps us successfully shepherd more than 300 projects and their communities, mentor dozens of open source innovations in the Apache Incubator, deepen community outreach, and furthers our mission of providing software for the public good 'The Apache Way'."

"We are very proud to join Apache family, as the first Platinum level sponsor from China, after a long time contributing on Open Source projects, include: Hadoop, HBase, Spark, etc.," said Huixing Wang, VP at Tencent Cloud. "Sponsoring ASF is an evidence that Tencent will encourage more talented engineers to join Open Source contributions and innovations, and we firmly believe that Open Source technology can make the world better."

Tencent joins the following ASF Sponsors:

Platinum —Cloudera, Comcast, Facebook, Google, LeaseWeb, Microsoft, Oath, and Pineapple Fund;
Gold —Anonymous, ARM, Bloomberg, Hortonworks, Huawei, IBM, Indeed, ODPi, Pivotal;
Silver —Aetna, Alibaba Cloud Computing, Budget Direct, Capital One, Cerner, Private Internet Access, Red Hat, Target, Union Investment;
Bronze —Airport Rentals, The Best VPN, The Blog Starter, Bookmakers, Cash Store, Casino Bonus, Casino2k, Cloudsoft, Emerio, HostChecka.com, HostingAdvice.com, HostPapa Web Hosting, The Linux Foundation, Mobile Slots, SCAMS.info, Site Builder Report, Talend, Twitter, Web Hosting Secret Revealed;
Platinum Targeted —DLA Pipser, Microsoft, Oath, OSU Open Source Labs, Sonatype;
Gold Targeted —Atlassian, The CrytpoFund, Datadog, PhoenixNAP, Quenda;
Silver Targeted —Amazon Web Services, Hotwax Systems,  Rackspace;
Bronze Targeted —Assembla, Bintray, Education Networks of America, Google, Hopsie, No-IP, PagerDuty, Peregrine Computer Consultants Corporation, Sonic.net, SURFnet, Virtru.

To Sponsor the ASF, visit http://apache.org/foundation/sponsorship.html

About Tencent and Tencent Cloud
Tencent uses technology to enrich the lives of Internet users. Our social products Weixin and QQ link our users to a rich digital content catalogue including games, video, music and books. Our proprietary targeting technology helps advertisers reach out to hundreds of millions of consumers in China. Our infrastructure services including payment, security, cloud and artificial intelligence create differentiated offerings and support our partners’ business growth. Tencent invests heavily in people and innovation, enabling us to evolve with the Internet.Tencent was founded in Shenzhen, China, in 1998. Shares of Tencent (00700.HK) are traded on the Main Board of the Stock Exchange of Hong Kong. https://www.tencent.com/

As the subsidiary of Tencent focused on developing cloud computing and artificial intelligence (AI) technologies, Tencent Cloud offers leading technological products and services and customized industry-specific solutions in the fields of cloud computing, big data, artificial intelligence to government agencies, corporations and individual developers around the world.

About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server --the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 700 individual Members and 6,600 Committers successfully collaborate to develop freely available enterprise-grade software, benefiting billions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official user conference, trainings, and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Aetna, Alibaba Cloud Computing, Anonymous, ARM, Bloomberg, Budget Direct, Capital One, Cerner, Cloudera, Comcast, Facebook, Google, Hortonworks, Huawei, IBM, Indeed, Inspur, LeaseWeb, Microsoft, Oath, ODPi, Pineapple Fund, Pivotal, Private Internet Access, Red Hat, Target, and Union Investment. For more information, visit http://www.apache.org/ and https://twitter.com/TheASF

© The Apache Software Foundation. "Apache", "Apache HTTP Server", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # # 

Tuesday September 18, 2018

The Apache Software Foundation Operations Summary: May - July 2018

FOUNDATION OPERATIONS SUMMARY

First Quarter, Fiscal Year 2019 (May - July 2018)

"The most popular open source software is Apache..."
— DZone “What Open Source Software Do You Use?” [February 2018]

> Conferences and Events: The Apache Europe Roadshow was held in Berlin, Germany, June 11-14th of this year. It was held in cooperation with the FOSS BackStage and Berlin Buzzwords events, at the Kulturbrauerei. The event also served as a preliminary investigation of the venue, and of the production company running the event, as a possible good fit for ApacheCon Europe 2019. This event was a great success, by all measures. Much of the content from that event is available on YouTube, at https://s.apache.org/b5UX

At the end of the quarter in question, we were well into planning ApacheCon North America, which will be held in Montreal, September 24-27th. Details of that event are available at https://apachecon.com/acna18

> Travel Assistance: The Travel assistance Committee exists to help those get to ApacheCon and other ASF related events (such as Apache Roadshows or project specific get togethers) that would not otherwise afford to go. During this quarter, the committee is gearing up to send successful applicants to ApacheCon NA in Montreal, Canada. More than 30 people applied via https://tac-apply.apache.org. In the end, 13 were accepted for financial support and all are being assisted for flights, accommodation and Conference fees. During the Conference itself they will assist with introducing other speakers - some are speakers themselves - and a few other minor duties, but importantly they get to meet other ASF folks, members of their project community etc.

TAC expects to spend around USD $25K of its budget at this event. No other events are scheduled at the moment in regards TAC involvement.

> Community Development: During this quarter our key focus was on continuing to support participation in events. Throughout May our main focus was helping with the planning, communications and preparations for the Apache EU Roadshow in Berlin. As well as promoting the event, we were also actively involved with helping manage and co-ordinate the event content. Over 70 talks were submitted for the CFP and a total of 28 were eventually selected for the two day Roadshow programme. 

In June the Apache EU Roadshow took place, co-located with Berlin Buzzwords and FOSS Backstage. The Roadshow was made up of an Apache Lounge and two full day tracks focussing on Apache Tomcat, IoT, Cloud technologies, Micro-services and Apache Httpd Server. Our Apache Lounge was very popular with attendees as an informal place to find out more information about Apache, meet-up or collaborate. Feedback from attendees indicate that the event and co-location was very successful. All videos, photos and presentations from the event have been published and we have already received feedback from attendees to help us improve any future events. We also took the opportunity to record some interviews for our FeatherCast podcast channel.  As well as interviews with attendees and speakers, we have started a short series called 'Board Conversations' where members of the Apache Board of Directors talk about their role. The co-location with FOSS Backstage worked well and feedback from the event was very positive. As a result  we are now looking at running Apache Roadshows in other locations.

Also in June we were invited to participate again at the Open Expo Europe in Madrid. This is the second year that we have had a presence at this conference. As well as a booth we also had several presentations about Apache projects, community development and the Apache Way. Once again, feedback from attendees was very positive and we are happy to be able to have the opportunity to promoting Apache and its projects to the Spanish speaking community.

Our main focus during July was around our participation at OSCON. This was was a great opportunity to reach out to a potentially new audience. We had an Apache booth and also several presentations at the event on topics such as Innersourcing and Financial inclusion. We received a constant stream of visitors that ranged from those thanking us for our contribution to open source to those wanting to find out what the foundation does. Our stock of stickers and giveaways ran out faster than anticipated so we will make sure that in future we have more stock.

We are now receiving more invitations to participate at more events and so are looking at how we can adjust our volunteer effort to integrate with this. We are now starting to see new people beginning to volunteer at  a regional level and to help support this we are now locating banners and other booth related supplies at several locations globally.

Our mailing list subscriptions have increased this quarter although traffic is lower and we are continuing to publish our monthly blog update.

> Committers and Contributions: Over the past quarter, 1,701 contributors committed 47,375 changes that amount to 15,276,185 lines of code across Apache projects. The top 5 contributors during this timeframe were: Duo Zhang (746 commits), Gary Gregory (712 commits), Andrea Cosentino (615 commits), Jean-Baptiste Onofré (551 commits), and Mark Thomas (455 commits).


All individuals who are granted write access to the Apache repositories must submit an Individual Contributor License Agreement (ICLA). Corporations that have assigned employees to work on Apache projects as part of an employment agreement may sign a Corporate CLA (CCLA) for contributing intellectual property via the corporation. Individuals or corporations donating a body of existing software or documentation to one of the Apache projects need to execute a formal Software Grant Agreement (SGA) with the ASF. 

During Q1 FY2019, the ASF Secretary processed 166 ICLAs, 9 CCLAs, and 6 Software Grants. Apache committer activity can be seen at http://status.apache.org/#commits

> Brand Management: Operations --the work of the Brand Management team falls broadly into one of three categories: 1) trademark registrations; 2) granting permission to use our marks; 3) addressing potential infringements of our marks. The volume of work continues to grow steadily as the foundation grows. Both registrations and addressing potential infringements are tasks that typically span many months. The GMail based tracking system continues to provide significant benefits in terms of reducing the overhead of tracking these long running tasks and ensuring that nothing falls through the cracks.

This quarter has seen the usual collection of requests to use Apache marks for events, merchandise and publications with nearly all requests being granted, subject to our Trademark Usage Policy. We have also had a couple of requests to use our marks for websites to promote one or more of our projects. In each case we have directed the enquirer to discuss and develop their ideas with the relevant project communities before seeking formal approval.

An enquiry that was, as far as we are aware, a first for the Brand Management team was an enquiry from the Apache Spark project whether or not they were allowed to use a variant of their logo for Pride. The Brand Management was happily to confirm that there were no concerns and that the project was free to go ahead with their plans.

Registrations --we have submitted a number of registrations and responded to requests for additional input on a number of ongoing registartions this quarter. We have not had any registrations complete this quarter although we are working on a numberof transfer agreements for podlings that have existing registrations and are nearing graduation.

Renewals fell due for two registrations this quarter. In consultation with the project communities it was decided, in both cases, to allow the registartion to lapse as the renewals were not viewed as cost-effective.

We have been made aware this quarter of a number of external registration applications made this quarter that overlap with registrations of our own. We are working with counsel to request adjustments to these registrations to avoid the overlap.

Infringements --potential infringements are brought to our attention from both internal and external sources. The majority of infringements we see are accidental and our project communities are able to resolve these quickly and informally with occasional input from the Brand Management team. A small number of issues take longer to resolve and we were pleased to see two such issues be successfully resolved this quarter.

And finally… The Brand Management team welcomes your comments and suggestions as well as any questions you might have. Please see https://www.apache.org/foundation/marks/contact for our contact details.


> Infrastructure:
 This past quarter, the Infrastructure team and its volunteers have spent considerable effort updating our shared services. We have performed a number of version upgrades, and have acquired and moved to new servers better-tuned to their workload.

Two of the most useful tools for our projects are the Jira issue tracker and the Confluence wiki system. We took a couple weekends to upgrade these to their latest versions, along with the numerous plugins these systems use to provide additional capabilities. Additionally, we performed an emergency upgrade for security purposes.

On the continuous integration front, we maintain several buildbot nodes, and a large deployment of Jenkins build nodes. Each of these were upgraded during the quarter to pick up new features, better reliability, and tighter security. The "Jenkins Master" was running on a shared server within a virtual machine. This created a strain on the underlying disks, so we migrated to a new, dedicated with much higher-performance disks. The Jenkins build system is one of our most-used services, and we continue to monitor its performance closely.

The Apache mirror system is a large network of volunteers that offer additional download points for the large catalog of Apache releases. It has been in operation for almost twenty years, and continues to grow in scope and in reliability. Similar to our Jenkins master, our distribution point was running into contention issues with other services on its machine. As a result, we have moved our distribution to a dedicated box, providing a much more reliable system for the mirror system and to release disk contention from the shared services.

That shared service is what we call our "Top Level Project" (TLP) web server, providing the web sites for the vast majority of our projects' web sites. By moving the mirror system off our primary web servers, it greatly improved its performance. We also migrated a secondary TLP server from our old ASF-owned hardware to a new cloud provider, and are testing and monitoring that new deployment.

Building upon our monitoring changes from last quarter, we have moved our status.apache.org server over to Statuspage.io for better reliability, maintability, and features. Much of our monitoring framework already had integrations, making this transition easy for all involved.

> Financial Statement:



> Fundraising:
 As we head towards the 20th anniversary of the foundation, we welcome Daniel Ruggeri as a co-VP of Fundraising. We are also proud to be working on three Apache events for 2018: ApacheCon 2018 North America in Montreal in September, the Apache 2018 EU Roadshow in Berlin in June and the Apache 2018 US Roadshow in Washington, DC in December. ApacheCon NA 2018 is effectively sold out for sponsors and we have a number of sponsors highly interested in AC2019 NA as well as AC2019 EU.

Interested in sponsoring the foundation and/or our events? Please email kmcgrail@apache.org for more details.

Fundraising continues to go well. We are able to fund operations and working on an endowment project to ensure the longevity of the organization. Fundraising Committee meetings continue to occur monthly and we are always looking for help. Continue improving our fundraising procedures and working on our playbook website. And we continue groundwork on fundraising for an OSS event in Africa.

The ASF foundation relies on our sponsors to exist. We are not a trade organization but a 100% volunteer led charity. Donations are tax-deductible to the extent permitted by law. To our generous Sponsors, thank you, thank you, thank you.

# # #

Report prepared by Sally Khudairi, Vice President Marketing & Publicity, with contributions by Rich Bowen, Vice President Conferences; Gavin McDonald, Vice President Travel Assistance Committee; Sharan Foga, Vice President Community Development; Mark Thomas, Vice President Brand Management; David Nalley, Vice President Infrastructure; Greg Stein, ASF Infrastructure Administrator; Tom Pappas, Vice President Finance; and Daniel Ruggeri and Kevin McGrail, Vice Presidents Fundraising.

For more information, subscribe to the announce@apache.org mailing list and visit http://www.apache.org/, the ASF Blog at http://blogs.apache.org/, the @TheASF on Twitter, and https://www.linkedin.com/company/the-apache-software-foundation.

(c) The Apache Software Foundation 2018.

Thursday August 23, 2018

The Apache Software Foundation Announces Apache® HAWQ® as a Top-Level Project

Advanced Big Data query engine and analytic database in use at Alibaba, Haier, VMWare, ZTESoft, and hundreds more.

Wakefield, MA —23 August 2018— The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today Apache® HAWQ® as a Top-Level Project (TLP).

Apache HAWQ is an advanced enterprise SQL-on-Hadoop query engine and analytic database. It combines the key technological advantages of MPP database with the scalability and convenience of Apache Hadoop. HAWQ reads data from and writes data to HDFS natively, delivers industry-leading performance and linear scalability, and provides users with a complete, standards compliant SQL interface.

"We are very excited to see Apache HAWQ graduate as a Top-Level Project and we would like to thank our Incubation mentors for all their help," said Dr. Lei Chang, Vice President of Apache HAWQ. "This is a huge milestone that reflects the collective contributions from the growing global community to deliver a world-class SQL engine for analytics."

HAWQ operates natively in Apache Hadoop to provide users the tools to confidently and successfully interact with petabyte-range data sets. Features include:
  • Exceptional performance: parallel processing architecture delivers high performance throughput and low latency —potentially near real time— query responses that can scale to petabyte-sized datasets;
  • Robust ANSI SQL compliance: leverage familiar skills. Achieve higher levels of compatibility for SQL-based applications and BI/data visualization tools. Execute complex queries and joins, including roll-ups and nested queries; and 
  • Apache Hadoop ecosystem integration: integrate and manage with Apache YARN. Provision with Apache Ambari. Interface with Apache HCatalog. Supports Apache Parquet, Apache HBase, and others. Easily scales nodes up or down to meet performance or capacity requirements.

Apache HAWQ is in use at Alibaba, Haier, VMware, ZTESoft, and hundreds of users around the world.

"We admire Apache HAWQ's flexible framework and ability to scale up in a Cloud ecosystem. HAWQ helps those seeking a heterogeneous computing system to handle ad-hoc queries and heavy batch workloads," said Kuien Liu, Computing Platform Architect at Alibaba. "Alibaba encourages more and more engineers to continue to embrace Open Source, and Apache HAWQ stands out as a star project. We are proud to have been collaborating with this community since 2015."

"Haier Group has deployed clusters of more than 30 nodes in the production environment from the very beginning of HAWQ," said Xiaoliang Wu, Big Data Architect at Haier. "We use HAWQ as an ad-hoc query and batch computation engine in areas such as social network services and IOT. Because of its superior scalability and stability, HAWQ greatly improves development efficiency and reduces operation and maintenance costs. We believe that Apache HAWQ is a very competitive product in the SQL-On-Hadoop field."

"We have been using Apache HAWQ at VMware for 4 years now," said Dominie Jacob, Lead Big Data Engineer at VMware Inc. "It is easy to manage and scale using Apache Ambari, and easy to provision and attach more nodes based on demand. Being virtualized, it is easy to provision and attach more nodes based on demand. In our BI Big Data world, HAWQ is the primary database for accessing the Hadoop datasets, building models, and executing predictive model workflows. HAWQ is working seamlessly with billions of records, thousands of Tables/Functions/Tableau-Reports, and hundreds of users. The demand for HAWQ is increasing. As VMware always encourages us to pick up and contribute back to Open Source technologies, we would love to collaborate with this community and see more enhancements. In our BI space, HAWQ is one of the top priorities."

"Apache HAWQ is an attractive technology for Big Data applications," said Zixu Zhao, Architect at ZTESoft. "HAWQ serves as the foundation of our Big Data platform and it has been used in a lot of applications, such as interactive analytics and BI on telecom data. We congratulate HAWQ on becoming an Apache Top-Level Project."

"Becoming an Apache Top-Level Project is an important milestone," added Chang. "There is much work ahead of us, and we look forward to growing the HAWQ community and codebase."

Catch Apache HAWQ in action at ApacheCon North America 24-27 September 2018 http://apachecon.com/acna18/ .

Availability and Oversight

Apache HAWQ software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For downloads, documentation, and ways to become involved with Apache HAWQ, visit http://hawq.apache.org/ and https://twitter.com/ApacheHAWQ .

About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server --the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 730 individual Members and 6,800 Committers across six continents successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official user conference, trainings, and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Aetna, Anonymous, ARM, Bloomberg, Budget Direct, Capital One, Cerner, Cloudera, Comcast, Facebook, Google, Hortonworks, Huawei, IBM, Indeed, Inspur, LeaseWeb, Microsoft, Oath, ODPi, Pineapple Fund, Pivotal, Private Internet Access, Red Hat, Target, and Union Investment. For more information, visit http://apache.org/ and https://twitter.com/TheASF


© The Apache Software Foundation. "Apache", "HAWQ", "Apache HAWQ", "Ambari", "Apache Ambari", "Hadoop", "Apache Hadoop", "HBase", "Apache HBase", "HCatalog", "Apache HCatalog", "Parquet", "Apache Parquet", "YARN", "Apache YARN", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #

Calendar

Search

Hot Blogs (today's hits)

Tag Cloud

Categories

Feeds

Links

Navigation