The Apache Software Foundation Blog

Tuesday January 15, 2019

Apache Software Foundation Gold Sponsor Profile: Bloomberg

with Kevin Fleming, Head of Open Source Community Engagement and Member of the CTO Office at Bloomberg


Kevin has spent more than 20 years in the technology industry. In 2004, he started a VOIP service provider company and chose Asterisk as his platform. 9 months later he was offered a position at Digium to work on Asterisk full-time. After seven years of developing and managing the Asterisk project, and helping to design and build the Asterisk SCF project, he moved on to Bloomberg LP, where he works with various teams to help produce and support Bloomberg's open software, used by its customers and partners to integrate with the Bloomberg Terminal. Follow @realkpfleming and @TechAtBloomberg on Twitter.


“ASF's very explicit statement that every participant

in a project is participating personally is really

a big differentiating factor to the other models.”


How did Bloomberg's work with Open Source begin?

Bloomberg has been a consumer of Open Source software for decades, but our involvement as a community collaborator and contributor began in earnest about seven years ago. That was a result of a company-wide decision to begin using Open Source tools in the development of our applications and infrastructure when possible, instead of commercial or proprietary tools.

Open Source tools are important to us because, when a tool’s source code is available, you have the flexibility to understand how it works, to modify it, and to support it by yourself, and you don’t have to rely on a vendor who might go away or whose priorities might change. That's not to say that there aren’t vendors who support their Open Source tools, because there are, but we're not locked into a channel model. Open Source tools give us control over our own destiny. If something becomes important enough to us, we can form an internal team to provide support and enhancements for that tool and the team can contribute those enhancements back to the Open Source community, if appropriate.

Why Apache? How is Bloomberg involved with the ASF, and for how long?

Bloomberg has been involved with the ASF for almost all of the seven years that we've been an active participant in the Open Source community. Apache is the home of dozens of Open Source projects that are fundamentally important to us. These tools support our data science workflows, data processing workflows, and web services, as well as other internal and external services that the company operates.

It's important to us that the organization providing a project's home is able to effectively support the project, and we want developers that work on projects in the Apache organization to focus on actually developing software, without having to spend time managing infrastructure (like bug trackers, source code repositories, and related tools). Contributors to Apache projects can focus on their own project because of the support from the foundation that these projects receive.

Why is support for foundations such as the ASF important? How does helping the ASF help Bloomberg?

Supporting organizations like the ASF is important to Bloomberg because of its governance model. Every participant in one of these Open Source projects has equal representation and footing, and developers are valued based on the merits of their contribution. Projects operating under a different governance model might not offer same type of participation for developers unless their company has made a significant financial contribution to the organization. Bloomberg participates in those types of organizations as well, but we strongly prefer those that allow everyone to participate. Not only can input come from a broader community, but also this allows contributors with a varied level of experience to participate in projects.

Contributors on these projects aren't only developers; they also include people with varied skills like documentation, project management, and marketing. Sometimes a project's decision-makers don’t write any code. While useful tools are developed within both governance models, the way an Apache project's roadmap is set, planned, and decided upon is what's important to us.

What sets the ASF apart from other software foundations or consortia?

The one really significant difference from other charitable foundations that we also support is the ASF's governance model. ASF's very explicit statement that every participant in a project is participating personally is really a big differentiating factor to the other models. 

What does 'The Apache Way' mean to Bloomberg? What makes 'The Apache Way' special?

As a result, meetings held to discuss the next major phase of an Apache project's development don't feel like any company has a representative group. ASF's policy states that you're there representing your own personal interests and not anyone else's. Even though I may know where everyone in the room works, it doesn’t matter and is not relevant. That doesn’t mean you can't say 'the company I work for uses this piece of software in a certain way,' and obviously the way you use the software will impact your opinion, but you don’t make suggestions because that’s what your company wants. Your decisions about a project should be influenced by what you think is best for the broader community. A contributor's entire currency is based on their contributions and how the community values their participation.

Do you have any guidelines for promoting innovation? There is no limit with Open Source: how do you stay focused?

We often have to consider different solutions because of changing business requirements, new types of systems to manage, or some other reason. We strongly encourage people to take a few steps back from their daily work of maintaining our systems to think about what the service may need to support in the future. We want to know if we're using the right tool, if we should use something else, or if we should improve an existing tool.

We strongly encourage people to consider that they're not just delivering a service today and that they don't want that service to be irrelevant to clients six months down the road. They need to build applications and provide databases and services that have the right functionality that meet our clients' present needs. But, you also have to choose solutions that can grow with you and that you can grow, and you have to be able to take technology in the direction you need it to go. You can do this with Open Source easier than you can with a commercial, off-the-shelf solution.

How does Apache fit into Bloomberg's long-term strategy/plans?

It's strategically important to us to ensure that the ASF continues to be a place where new, interesting, and exciting Open Source projects want to go to as their home. As these projects evolve beyond just a few people putting code up on GitHub, they can receive the benefits and support that ASF has to offer – this is a good thing for Bloomberg and the greater Open Source community.

Money is just one way to support the ASF. How else do you contribute? What recommendations do you have for others to participate?

We participate in helping the ASF decide how best to support organizations like us, and we look for ways to further help the ASF through regular conversations with them. We help spread the word about how Apache projects are run and why that's valuable and important – marketing and evangelizing is another way we contribute to the overall health of the community and the projects to which our developers contribute.

There are a few different models for how people can contribute to Apache projects. We have some employees who contribute outside of work, in their personal time. On the other end of the spectrum, we have staff that spend most of their day working on Open Source projects, including reviewing patches that aren't contributed by Bloomberg employees. These Open Source projects are important to Bloomberg, and this work ensures that the projects move forward. Of course we also have team members who contribute to projects as the need arises, which may mean that they contribute to a dozen (or more) projects in any given year.

We also host collaborative weekend sprints that are focused on a specific Open Source project or group of projects. Between 50 and 100 people attend these events with project leaders so they can learn how to become contributors to that specific project, and we provide the support system so they can participate. We ask people to break up into teams so they can, while working as part of a small group, tackle open items on the project's 'to do' list. The groups dive in and try to figure out how to solve each problem, and experts are available to help when people get stuck or to merge participants' PRs on the spot.

For some of those attending, this may be their initial contribution experience, and it's important that this experience is very collaborative, friendly, and productive. The goal of these events is to train people to be Open Source contributors. While the sprint might not be for an Apache project, some participants end up contributing to Apache projects in the future. Once someone becomes a contributor, they become more comfortable with the process and know what to expect, and they're able to translate that experience to subsequent projects.

How does it feel to be able to offer this level of support?

We're pleased to be able to participate and encourage more companies to sponsor the Apache Software Foundation. Everyone wins when everyone collaborates.

# # #

Sponsors of The Apache Software Foundation such as Bloomberg enable the all-volunteer ASF to ensure its 300+ community-driven software products remain available to billions of users around the world at no cost, and to incubate the next generation of Open Source innovations. For more information sponsorship and on ways to support the ASF, visit http://apache.org/foundation/contributing.html . 

Friday January 11, 2019

The Apache News Round-up: week ending 11 January 2019

Happy Friday --with the year off to a hot start, we're picking up the pace with a new Top-Level Project, more events, and 80% more commits over the past 7 days. Let's take a look at what's happening with the Apache community:

Do you have a few minutes to help the ASF? In advance of our 20th Anniversary, we'd love your insight on The Apache Way. Our community is integral to our success, and we'd appreciate your feedback on this quick survey https://s.apache.org/oxTr

Success at Apache –a monthly blog series that focuses on the processes behind why the ASF "just works".
 - Success at Apache: Accidentally Finding Awesome by Daniel Ruggeri https://s.apache.org/e3is

ASF Board –management and oversight of the business affairs of the corporation in accordance with the Foundation's bylaws.
 - Next Board Meeting: 16 January. Board calendar and minutes http://apache.org/foundation/board/calendar.html

ApacheCon™ –the ASF's official global conference series, now in its 21st year.
 - Join us: Apache Roadshow/DC and Open Source Career Fair at George Mason University 25 March 2019 http://apachecon.com/
 - CFP Now Open: Apache Roadshow/Chicago 13-14 May 2019 http://apachecon.com/chiroadshow19/index.html
 - Save the Date: ApacheCon North America 9-13 September in Las Vegas http://apachecon.com/

ASF Infrastructure –our distributed team on three continents keeps the ASF's infrastructure running around the clock.
 - NEW statistics and visualizations for 7M+ weekly checks: 99.95% uptime. http://www.apache.org/uptime/

Apache Code Snapshot –this week, 440 Apache contributors changed 1,027,772 lines of code over 3,027 commits. Top 5 contributors, in order, are: Kaxil Naik, Ash Berlin-Taylor, Andrea Cosentino, Chesnay Schepler, and Tellier Benoit.

Apache Project Announcements –the latest updates by category.

Big Data --
 - The Apache Software Foundation Announces Apache® Airflow™ as a Top-Level Project https://s.apache.org/LeeE
 - Apache Flume 1.9.0 released http://flume.apache.org/
 - Apache HBase 2.0.4 and 2.1.2 released https://hbase.apache.org/

Network Client/Server --
 - Apache Guacamole 1.0.0 released http://guacamole.apache.org/
 - Apache Jackrabbit 2.10.9 released http://jackrabbit.apache.org/
 - Apache Qpid Broker-J 7.1.0 released http://qpid.apache.org

Did You Know?

 - Did you know that the following Apache projects are celebrating anniversaries in January? Apache Cocoon, James, and Web Services (16 years); Lucene (14 years); ActiveMQ (12 years); Hadoop (11 years); River (8 years); Empire-db and Gora (7 years); OpenMeetings (6 years); Samza (4 years); Arrow (3 years); and Ranger (2 years). Many happy returns! https://projects.apache.org/committees.html?date

 - Did you know that blogs.apache.org is powered by Apache Roller? v5.2.2 just released today! http://roller.apache.org/

 - Did you know that NTT, the world's fourth largest telecommunications company, built a Kappa architecture for network flows using Apache Kafka? http://kafka.apache.org/

Apache Community Notices:

 - Apache in 2018 - By The Digits https://s.apache.org/Apache2018Digits

 - ASF Operations Summary: Q2 FY2019 https://s.apache.org/d2Fq

 - ASF Annual Report for FY2018 https://s.apache.org/FY2018AnnualReport

 - The Apache Software Foundation 2018 Vision Statement https://s.apache.org/zqC3

 - Foundation Statement –Apache Is Open. https://s.apache.org/PIRA

 - "Success at Apache" focuses on the processes behind why the ASF "just works". https://blogs.apache.org/foundation/category/SuccessAtApache

 - Please follow/like/re-tweet the ASF on social media: @TheASF on Twitter and on LinkedIn at https://www.linkedin.com/company/the-apache-software-foundation

 - Do friend and follow us on the Apache Community Facebook page https://www.facebook.com/ApacheSoftwareFoundation/and Twitter account https://twitter.com/ApacheCommunity

 - The list of Apache project-related MeetUps can be found at http://events.apache.org/event/meetups.html

 - The ASF will be at FOSDEM 2-3 February/Brussels https://fosdem.org/2019/

 - The Apache Big Data community will be at DataWorks Summit 18-21 March 2019 in Barcelona and 20-23 May 2019 in Washington DC https://dataworkssummit.com/

 - Future dates for Spark + AI Summit 2019 announced: 23-25 April/San Francisco and 15-17 October/Amsterdam https://databricks.com/sparkaisummit/

 - CFP Now Open: Apache Roadshow Chicago 13-14 May 2019 http://apachecon.com/chiroadshow19/index.html

 - CFP now open for Berlin Buzzwords: 16-18 June 2019 https://berlinbuzzwords.de/

 - Save the date: ApacheCon North America 9-13 September 2019 http://apachecon.com/

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Tuesday January 08, 2019

The Apache Software Foundation Announces Apache® Airflow™ as a Top-Level Project

Open Source Big Data workflow management system in use at Adobe, Airbnb, Etsy, Google, ING, Lyft, PayPal, Reddit, Square, Twitter, and United Airlines, among others.

Wakefield, MA —8 January 2019— The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today Apache® Airflow™ as a Top-Level Project (TLP).

Apache Airflow is a flexible, scalable workflow automation and scheduling system for authoring and managing Big Data processing pipelines of hundreds of petabytes. Graduation from the Apache Incubator as a Top-Level Project signifies that the Apache Airflow community and products have been well-governed under the ASF's meritocratic process and principles.

"Since its inception, Apache Airflow has quickly become the de-facto standard for workflow orchestration," said Bolke de Bruin, Vice President of Apache Airflow. "Airflow has gained adoption among developers and data scientists alike thanks to its focus on configuration-as-code. That has gained us a community during incubation at the ASF that not only uses Apache Airflow but also contributes back. This reflects Airflow’s ease of use, scalability, and power of our diverse community; that it is embraced by enterprises and start-ups alike, allows us to now graduate to a Top-Level Project."

Apache Airflow is used to easily orchestrate complex computational workflows. Through smart scheduling, database and dependency management, error handling and logging, Airflow automates resource management, from single servers to large-scale clusters. Written in Python, the project is highly extensible and able to run tasks written in other languages, allowing integration with commonly used architectures and projects such as AWS S3, Docker, Apache Hadoop HDFS, Apache Hive, Kubernetes, MySQL, Postgres, Apache Zeppelin, and more. Airflow originated at Airbnb in 2014 and was submitted to the Apache Incubator March 2016.

Apache Airflow is in use at more than 200 organizations, including Adobe, Airbnb, Astronomer, Etsy, Google, ING, Lyft, NYC City Planning, Paypal, Polidea, Qubole, Quizlet, Reddit, Reply, Solita, Square, Twitter, and United Airlines, among others. A list of known users can be found at https://github.com/apache/incubator-airflow#who-uses-apache-airflow

"Adobe Experience Platform is built on cloud infrastructure leveraging open source technologies such as Apache Spark, Kafka, Hadoop, Storm, and more," said Hitesh Shah, Principal Architect of Adobe Experience Platform. "Apache Airflow is a great new addition to the ecosystem of orchestration engines for Big Data processing pipelines. We have been leveraging Airflow for various use cases in Adobe Experience Cloud and will soon be looking to share the results of our experiments of running Airflow on Kubernetes." 

"Our clients just love Apache Airflow. Airflow has been a part of all our Data pipelines created in past 2 years acting as the ring-master and taming our Machine Learning and ETL Pipelines," said Kaxil Naik, Data Engineer at Data Reply. "It has helped us create a Single View for our client's entire data ecosystem. Airflow's Data-aware scheduling and error-handling helped automate entire report generation process reliably without any human-intervention. It easily integrates with Google Cloud (and other major cloud providers) as well and allows non-technical personnel to use it without a steep learning curve because of Airflow’s configuration-as-a-code paradigm."

"With over 250 PB of data under management, PayPal relies on workflow schedulers such as Apache Airflow to manage its data movement needs reliably," said Sid Anand, Chief Data Engineer at PayPal. "Additionally, Airflow is used for a range of system orchestration needs across many of our distributed systems: needs include self-healing, autoscaling, and reliable [re-]provisioning."

"Since our offering of Apache Airflow as a service in Sept 2016, a lot of big and small enterprises have successfully shifted all of their workflow needs to Airflow," said Sumit Maheshwari, Engineering Manager at Qubole. "At Qubole, not only are we a provider, but also a big consumer of Airflow as well. For example, our whole Insight and Recommendations platform is built around Airflow only, where we process billions of events every month from hundreds of enterprises and generate insights for them on big data solutions like Apache Hadoop, Apache Spark, and Presto. We are very impressed by the simplicity of Airflow and ease at which it can be integrated with other solutions like clouds, monitoring systems or various data sources."

"At ING, we use Apache Airflow to orchestrate our core processes, transforming billions of records from across the globe each day," said Rob Keevil, Data Analytics Platform Lead at ING WB Advanced Analytics. "Its feature set, Open Source heritage and extensibility make it well suited to coordinate the wide variety of batch processes we operate, including ETL workflows, model training, integration scripting, data integrity testing, and alerting. We have played an active role in Airflow development from the onset, having submitted hundreds of pull requests to ensure that the community benefits from the Airflow improvements created at ING.  We are delighted to see Airflow graduate from the Apache Incubator, and look forward to see where this exciting project will be taken in future!"

"We saw immediately the value of Apache Airflow as an orchestrator when we started contributing and using it," said Jarek Potiuk, Principal Software Engineer at Polidea. "Being able to develop and maintain the whole workflow by engineers is usually a challenge when you have a huge configuration to maintain. Airflow allows your DevOps to have a lot of fun and still use the standard coding tools to evolve your infrastructure. This is 'infrastructure as a code' at its best."

"Workflow orchestration is essential to the (big) data era that we live in," added de Bruin. "The field is evolving quite fast and the new data thinking is just starting to make an impact. Apache Airflow is a child of the data era and therefore very well positioned, and is also young so a lot of development can still happen. Airflow can use bright minds from scientific computing, enterprises, and start-ups to further improve it. Join the community, it is easy to hop on!"

Availability and Oversight
Apache Airflow software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For downloads, documentation, and ways to become involved with Apache Airflow, visit http://airflow.apache.org/ and https://twitter.com/ApacheAirflow

About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server --the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 730 individual Members and 7,000 Committers across six continents successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official user conference, trainings, and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Aetna, Alibaba Cloud Computing, Anonymous, ARM, Baidu, Bloomberg, Budget Direct, Capital One, Cerner, Cloudera, Comcast, Facebook, Google, Handshake, Hortonworks, Huawei, IBM, Indeed, Inspur, LeaseWeb, Microsoft, Oath, ODPi, Pineapple Fund, Pivotal, Private Internet Access, Red Hat, Target, Tencent, and Union Investment. For more information, visit http://apache.org/ and https://twitter.com/TheASF

© The Apache Software Foundation. "Apache", "Airflow", "Apache Airflow", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #

Monday January 07, 2019

Success at Apache: Accidentally Finding Awesome

by Daniel Ruggeri

My involvement with the ASF started very simply. 

I was a server administrator who wanted to have a bug or two fixed and a feature or two added to the Apache HTTP Server (httpd). I spent some time learning the codebase a bit and submitted my first patch to the httpd dev list. I wasn't expecting much of a response, as my primary motivation was to avoid having to maintain the fixes locally, but I was willing to do it if I had to. Surprisingly enough, I got a quick response from "those developer folks" and was thanked for the contribution and given a bit of guidance on when it might hit the stable branch. Wow... cool: that was neat. 

Fast forward a few months and I found a few other bugs and even added a few features myself. Every time, "those folks" (who I certainly wasn't a part of because I just wasn't as brilliant) took the contribution and incorporated it into the code base or gave pointers on how to improve it. This was getting to be pretty cool, but I was convinced "they" were just happy for the free labor.

Around that time, I was hitting some serious career growth. Working with httpd so much at $dayjob, I got to the point where I knew the ins and outs of the proxy quite well. I was also challenged by a mentor to consider giving public talks. After mulling over it, I figured I'd give it a shot and since 98% of $dayjob revolved around the httpd proxy and cool things you could do with it, I submitted a talk to ApacheCon. Again, thinking "Maybe 'those folks' don't have a full schedule" and are seeking content.

Amazingly, "those folks" accepted the talk. I gave my first *real* public speech at ApacheCon. I remember it vividly: I was nervous as hell. I mean... could you believe it? The PRESIDENT/one of the founders of the ASF was in the audience. The guy that WROTE THE MANUAL AND BOOK about httpd was also sitting right there. Oh, by the way, the guy that WROTE THE BOOK about modules was across the aisle a few rows back. Not to mention the fact that I saw several name tags I recognized as 'heavy hitters' in the community. I couldn't believe it, but they actually took the time out of their day to hear what I had to say.

While I think the presentation was probably "OK" at best, I was still welcomed and even got to chat with "those folks" about the future of the project and where it might be taken. I also got to chat with folks from several other projects. I heard about this "Hadoop" thing from a newfound friend (didn't make much sense to me) and enjoyed some awesome meals with folks from other projects (I didn't even come close to understanding what they did, but wrote down the names for later research). I connected with a fellow server admin who had some cool ideas for httpd and spent some time brainstorming how to make our @dayjobs better. 

I learned so many things in that first year at ApacheCon. 

Not too long afterwards, I was invited to be a committer on the httpd project. This floored me because, for the first time, I realized that this wasn't about sucking up free patches from the outside world. I started to see that the project was interested in me being part of it.

So, off I went. I continued submitting ever-more-interesting patches here and there, going to ApacheCons and giving ever-more-refined versions of my proxy talk and spending ever-more-time with other folks in the community. I did this really cool "barcamp" thing where we talked about whatever we wanted and got to expand our minds. 

There was also something about making the terrible (wonderful?) mistake of buying the first round the last night of the ‘con once, too: shenanigans all around. 

After a while, I didn't feel like just an outsider trying to run a better server at $dayjob. I felt like I was part of this bigger thing that was going on. I was hanging out with people I genuinely consider friends as opposed to "those folks". I was loving it and I wanted to share it. So I did the unthinkable... in a moment of boldness or temporary insanity enhanced by a faulty governor that avoids embarrassment, I gave a completely ad-hoc lightning talk titled "I love this community." And at that point... the cat was out of the bag and I was effectively 'all in'.

The really cool thing is that I wasn't actively trying to join the community. Heck, I didn't even realize a community was there. Instead the community was actually pulling me toward it. I had no idea what the *depth* and *richness* of where things would go. I started as an outsider with zero expectation other than making my life a bit easier at work and stumbled upon one of the most rewarding things I've found outside of blood family.

... THIS is why I love this community and THIS is why I want to serve it. So, as it follows, this is where the pride comes from. With a family this welcoming, it makes it easy to become more involved. So… the only thought to leave you with is “How are YOU going to get move involved?”

Daniel Ruggeri is an Open Source evangelist and lover of tech. At work, he is responsible for setting the direction of the Web and Cloud space for Mastercard and he spends his time playing with infrastructure and the code that powers it both inside the firewall and outside. He is a member of The ASF and has contributed code to Open Source projects from simple pet projects to widely utilized servers. As a lover of Open Source, he even teaches courses about Open Source Software Development (and will share the curriculum with you!).

# # #

"Success at Apache" is a monthly blog series that focuses on the people and processes behind why the ASF "just works". https://blogs.apache.org/foundation/category/SuccessAtApache

Friday January 04, 2019

The Apache News Round-up: week ending 4 January 2019

Welcome, 2019! We're testing a slightly adjusted format --do let us know what you think:

Apache in 2018 - By The Digits
 - Stewarding 300+ projects "The Apache Way" https://s.apache.org/Apache2018Digits

ASF Board –management and oversight of the business affairs of the corporation in accordance with the Foundation's bylaws.
 - Next Board Meeting: 16 January. Board calendar and minutes http://apache.org/foundation/board/calendar.html

ApacheCon™ –the ASF's official global conference series, now in its 20th year.
 - CFP Now Open: Apache Roadshow Chicago 13-14 May 2019 http://apachecon.com/chiroadshow19/index.html
 - Save the Date: ApacheCon North America 9-13 September in Las Vegas http://apachecon.com/

ASF Infrastructure –our distributed team on three continents keeps the ASF's infrastructure running around the clock.
 - NEW statistics and visualizations for 7M+ weekly checks: 99.96% uptime. http://www.apache.org/uptime/

Apache Code Snapshot –this week, 293 Apache contributors changed 960,842 lines of code over 1,707 commits. Top 5 contributors, in order, are: Tilman Hausherr, Dan Haywood, Claus Ibsen, Kaxil Naik, and Olivier Lamy.

Apache Project Announcements –the latest updates by category.

Attic --
 - Apache Tiles retired http://attic.apache.org

Big Data --
 - Apache Drill 1.15.0 released https://drill.apache.org/

Java --
 - Apache Juneau 8.0.0 released http://juneau.apache.org/

Incubating Podlings --
 - Apache NetBeans 10.0 released https://netbeans.apache.org/

Library --
 - Apache Groovy 3.0.0-alpha-4 released http://groovy.apache.org
 - Apache Log4j Kotlin API 1.0.0 released https://logging.apache.org/
 - OpenNLP 1.9.1 released http://opennlp.apache.org/

Microservices --
 - Apache ServiceComb Pack version 0.3.0 released http://servicecomb.apache.org/

Network Client/Server --
 - Apache OpenMeetings 4.0.7 released https://openmeetings.apache.org

Did You Know?

 - Did you know that Apache Fortress is accepting ideas for new features or bug fix requests on their JIRA? https://issues.apache.org/jira/projects/FC/summary

 - Did you know that Apache OpenOffice offers hundreds of ready-to-use extensions, including dictionaries, tools, PDF importer, and more? https://sourceforge.net/projects/aoo-extensions/

 - Did you know that once again, Apache Community Development (ComDev) will be helming the ASF booth, and dozens of Apache projects will be having a presence at FOSDEM 2-3 February/Brussels? https://fosdem.org/2019/

Apache Community Notices:

 - Apache in 2018 - By The Digits https://s.apache.org/Apache2018Digits

 - ASF Operations Summary: Q2 FY2019 https://s.apache.org/d2Fq

 - ASF Annual Report for FY2018 https://s.apache.org/FY2018AnnualReport

 - The Apache Software Foundation 2018 Vision Statement https://s.apache.org/zqC3

 - Foundation Statement –Apache Is Open. https://s.apache.org/PIRA

 - "Success at Apache" focuses on the processes behind why the ASF "just works". https://blogs.apache.org/foundation/category/SuccessAtApache

 - Please follow/like/re-tweet the ASF on social media: @TheASF on Twitter and on LinkedIn at https://www.linkedin.com/company/the-apache-software-foundation

 - Do friend and follow us on the Apache Community Facebook page https://www.facebook.com/ApacheSoftwareFoundation/and Twitter account https://twitter.com/ApacheCommunity

 - The list of Apache project-related MeetUps can be found at http://events.apache.org/event/meetups.html

 - The ASF will be at FOSDEM 2-3 February/Brussels https://fosdem.org/2019/

 - The Apache Big Data community will be at DataWorks Summit 18-21 March 2019 in Barcelona and 20-23 May 2019 in Washington DC https://dataworkssummit.com/

 - Future dates for Spark + AI Summit 2019 announced: 23-25 April/San Francisco and 15-17 October/Amsterdam https://databricks.com/sparkaisummit/

 - CFP Now Open: Apache Roadshow Chicago 13-14 May 2019 http://apachecon.com/chiroadshow19/index.html

 - CFP now open for Berlin Buzzwords: 16-18 June 2019 https://berlinbuzzwords.de/

 - Save the date: ApacheCon North America 9-13 September 2019 http://apachecon.com/

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Tuesday January 01, 2019

Apache in 2018 - By The Digits

It's been a great year for the Apache community at-large. With nearly 200M lines of code under the ASF's stewardship, our ongoing success is the result of community-led development "The Apache Way", executed through the collaborative efforts of more than 300 Apache projects and their communities. Highlights include:

Apache Projects https://projects.apache.org/
  • Total number of projects + sub-projects - 328 (not including Apache Labs initiatives)
  • Top-Level Projects - 198
  • Podlings in the Apache Incubator - 51
  • Other groups, including operations/support - 62

Community/People —http://home.apache.org/
  • Apache Committers - 7,032 (6,693 active)
  • ASF Members (individuals) - 730
  • New Members elected - 44

Apache Projects/Code —https://projects.apache.org/statistics.html

3,208 Apache Committers changed 78,493,228 lines of code over 201,220 commits. We also  welcomed 4,638 new code contributors and 15,861 new issue/pull request contributors.

 Top 5 Apache Code Committers 

  1. Andrea Cosentino (2,508 commits; 237,224 lines changed)
  2. Jean-Baptiste Onofré (2,098 commits; 1,208,851 lines changed)
  3. Duo Zhang (1,956 commits; 809,085 lines changed)
  4. Mark Thomas (1,823 commits; 179,883 lines changed)
  5. Tilman Hausherr (1,736 commits; 81,940 lines changed)

Top 5 Apache Project Repositories by Commits
  1. Hadoop
  2. HBase
  3. Beam
  4. Camel
  5. Flink
Top 5 Apache Project Repositories by Size (Lines of Code)
  1. OpenOffice (7,822,699)
  2. NetBeans (7,741,506)
  3. Flex (whiteboard: 5,233,722; SDK 3,933,522)
  4. Mynewt (documentation: 4,381.072)
  5. Hadoop (3,881,797)

"If it didn't happen on-list, it didn't happen." https://lists.apache.org/
  • Total number of mailing lists 1,131
  • 19,435 authors sent 1,497,005 emails on 505,793 topics
Top 5 most active Apache user@ mailing lists
  1. Flink
  2. Lucene
  3. Ignite
  4. Cassandra
  5. Kafka
Top 5 most active Apache dev@ mailing lists
  1. Beam
  2. Ignite
  3. Kafka
  4. Tomcat
  5. James

Contributor License Agreements and Software Grants —https://www.apache.org/licenses/

We welcomed an average of 387 new code contributors and 1,250 new people filing issues each month. Individuals who are granted write access to the Apache repositories must submit an Individual Contributor License Agreement (ICLA). Corporations that have assigned employees to work on Apache projects as part of an employment agreement may sign a Corporate CLA (CCLA) for contributing intellectual property via the corporation. Individuals or corporations donating a body of existing software or documentation to one of the Apache projects need to execute a formal Software Grant Agreement (SGA) with the ASF. 
  • ICLAs signed - 831
  • CCLAs signed - 35
  • Software Grants submitted - 25

Sponsorship and Individual Support —http://apache.org/foundation/contributing.html

Thank you to our hundreds of individual donors and Sponsors whose generous support helps offset the ASF's day-to-day operating expenses that include Infrastructure, Accounting, Fundraising, Marketing & Publicity, and more.
  • Platinum: Cloudera, Comcast, Facebook, Google, LeaseWeb, Microsoft, Oath, Pineapple Fund, and Tencent Cloud.

  • Gold: Anonymous, ARM, Bloomberg, Handshake, Hortonworks, Huawei, IBM, Indeed, Pivotal, and Union Investment.

  • Silver: Aetna, Alibaba Cloud Computing, Baidu, Budget Direct, Capital One, Cerner, Inspur, ODPi, Private Internet Access, Red Hat, and Target.

  • Bronze: Airport Rentals, Best VPN, The Blog Starter, Bookmakers, Cash Store, Casino Bonus, Casino2k, Cloudsoft, Emerio, Footprints Recruiting, HostChecka.com, HostingAdvice.com, HostPapa Web Hosting, The Linux Foundation, Mobile Slots, Mutuo Kredit AG, Online Holland Casino, RX-M, SCAMS.info, Site Builder Report, Talend, The Best VPN, Twitter, and Web Hosting Secret Revealed.

ASF Targeted Sponsors provide the Foundation with contributions for specific activities or programs.
  • Targeted Platinum: DLA Piper, Microsoft, Oath, OSU Open Source Labs, and Sonatype.

  • Targeted Gold: Atlassian, The CrytpoFund, Datadog, PhoenixNAP, and Quenda.

  • Targeted Silver: Amazon Web Services, HotWax Systems, and Rackspace.

  • Targeted Bronze: Bintray, Education Networks of America, Google, Hopsie, No-IP, PagerDuty, Peregrine Computer Consultants Corporation, Sonic.net, SURFnet, and Virtru.


Together, our Members, Committers, contributors, users, supporters, and sponsors continue to build on our mission of providing Open Source software for the public good and are helping keep Apache software accessible to everyone.

Wishing you the best in 2019!

# # #

Friday December 28, 2018

The Apache News Round-up: week ending 28 December 2018

It's the last Round-up of the year --the past 12 months have been tremendous. Thank you to all who have contributed to our collective success. Here's to a great 2019!

Let's review what took place over the past week:

Support Apache –help offset our day-to-day operating expenses.
 - We appreciate everyone who supported The ASF with a tax-deductible donation. Please make a year-end gift today: show your ongoing support and help keep Apache software for everyone. Every dollar counts! http://donate.apache.org

ASF Board –management and oversight of the business affairs of the corporation in accordance with the Foundation's bylaws.
 - Next Board Meeting: 16 January. Board calendar and minutes http://apache.org/foundation/board/calendar.html

ApacheCon™ –the ASF's official global conference series, now in its 20th year.
 - CFP Now Open: Apache Roadshow Chicago 13-14 May 2019 http://apachecon.com/chiroadshow19/index.html
 - Save the Date: ApacheCon North America 9-13 September in Las Vegas http://apachecon.com/

ASF Infrastructure –our distributed team on three continents keeps the ASF's infrastructure running around the clock.
 - 7M+ weekly checks yield polished performance at 98.64% uptime. http://status.apache.org/

Apache Code Snapshot –this week, 247 Apache contributors changed 519,494 lines of code over 1,358 commits. Top 5 contributors, in order, are: Jean-Baptiste Onofré, Konstantin V Shvachko, Michael Osipov, Philippe Mouawad, and Thomas Andraschko.

Apache Flink™ –an Open Source stream processing framework for distributed, high-performing, always-available, and accurate Big Data streaming applications.
 - Apache Flink 1.5.6, 1.6.3, and 1.7.1 released https://flink.apache.org/

Apache Groovy™ –a multi-faceted programming language for the JVM.
 - Apache Groovy 2.5.5 released https://groovy.apache.org/

Apache Qpid™ –the latest release of the newer JMS client supporting the Advanced Message Queuing Protocol 1.0 (AMQP 1.0, ISO/IEC 19464), based around the Apache Qpid Proton protocol engine and implementing the AMQP JMS Mapping as it evolves at OASIS.
 - Apache Qpid JMS 0.40.0 released http://qpid.apache.org

Apache Tika™ –a toolkit for detecting and extracting metadata and structured text content from various documents using existing parser libraries.
 - Apache Tika 1.20 released https://tika.apache.org/
 - [CVE-2018-17197] Apache Tika Denial of Service -- Infinite Loop in Tika's SQLite3Parser http://mail-archives.apache.org/mod_mbox/www-announce/201812.mbox/%3CCAC1dCwWhYmbkxAvFKgGSFd_ffp5EeCimB2gBXTo%2B9-F7v6TSNQ%40mail.gmail.com%3E


Did You Know?

 - Did you know that Apache NetBeans (incubating) 10.0 is out? https://netbeans.apache.org/download/nb100/nb100.html

 - Did you know that LeaseWeb uses Apache CloudStack as part of its private Cloud offering? http://cloudstack.apache.org/

 - Did you know that once again, Apache Community Development (ComDev) will be helming the ASF booth, and dozens of Apache projects will be having a presence at FOSDEM 2-3 February/Brussels? https://fosdem.org/2019/

Apache Community Notices:

 - ASF Operations Summary: Q2 FY2019 https://s.apache.org/d2Fq

 - ASF Annual Report for FY2018 https://s.apache.org/FY2018AnnualReport

 - The Apache Software Foundation 2018 Vision Statement https://s.apache.org/zqC3

 - Foundation Statement –Apache Is Open. https://s.apache.org/PIRA

 - "Success at Apache" focuses on the processes behind why the ASF "just works". https://blogs.apache.org/foundation/category/SuccessAtApache

 - Please follow/like/re-tweet the ASF on social media: @TheASF on Twitter and on LinkedIn at https://www.linkedin.com/company/the-apache-software-foundation

 - Do friend and follow us on the Apache Community Facebook page https://www.facebook.com/ApacheSoftwareFoundation/and Twitter account https://twitter.com/ApacheCommunity

 - The list of Apache project-related MeetUps can be found at http://events.apache.org/event/meetups.html

 - The Apache Big Data community will be at DataWorks Summit 18-21 March 2019 in Barcelona and 20-23 May 2019 in Washington DC https://dataworkssummit.com/

 - Future dates for Spark + AI Summit 2019 announced: 23-25 April/San Francisco and 15-17 October/Amsterdam https://databricks.com/sparkaisummit/

 - CFP Now Open: Apache Roadshow Chicago 13-14 May 2019 http://apachecon.com/chiroadshow19/index.html

 - CFP now open for Berlin Buzzwords: 16-18 June 2019 https://berlinbuzzwords.de/

 - Save the date: ApacheCon North America 9-13 September 2019 http://apachecon.com/

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Friday December 21, 2018

The Apache News Round-up: week ending 21 December 2018

As we wrap up the week, we wish everyone a festive holiday season for those who celebrate. Like Santa's elves, the Apache community is always working! Here's what happened over the past week:

Support Apache –help keep Apache software for everyone.
 - Just a few remain to make a tax-deductible donation to the ASF in 2018. Every dollar counts! http://donate.apache.org

ASF Board –management and oversight of the business affairs of the corporation in accordance with the Foundation's bylaws.
 - Next Board Meeting: 16 January. Board calendar and minutes http://apache.org/foundation/board/calendar.html

ApacheCon™ –the ASF's official global conference series, now in its 20th year.
 - CFP Now Open: Apache Roadshow Chicago 13-14 May 2019 http://apachecon.com/chiroadshow19/index.html
 - Save the Date: ApacheCon North America 9-13 September in Las Vegas http://apachecon.com/

ASF Infrastructure –our distributed team on three continents keeps the ASF's infrastructure running around the clock.
 - 7M+ weekly checks yield nice-not-naughty performance at 98.90% uptime. http://status.apache.org/

Apache Code Snapshot –this week, 473 Apache contributors changed 1,132,275 lines of code over 2,913 commits. Top 5 contributors, in order, are: Jonathan Hung, Andrea Cosentino, Mehul Parikh, Robert Munteanu, and Stephen Mallette.

Apache HttpComponents™ –a library for client-side HTTP communication built on HttpCore.
 - Apache HttpComponents Client 5.0 beta3 released http://hc.apache.org/

Apache Jackrabbit™ Oak –a scalable, high-performance hierarchical content repository designed for use as the foundation of modern world-class Web sites and other demanding content applications.
 - Apache Jackrabbit Oak 1.8.10 released http://jackrabbit.apache.org/

Apache Knox™ –a REST API Gateway for providing secure access to the data and processing resources of Apache Hadoop clusters.
 - Apache Knox 1.2.0 released https://knox.apache.org/

Apache Lucene™ –a high-performance, full-featured text search engine library written entirely in Java.
 - Apache Lucene 7.6.0 released http://lucene.apache.org/
 - Solr Reference Guide for 7.6 released https://www.apache.org/dyn/closer.cgi/lucene/solr/ref-guide/apache-solr-ref-guide-7.6.pdf

Apache ServiceComb™ –a type of Compensating Transaction pattern, which provides a simple way to help users solve the data consistency problems encountered in micro-service applications.
 - Apache ServiceComb Saga Actuator v0.3.0 released http://servicecomb.apache.org/

Apache Tomcat™ –an Open Source software implementation of the Java Servlet, JavaServer Pages, Java Unified Expression Language, Java WebSocket and JASPIC technologies. 
 - Apache Tomcat 8.5.37 and 9.0.14 released http://tomcat.apache.org/


Did You Know?

 - Did you know that Apache projects, their communities, and Apache events including ApacheCon operate under the terms of The Apache Software Foundation Code of Conduct? https://www.apache.org/foundation/policies/conduct.html

 - Did you know that Apache Airflow is used to track disease outbreaks in India? http://airflow.apache.org/

 - Did you know that BRPC, Iceberg, IoTDB, and ShardingSphere are new podlings undergoing development in the Apache Incubator? http://incubator.apache.org/

Apache Community Notices:

 - ASF Operations Summary: Q2 FY2019 https://s.apache.org/d2Fq

 - ASF Annual Report for FY2018 https://s.apache.org/FY2018AnnualReport

 - The Apache Software Foundation 2018 Vision Statement https://s.apache.org/zqC3

 - Foundation Statement –Apache Is Open. https://s.apache.org/PIRA

 - "Success at Apache" focuses on the processes behind why the ASF "just works". https://blogs.apache.org/foundation/category/SuccessAtApache

 - Please follow/like/re-tweet the ASF on social media: @TheASF on Twitter and on LinkedIn at https://www.linkedin.com/company/the-apache-software-foundation

 - Do friend and follow us on the Apache Community Facebook page https://www.facebook.com/ApacheSoftwareFoundation/and Twitter account https://twitter.com/ApacheCommunity

 - The list of Apache project-related MeetUps can be found at http://events.apache.org/event/meetups.html

 - The Apache Big Data community will be at DataWorks Summit 18-21 March 2019 in Barcelona and 20-23 May 2019 in Washington DC https://dataworkssummit.com/

 - Future dates for Spark + AI Summit 2019 announced: 23-25 April/San Francisco and 15-17 October/Amsterdam https://databricks.com/sparkaisummit/

 - CFP Now Open: Apache Roadshow Chicago 13-14 May 2019 http://apachecon.com/chiroadshow19/index.html

 - CFP now open for Berlin Buzzwords: 16-18 June 2019 https://berlinbuzzwords.de/

 - Save the date: ApacheCon North America 9-13 September 2019 http://apachecon.com/

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Friday December 14, 2018

The Apache News Round-up: week ending 14 December 2018

Happy Friday! Let's review what the Apache community has been up to over the past week:

Support Apache –help keep Apache software for everyone.
 - Two weeks remain to make a tax-deductible donation to the ASF in 2018! 750+ generous contributors donated $80K+ as part of our Individual Giving campaigns. Every dollar counts! http://donate.apache.org

ASF Board –management and oversight of the business affairs of the corporation in accordance with the Foundation's bylaws.
 - Next Board Meeting: 19 December. Board calendar and minutes http://apache.org/foundation/board/calendar.html

ApacheCon™ –the ASF's official global conference series, now in its 20th year.
 - CFP Now Open: Apache Roadshow Chicago 13-14 May 2019 http://apachecon.com/chiroadshow19/index.html
 - Save the Date: ApacheCon North America 2019 will take place 9-13 September in Las Vegas http://apachecon.com/

ASF Infrastructure –our distributed team on three continents keeps the ASF's infrastructure running around the clock.
 - 7M+ weekly checks yield grand performance at 99.64% uptime. http://status.apache.org/

Apache Code Snapshot –this week, 469 Apache contributors changed 968,811 lines of code over 2,704 commits. Top 5 contributors, in order, are: Mark Robert Miller, Mark Thomas, Andrew Purtell, Andrea Cosentino, and Matteo Merli.

Apache Beam™ –an Open Source unified programming model to define and execute Big Data processing pipelines.
 - Apache Beam 2.9.0 released https://beam.apache.org/

Apache Calcite™ Avatica –a framework for building database drivers.
 - Apache Calcite Avatica 1.13.0 released https://calcite.apache.org/

Apache Geode™ –a Big Data management platform that provides a database-like consistency model, reliable transaction processing and a shared-nothing architecture to maintain very low latency performance with high concurrency processing.
 - Apache Geode 1.8.0 released http://geode.apache.org/

Apache Griffin™ –Open Source Big Data quality solution.
 - The Apache Software Foundation Announces Apache® Griffin™ as a Top-Level Project https://s.apache.org/n21m

Apache Gobblin (incubating) –a distributed data integration framework that simplifies common aspects of Big Data integration.
 - Apache Gobblin (incubating) 0.14.0 released https://gobblin.apache.org/

Apache Groovy™ –a multi-faceted programming language for the JVM.
 - Apache Groovy 2.4.16 released http://groovy.apache.org

Apache Hivemall (incubating) –a scalable machine learning library implemented as Hive UDFs/UDAFs/UDTFs. 
 - Apache Hivemall 0.5.2-incubating released http://hivemall.incubator.apache.org/

Apache Jackrabbit™ –a fully compliant implementation of the Content Repository for Java(TM) Technology API, version 2.0 (JCR 2.0) as specified in the Java Specification Request 283 (JSR 283).
 - Apache Jackrabbit 2.19.0 released http://jackrabbit.apache.org/

Apache Log4j™ Audit –a framework for performing audit logging using a predefined catalog of audit events.
 - Apache Log4j-Audit 1.0.1 released http://logging.apache.org/

Did You Know?

 - Did you know that the following Apache projects are celebrating anniversaries this month? Apache Portable Runtime/APR (18 years); Logging Services (15 years); Cayenne, OFBiz, and Tiles (12 years); Synapse (11 years); Camel (10 years); Axis, OpenWebBeans, and Pivot (9 years); Aries (8 years); Flex (6 years); Helix (5 years); Falcon and Flink (4 years); Beam and Eagle (2 years); and Trafodion (1 year)? https://projects.apache.org/committees.html?date

 - Did you know that Jet.com uses Apache TinkerPop Gremlin to enable help center agents to view and edit help center content across all their communication channels? http://tinkerpop.apache.org/

 - Did you know that Dremio recently donated the Gandiva Initiative code base to Apache Arrow? Improved efficiency and performance for analytics, machine learning, and data science on Arrow data structures! http://arrow.apache.org/

Apache Community Notices:

 - ASF Operations Summary: Q2 FY2019 https://s.apache.org/d2Fq

 - ASF Annual Report for FY2018 https://s.apache.org/FY2018AnnualReport

 - The Apache Software Foundation 2018 Vision Statement https://s.apache.org/zqC3

 - Foundation Statement –Apache Is Open. https://s.apache.org/PIRA

 - "Success at Apache" focuses on the processes behind why the ASF "just works". https://blogs.apache.org/foundation/category/SuccessAtApache

 - Please follow/like/re-tweet the ASF on social media: @TheASF on Twitter and on LinkedIn at https://www.linkedin.com/company/the-apache-software-foundation

 - Do friend and follow us on the Apache Community Facebook page https://www.facebook.com/ApacheSoftwareFoundation/and Twitter account https://twitter.com/ApacheCommunity

 - The list of Apache project-related MeetUps can be found at http://events.apache.org/event/meetups.html

 - Flink Forward China will take place 21-22 December 2018 in Beijing https://china-2018.flink-forward.org/call-for-presentations-submit-talk/

 - The Apache Big Data community will be at DataWorks Summit 18-21 March 2019 in Barcelona and 20-23 May 2019 in Washington DC https://dataworkssummit.com/

 - Future dates for Spark + AI Summit 2019 announced: 23-25 April/San Francisco and 15-17 October/Amsterdam https://databricks.com/sparkaisummit/

 - Block your calendars for ApacheCon North America: taking place in September 2019; announcing dates and details soon. http://apachecon.com/

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Wednesday December 12, 2018

The Apache Software Foundation Announces Apache® Griffin™ as a Top-Level Project

Open Source Big Data quality solution in use at eBay, Expedia, Huawei, JD.com, Meituan, PayPal, Pingan Bank, PPDAI, VIP.com, VMWare, and more.

Wakefield, MA —12 December 2018— The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today Apache® Griffin™ as a Top-Level Project (TLP).

Apache Griffin is a robust Open Source Big Data quality solution for distributed data systems at any scale. It provides a unified process to measure data quality from different perspectives, as well as building and validating trusted data assets in both streaming or batch contexts. Griffin originated at eBay and entered the Apache Incubator in December 2016.

"We are very proud of Griffin reaching this important milestone," said William Guo, Vice President of Apache Griffin. "By actively improving Big Data quality, Griffin helps build trusted data assets, therefore boosting your confidence in your business." 

Apache Griffin enables data scientists/analysts to handle data quality issues by:
  • Defining –specifying data quality requirements such as accuracy, completeness, timeliness, profiling, etc.;

  • Measuring –source data ingested into the Griffin computing cluster will apply data quality measurement based on user-defined requirements; and

  • Applying Metrics –data quality reports as metrics will be exported to designated destination.

In addition, Griffin allows users to easily onboard new requirements into the platform and write comprehensive logic to further define their data quality. 

Apache Griffin is in use in high volume, high demand environments at 163.com/Netease, eBay, Expedia, Huawei, JD.com, Meituan, PayPal, Pingan Bank, PPDAI, VIP.com, and VMWare, among others.

"eBay contributed Griffin to the Apache Incubator in December 2016 to ensure its future development in a community-driven manner. It started with the idea on how eBay could address the data quality issue across multiple systems, especially in streaming context," said Vivian Tian, VP of eBay, GM - China Center of Excellence. "Griffin brings data quality solution to data ecosystem and ensure data applications have a solid quality foundation. We are extremely happy to see Griffin graduate as an Apache Top Level Project, and look forward to continued innovation and collaboration with the Apache community."

"We have been using Apache Griffin for about two years, monitoring 1000+ tables with data quality metrics, and are very happy to see it graduate to a Top-Level Project," said Chao Zhu, Senior Director at VIPshop Finance. "Apache Griffin and its data quality DSL can help us easily identify data quality issues instantly on our big data platform. In addition, Apache Griffin's architecture is highly extensible. We are looking forward to using it in real time data quality management system. We also look forward to contribute some of our minor enhancement to Griffin back to the community."

"We appreciate the Griffin project which really helps so much in our daily data jobs.After years of struggling with the complexity of data quality issues, we turned to Apache Griffin for a new platform that would simplify our data quality pipeline," said Jianfeng Liu, Director of Real-time Data Department at PPDAI. "Because of Apache Griffin's unified model for both batch and stream processing, we've been able to replace legacy systems with one solution that works seamlessly in our production environment. Griffin DSLs have allowed us to dramatically simplify our pipeline and to reduce our efforts a lot. I'm very proud and excited to see that the project is graduating."

"Apache Griffin is one of the best data quality solutions which my team has been used so far. It has been an exciting journey seeing the Griffin community evolve rapidly. And many people iteratively adopting it and contributing to newer capabilities," said Austin Sun, Senior Engineering Manager, Enterprise Service Platform at PayPal. "In PayPal risk domain, we benefit a lot from Apache Griffin to provide high quality data to make precise decision and protect our customer. In addition to PayPal risk, I knew there are several other corporates also leverages core capability from Griffin as their data quality solution. It’s my great honor to witness Griffin grows to a top level project. Way to go, Griffin."

"Apache Griffin project is yet another showcase how community over code can work for projects coming out from internal usages of companies into the open source," said Henry Saputra, ASF member and Incubator Mentor for Apache Griffin. "I am proud to be the part of the projects and mentors for the project when it was being contributed from eBay, in addition to several other projects already donated to ASF such as Apache Kylin and Eagle. The team has worked tremendously hard to adapt the Apache Way, and also shown great respect for the open source community in all the processes for design, development, and release processes.As a Top-Level Project I believe the PMC will help lead the project to much more success in the future."

"Graduation is not the end, it is the beginning of another journey. We hope to take Apache Griffin to the next level with a wider set of features and users," added Guo. "We welcome anyone to join our efforts by helping with product design, documentation, code, technical discussions or promoting Apache Griffin in The Apache Way."

Availability and Oversight
Apache Griffin software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For downloads, documentation, and ways to become involved with Apache Griffin, visit http://griffin.apache.org/ and https://twitter.com/apachegriffin

About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server --the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 730 individual Members and 6,800 Committers across six continents successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official user conference, trainings, and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Aetna, Alibaba Cloud Computing, Anonymous, ARM, Baidu, Bloomberg, Budget Direct, Capital One, Cerner, Cloudera, Comcast, Facebook, Google, Handshake, Hortonworks, Huawei, IBM, Indeed, Inspur, LeaseWeb, Microsoft, Oath, ODPi, Pineapple Fund, Pivotal, Private Internet Access, Red Hat, Target, Tencent, and Union Investment. For more information, visit http://apache.org/ and https://twitter.com/TheASF

© The Apache Software Foundation. "Apache", "Griffin", "Apache Griffin", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #

Friday December 07, 2018

The Apache News Round-up: week ending 7 December 2018

Greetings, December: counting down to the end of the calendar year. All the while, the brilliant Apache community remains productive:

Support Apache –help keep Apache software for everyone.
 - Join 730+ generous contributors who have donated nearly $80,000 to the ASF as part of our Individual Giving campaigns. Giving to the ASF feels great and is so easy --every dollar counts! http://donate.apache.org

Success at Apache –a monthly blog series that focuses on the processes behind why the ASF "just works".
 - Success at Apache: Cookie Monster by Isabel Drost-Fromm https://s.apache.org/cnSe

ASF Board –management and oversight of the business affairs of the corporation in accordance with the Foundation's bylaws.
 - Next Board Meeting: 19 December. Board calendar and minutes http://apache.org/foundation/board/calendar.html

ApacheCon™ –the ASF's official global conference series, now in its 20th year.
 - SAVE THE DATE: ApacheCon North America 2019 will take place 9-13 September in Las Vegas http://apachecon.com/

ASF Infrastructure –our distributed team on three continents keeps the ASF's infrastructure running around the clock.
 - 7M+ weekly checks yield impressive performance at 99.53% uptime. http://status.apache.org/

Apache Code Snapshot –this week, 470 Apache contributors changed 835,412 lines of code over 3,025 commits. Top 5 contributors, in order, are: Jean-Baptiste Onofré, Andrea Cosentino, Andrzej Kaczmarek, Jan Piotrowski, and Tilman Hausherr.

Apache Bahir™ –provides extensions to multiple distributed analytic platforms, such as Apache Spark, to extend their reach with diverse streaming connectors and SQL data sources.
 - Apache Bahir 2.3.2 released http://bahir.apache.org

Apache BookKeeper™ –a scalable, fault-tolerant, and low-latency storage service optimized for real-time workloads.
 - Apache BookKeeper 4.8.1 released https://bookkeeper.apache.org

Apache CouchDB™ –Open Source NoSQL document database using HTTP, JSON, and MapReduce.
 - Apache CouchDB 2.3.0 released https://couchdb.apache.org/

Apache Crail (incubating) –a high-performance distributed data store designed for fast sharing of ephemeral data in distributed data processing workloads.
 - Apache Crail 1.1-incubating released https://crail.incubator.apache.org/

Apache HBase™ –Open Source, distributed, versioned, non-relational database.
 - Apache HBase 2.0.3 released https://hbase.apache.org/

Apache Impala™ –a high-performance distributed SQL engine.
 -  Apache Impala 3.1.0 released https://impala.apache.org/

Apache Ignite™ –a memory-centric distributed database, caching, and processing platform for transactional, analytical, and streaming workloads delivering in-memory speeds at petabyte scale.
 - Apache Ignite 2.7.0 Vulnerable Dependecies Updates http://mail-archives.apache.org/mod_mbox/www-announce/201812.mbox/%3CCALUCNEsCwE0fC2XCHi996%3DOdUCZZLK8WzF2KOdaLPYkZzWE_8A%40mail.gmail.com%3E

Apache Jackrabbit™ –a fully compliant implementation of the Content Repository for Java(TM) Technology API, version 2.0 (JCR 2.0) as specified in the Java Specification Request 283 (JSR 283).
 - Apache Jackrabbit 2.18.0 and Jackrabbit Oak 1.9.12 released http://jackrabbit.apache.org/

Apache Kylin™ –an Open Source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Apache Hadoop, supporting extremely large datasets.
 - Apache Kylin 2.5.2 released https://kylin.apache.org/

Apache PDFBox™ –an Open Source Java tool for working with PDF documents.
 - Apache PDFBox 2.0.13 released http://pdfbox.apache.org/

Apache PLC4X (incubating) –a set of libraries for communicating with industrial programmable logic controllers (PLCs) using a variety of protocols but with a shared API.
 - Apache PLC4X 0.2.0 released http://plc4x.apache.org

Apache POI™ –Java library for reading and writing Microsoft Office file formats, such as Excel, PowerPoint, Word, Visio, Publisher and Outlook.
 - Apache POI 4.0.1 released https://poi.apache.org/

Apache Qpid™ –the latest release of the newer JMS client supporting the Advanced Message Queuing Protocol 1.0 (AMQP 1.0, ISO/IEC 19464), based around the Apache Qpid Proton protocol engine and implementing the AMQP JMS Mapping as it evolves at OASIS.
 - Apache Qpid JMS 0.39.0 released http://qpid.apache.org/

Apache ServiceComb™ –a microservice framework that provides a set of tools and components to make Cloud application development and deployment easier.
 - Apache ServiceComb Service-Center 1.1.0, ServiceComb Saga 0.2.1, and Java-Chassis 1.1.0 released http://servicecomb.apache.org/

Apache Tomcat™ Native Library –provides portable API for features not found in contemporary JDKs.
 - Apache Tomcat Native 1.2.19 released http://tomcat.apache.org/

Apache UIMA™ –supports the community working on the analysis of unstructured information with a unifying Java and C++ framework, tooling, and analysis components, guided by the OASIS UIMA (Unstructured Information Management Architecture) standard.
 - Apache UIMA Java SDKs and versions 2.10.3 and 3.0.1 released http://uima.apache.org

Apache Wicket™ –Open Source Java component oriented Web application framework that powers thousands of applications and sites for governments, stores, universities, cities, banks, email providers, and more.
 - Apache Wicket 7.11.0 released http://wicket.apache.org/


Did You Know?

 - Did you know that Apache Omid (incubating) was selected as the transaction management provider for Apache Phoenix? http://omid.incubator.apache.org/ and http://phoenix.apache.org

 - Did you know that you can see a top-level overview of each Apache project, the category they fall under, timelines, evolution, and overall commit history at https://projects.apache.org/ ?

 - Did you know that Apache Cayenne is an Open Source Java object-to-relational mapping framework? Check out v4.0 of the "ORM superpower" https://cayenne.apache.org/


Apache Community Notices:

 - ASF Operations Summary: Q2 FY2019 https://s.apache.org/d2Fq

 - ASF Annual Report for FY2018 https://s.apache.org/FY2018AnnualReport

 - The Apache Software Foundation 2018 Vision Statement https://s.apache.org/zqC3

 - Foundation Statement –Apache Is Open. https://s.apache.org/PIRA

 - "Success at Apache" focuses on the processes behind why the ASF "just works". https://blogs.apache.org/foundation/category/SuccessAtApache

 - Please follow/like/re-tweet the ASF on social media: @TheASF on Twitter and on LinkedIn at https://www.linkedin.com/company/the-apache-software-foundation

 - Do friend and follow us on the Apache Community Facebook page https://www.facebook.com/ApacheSoftwareFoundation/and Twitter account https://twitter.com/ApacheCommunity

 - The list of Apache project-related MeetUps can be found at http://events.apache.org/event/meetups.html

 - Flink Forward China will take place 21-22 December 2018 in Beijing https://china-2018.flink-forward.org/call-for-presentations-submit-talk/

 - The Apache Big Data community will be at DataWorks Summit 18-21 March 2019 in Barcelona and 20-23 May 2019 in Washington DC https://dataworkssummit.com/

 - Future dates for Spark + AI Summit 2019 announced: 23-25 April/San Francisco and 15-17 October/Amsterdam https://databricks.com/sparkaisummit/

 - Block your calendars for ApacheCon North America: taking place in September 2019; announcing dates and details soon. http://apachecon.com/

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Monday December 03, 2018

Success at Apache: Cookie Monster

by Isabel Drost-Fromm

As a researcher interested in machine learning, Web- and social graphs I joined the Nutch mailing lists back in 2005 when the project was still on SourceForge. I started tinkering with Nutch Writeables to store the data I needed for my analysis – something that today some may know as Hadoop Writeables – the Nutch wiki still has a link to the material that I could get published out of those experiments: https://wiki.apache.org/nutch/AcademicArticles

After leaving academia I remained on the Nutch and Lucene mailing lists - until one day I saw the idea of an "Apache Text" project mentioned: https://lists.apache.org/thread.html/ac22faddbef946b66d544e590fe1b2a54b60215c98cc38a2f995ee06@1176254016@%3Cdev.lucene.apache.org%3E ... I got in touch with Grant Ingersoll, over the course of half a year that vague idea was turned into a plan to have a scalable machine learning project at Apache: Scalable in terms of community, dataset size but also commercially friendly when it comes to licensing – Apache Mahout was created.

Some ideas turn into something with a life on its own. The story I'm going to tell has little to do with great technical or economic achievements that were made with software developed at The Apache Software Foundation. However it has a lot to do with the kind of cross community links that exist between projects at Apache. It also has a lot to do with the fact that there are people active in Apache projects for whom the project is more than merely a day job.

But let's start at the beginning: Little over a year ago, in April or May 2017 Stefan Rudnitzki, one of my then-new colleagues at Europace AG was showing me around the office – mentioning in particular that there's space for meetups of 100 up to 200 people. It was the year when it was unclear whether or not there would be an ApacheCon EU. The combination of those two pieces of information put  an interesting idea in our heads: Why not pull ASF interested people to Berlin and have them discuss cross-community, behind-the-scenes, OSS economics, decentralized project management, coordination of work without discretionary power topics?

In a first step we ran a rough version of the idea past a handful of friends at Apache – and received encouragement. The idea got bigger, new aspects were added and we thought "Let's get more specific!".

In a working backwards model the next thing that was written was a press release (in big, bold, red letters marked as "draft, imaginary, DO NOT PUBLISH!!!!!!!") describing a conference on all things open source behind the scenes. The format helped identify important open question marks – like: 

  • "We don't have a name for the event yet!"
  • "We need to decide on a date."
  • "We need to come up with a clearer list of topics to cover."
  • "What's our target audience?"
  • "If this is a full day event – what will we do about catering?"

What helped me personally was having learnt from Sally in her ASF media training what a real press release actually should look like. 

As for the name that was found missing in the initial press release draft:  After weeks of trying several approaches to come up with a catchy name, I went to pick up my child from kindergarten. What caught my eye was a poster announcing a beneficial concert to collect donations for better equipment and toys – an *a capella* concert: .oO(FOSS A Capella?) .oO(FOSS Backstage?)

The press release formatted version of the vision was first run by Europace – though people here are fairly regularly running after hours meetups, hosting an entire full-day conference is a slightly different scale. After the idea had been met with approval here, it was run by the Apache Community Development mailing list – which we used to keep current planning status transparent and public. 

With the idea out in the open it grew beyond something that can easily be run as a small side project. Years ago to create Berlin Buzzwords I had been working together with an event agency called newthinking communications GmbH. They were founded in 2003 by Andreas Gebhard and Markus Beckedahl in the spirit to create a network on the interface between digital technologies and society. Today, the focus lies in the organisation of events such as Berlin Buzzwords and FOSS Backstage as well as content management services (based on Drupal) for NGOs and political parties as well the conferences named above. So I got in touch with newthinking – and was delighted to receive "Sure, we are going to help out" as an answer. 

So, what about the cookies? One of the first offers I received after publishing that we were to run a FOSS Backstage full day Micro Summit in November 2017 was: "If you need support with providing cookies for the coffee break – I'm happy  to bake some, if there's no more than 40 attendees." Half jokingly I responded that I would add another 40 cookies, lest someone sends me a 3D model of an ASF feather cookie cutter. Lo and behold  the next thing I know is that someone sends me a model file for an ASF cookie cutter (which by now even made it to the then VP trademarks – who was interested in putting it to good use himself). Just a few weeks later I attended Open Source Summit in Prague. Guess what happened? Someone who knew I'd be there brought some printed cookie cutters with him from Australia.

In the meantime we had a one day / two tracks FOSS Backstage Micro Summit in November 2017 kindly hosted by Europace AG. I was able to talk several people into baking ASF cookies (including sugar coatings in the appropriate colours). In addition with the support of both, Newthinking communications GmbH, the ASF planners, and the ASF community development PMC an Apache Roadshow was co-located with the actual FOSS Backstage in June this year – a two day, multiple tracks event featuring Danese Cooper and Shane Coughlan for keynotes, a host of speakers with all sorts of relevant and inspiring stories to share, as well as fishbowl discussions on topics like Open Source monetization. One of the loveliest feedback we received: "This doesn't feel like an inaugural conference, given the professional organisation. You surely did manage to successfully invite people from a great variety of FOSS projects and foundations."

Having a press release draft ready was helpful when starting to drum up interest for the real event: With all details filled in, the "Draft/ Do not share"-warning removed it ended up getting sent to the press and published for real.

We started with a scope of all things FOSS economics, decentralised organisation, cross-cultural team-building, volunteer motivation, licensing and legal. In 2019 we want to align these aspects towards InnerSource, work collaboration principles and modern work models so that teams, companies and organisations can learn from the experiences we all make while working on Open Source projects. We are glad to have the event backed by newthinking GmbH next year again.


Isabel Drost-Fromm is (currently board-) member of the Apache Software Foundation, co-founder of Apache Mahout and mentored several incubating projects. Interested in all things search and text mining with a thorough background in open source project management and open collaboration she is working Europace AG as Open Source Strategist. True to the nature of people living in Berlin she loves having friends fly in for a brief visit –- as a result she co-founded and is still one the creative heads behind both, Berlin Buzzwords, a tech conference on all things search, scale and storage as well as FOSS Backstage, a conference on all things Free and Open Source behind the scenes and how it interrelates with business and InnerSource.

= = =

"Success at Apache" is a monthly blog series that focuses on the processes behind why the ASF "just works" https://blogs.apache.org/foundation/category/SuccessAtApache

Friday November 30, 2018

The Apache News Round-up: week ending 30 November 2018

Farewell, November: you certainly were a fast-moving month. This past week was fast-moving as well, with the following activities from the Apache community:

Support Apache –help keep Apache software for everyone.
 - From Giving Tuesday to every day, more than 700 generous contributors have donated nearly $80,000 to the ASF as part of our Individual Giving campaigns. Giving to the ASF feels great and is so easy --every dollar counts! https://s.apache.org/9cCy

ASF Board –management and oversight of the business affairs of the corporation in accordance with the Foundation's bylaws.
 - The Apache Software Foundation Operations Summary: August - October 2018 https://s.apache.org/d2Fq
 - Next Board Meeting: 19 December. Board calendar and minutes http://apache.org/foundation/board/calendar.html

ApacheCon™ –the ASF's official global conference series, now in its 20th year.
 - SAVE THE DATE: ApacheCon North America 2019 will take place 9-13 September in Las Vegas http://apachecon.com/
 - POSTPONED: Apache Roadshow DC/Open Source Job Fair. Watch this space for new dates.

ASF Infrastructure –our distributed team on three continents keeps the ASF's infrastructure running around the clock.
 - 7M+ weekly checks yield symmetrical performance at 98.89% uptime. http://status.apache.org/

Apache Code Snapshot –this week, 498 Apache contributors changed 941,670 lines of code over 2,745 commits. Top 5 contributors, in order, are: Till Rohrmann, Jan Piotrowski, Tellier Benoit, Chun-Hung Hsiao, and Andrzej Kaczmarek.

Apache Bigtop™ –packaging and interoperability testing of the Apache Hadoop ecosystem.
 - Apache Bigtop 1.3.0 released https://bigtop.apache.org/

Apache Flink™ –an Open Source stream processing framework for distributed, high-performing, always-available, and accurate Big Data streaming applications.
 - Apache Flink 1.7.0 released https://flink.apache.org/

Apache Jackrabbit™ –a fully compliant implementation of the Content Repository for Java(TM) Technology API, version 2.0 (JCR 2.0) as specified in the Java Specification Request 283 (JSR 283).
 - Apache Jackrabbit 2.17.7 released http://jackrabbit.apache.org/

Apache Qpid™ Proton –a messaging library for the Advanced Message Queuing Protocol 1.0 (AMQP 1.0, ISO/IEC 19464).
 - Apache Qpid Proton-J 0.31.0 released http://qpid.apache.org

Apache Traffic Server™ –a fast, scalable and extensible HTTP/1.1 compliant caching proxy server.
 - Apache Traffic Server v7.1.5 and v8.0.1 released https://trafficserver.apache.org/


Did You Know?

 - Did you know that you can find the logos of (nearly) all Apache projects at http://www.apache.org/logos/ ? Thanks to Apache Community Development (ComDev) for leading the effort on this! http://community.apache.org/

 - Did you know that new podlings in the Apache Incubator include BRPC, Marvin-AI, Pinot, ShardingSphere, and Zipkin? http://incubator.apache.org/

 - Did you know that, contrary to popular belief, the Apache Weekly News Round-ups aren't auto-generated, but individually written by ASF Vice President Marketing & Publicity? 229 published thus far and going strong...


Apache Community Notices:

 - ASF Operations Summary: Q1 FY2019 https://s.apache.org/qiKn

 - ASF Annual Report for FY2018 https://s.apache.org/FY2018AnnualReport

 - The Apache Software Foundation 2018 Vision Statement https://s.apache.org/zqC3

 - Foundation Statement –Apache Is Open. https://s.apache.org/PIRA

 - "Success at Apache" focuses on the processes behind why the ASF "just works". https://blogs.apache.org/foundation/category/SuccessAtApache

 - Please follow/like/re-tweet the ASF on social media: @TheASF on Twitter and on LinkedIn at https://www.linkedin.com/company/the-apache-software-foundation

 - Do friend and follow us on the Apache Community Facebook page https://www.facebook.com/ApacheSoftwareFoundation/and Twitter account https://twitter.com/ApacheCommunity

 - The list of Apache project-related MeetUps can be found at http://events.apache.org/event/meetups.html

 - Flink Forward China will take place 21-22 December 2018 in Beijing https://china-2018.flink-forward.org/call-for-presentations-submit-talk/

 - The Apache Big Data community will be at DataWorks Summit 18-21 March 2019 in Barcelona and 20-23 May 2019 in Washington DC https://dataworkssummit.com/

 - Future dates for Spark + AI Summit 2019 announced: 23-25 April/San Francisco and 15-17 October/Amsterdam https://databricks.com/sparkaisummit/

 - Block your calendars for ApacheCon North America: taking place in September 2019; announcing dates and details soon. http://apachecon.com/

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Thursday November 29, 2018

The Apache Software Foundation Operations Summary: August - October 2018

FOUNDATION OPERATIONS SUMMARY

Second Quarter, Fiscal Year 2019 (August - October 2018)

"There have been no signs Apache will stop growing."
Nick Ismail, InformationAge

> Conferences and Events: During Q2, we conducted one event, and were in the midst of planning three others.

  • ApacheCon North America 2018, September 24-27 | Montreal, Canada — This event was our 30th ApacheCon, and celebrated the 20th anniversary of the first ApacheCon in San Francisco in 1998. This was an intentionally smaller event, produced mostly in house, with the assistance of volunteer producer Ruth Suehle, as well as a cast of characters from around the Foundation. We had roughly 350 in attendance, and were able to turn a small profit on the entire venture. Video from the event may be viewed at https://s.apache.org/oUA1 (Keynotes) and audio from the event may be found at https://feathercast.apache.org/ (the rest of the presentations). Keynotes included Cliff Schmidt, Myrle Krantz, Bridget Kromhout, and Dave Neuman, and Fred Reiss, all of whom delivered inspiring talks about the role of open source in making the world a better place, with an emphasis on how open source helps the underprivileged of the world. Bertrand Delacretaz delivered the traditional State Of The Feather address on behalf of the Foundation.

  • Apache North America Road Show, December 4 | Fairfax, VA — During this quarter, we were actively working towards the Apache North America Roadshow, which will be held at George Mason University on December 4th of this year. This event is led by Kevin McGrail, in conjunction with GMU. You can read more about this event at http://www.apachecon.com/usroadshow18/

  • ApacheCon North America 2019 — During this quarter we were investigating venues for ApacheCon North America 2019, which will celebrate the 20th anniversary of the ASF. We expect to announce dates and venue in the coming quarter.

  • ApacheCon EU 2019 — During this quarter we were in discussion with a producer in Europe for the production of ApacheCon EU 2019, which is tentatively planned to be in Berlin. Details, dates, and venue should be announced in the coming quarter.


Sponsorship: as always, if you are interested in sponsoring ApacheCon, or other Apache events, we encourage you to get in touch with the sponsorship team, who can provide you with all active prospectuses at that time.

> Community Development: During this quarter our focus was helping prepare for and support ApacheCon NA in Montreal as well as participation in various other events.

During August one of our key activities was coordinating and setting up a central logo page and repository for high resolution logos for every single ASF project http://www.apache.org/logos/ . It was a great way to collaborate with all our projects on achieving a common goal. We now have the most recent versions of all ASF project logos available in various formats. Feedback and participation from projects was extremely positive and we now have a great resource for communities to use for marketing materials as well as reinforcing the Apache brand.

Our main focus in September was to help provide support for ApacheCon NA in Montreal. As usual we coordinated the Apache booth which is always a popular central meeting place throughout the conference. As well as speaking to conference attendees, we also had promotional material and giveaways.

We are continuing to be active in external events. During September we participated at Solutions Hamburg and for the first time had an Apache booth at the event. Once again we received very positive feedback and interest from attendees wanting to learn more about ASF activities. 

It has been nearly two years since we ran the Committer Diversity survey and in October we started discussions around re-running it. The community has been very positive and are very supportive of organizing another survey to understand how and if committer diversity has changed. It is hoped to get this done during the next quarter.

We are still receiving many requests to participate at various events and are looking running smaller Apache Roadshow style events as a way to reach audiences that may not have the capacity to attend ApacheCon.

Our mailing list subscriptions have increased this quarter and traffic is also higher reflecting the continued participation and interest, our discussions have created.

> Committers and Contributions: Over the past quarter, 1,656 contributors committed 50,346 changes that amount to 17,789,994 lines of code across Apache projects. The top 5 contributors during this timeframe were: David Moravek (920 commits), Radu Cotescu (718 commits), Andrea Cosentino (561 commits), Derek Gelinas (484 commits), and Jean-Baptiste Onofré (483 commits).

All individuals who are granted write access to the Apache repositories must submit an Individual Contributor License Agreement (ICLA). Corporations that have assigned employees to work on Apache projects as part of an employment agreement may sign a Corporate CLA (CCLA) for contributing intellectual property via the corporation. Individuals or corporations donating a body of existing software or documentation to one of the Apache projects need to execute a formal Software Grant Agreement (SGA) with the ASF. 

During Q1 FY2019, the ASF Secretary processed 182 ICLAs, 12 CCLAs, and 4 Software Grants. History of Apache committer growth can be seen at https://projects.apache.org/timelines.html

> Brand Management: Operations — The work of the Brand Management team falls broadly into one of three categories:

  • trademark transfers and registrations
  • granting permission to use our marks
  • addressing potential infringements of our marks

The volume of work has remained steady this quarter. Registrations and transfers are lengthy processes and the previous work to put in place a task tracking system continues to pay dividends. 

This quarter has seen the usual collection of requests to use Apache marks for user groups, events, merchandise and publications with nearly all requests being granted, subject to our Trademark Usage Policy. 

Registrations — The transfer of the NETBEANS mark in the EU completed this quarter. The transfer of the US registration is still in progress. We also also working on the agreements to transfer the marks associated with a number of other podlings. These typically span multiple jurisdictions so can take a while to complete.

We are working with counsel to address a number of external registrations that overlap with our own. While progress is being made, this too is a lengthy process and we expect that the issues currently being worked on will not be resolved until well into next calendar year.

Infringements Potential infringements are brought to our attention from both internal and external sources. The majority of infringements we see are accidental and our project communities are able to resolve these quickly and informally with occasional input from the Brand Management team. A small number of issues take longer to resolve. After last quarter's successes in resolving two of these more complex issues, this quarter has seen a small uptick in the number of complex issues we are tracking.

And finally…The Brand Management team  welcomes your comments and suggestions as well as any questions you might have. Please see https://www.apache.org/foundation/marks/contact for our contact details.


> Infrastructure:
 Infrastructure had a great quarter, as this was our yearly gathering at ApacheCon. This year, it was held in Montreal, and we arrived from all corners to discuss work, do some team bonding, and knock out a large number of action items helped by sitting across the table from each other.

Our most interesting item this quarter is that we posted a job opening, and will be working to hire additional teammates. Our last round of hiring was two years ago, yet with the growth of the Foundation, the additional help is very much needed.

The rest of the quarter has been spent with typical activity, across Jenkins, email and gitbox. Jenkins saw a lot of work focusing on disk space issues, the new master we deployed last quarter, and continued upgades to support the many projects using Jenkins. We made significant progress on preparing our new email infrastructure, to move us away from decade-old hardware and a tricky software install. Email is such a critical service to our communities, that we are approaching this migration process with the utmost care. Lastly, we improved many features around our "gitbox" service (close integration with GitHub), such that we hope to migrate all projects within the next quarter or two, and decommission our old git servers.

> Financial Statement:



> Fundraising:
 The Fundraising team has continued building upon the success of previous quarters. We are happy to report that event fundraising is nearly complete for the year and we are ahead of projected budget.

We are delighted to announce Tencent has joined us as a platinum sponsor as well as the return of Alibaba as a silver sponsor this quarter. 

In late September we added three new ambassadors/sponsor relations team members:

  • Ted Liu
  • Craig Russell
  • Bob Paulin

ApacheCon NA 2018 was a wonderful opportunity to meet personally with sponsors and friends of the foundation. We thank those who attended the sponsor lunch as well as everyone who made the event such a success!

We continue to drive out efficiencies in our procedures and systems. The team has begun working on system integrations to automate access to data managed by the Fundraising team. We also continue to watch for and drive out fraudster use of the individual donation platform (Hopsie). Focus on maturing our sponsor relations practice and procedures continues as well.

The recently published targeted sponsorship policy continues to evolve. We have added notes indicating that endorsements are not acceptable per the policy and are working on a draft of a revised policy after feedback and conversation since initial publishing. More to come soon!

The finance team has been considering ideas for securing our financial future via establishing some sort of restricted fund or endowment. Because our sponsors are so important to us, we reached out to several seeking thoughts and opinions. We are happy to report that the feedback was positive and highly valuable. More discussions with sponsors may come as we continue to support the finance team in their evaluations.

= = = 

Thank you to all our Sponsors!

  • PLATINUM: Cloudera, Comcast, Facebook, Google, LeaseWeb, Microsoft, Pineapple Fund, Oath, Tencent
  • GOLD: Anonymous, ARM, Bloomberg, Handshake, Hortonworks, Huawei, IBM, Indeed, ODPi, Pivotal
  • SILVER: Aetna, Alibaba Cloud Computing, Baidu, Budget Direct, Capital One, Cerner, Inspur, Private Internet Access, Red Hat, Target, Union Investment
  • BRONZE: Airport Rentals, Best VPN, The Blog Starter, Bookmakers, Cash Store, Casino Bonus, Casino2k, Cloudsoft, Emerio, HostChecka.com, HostingAdvice.com, HostPapa Web Hosting, The Linux Foundation, Mobile Slots, SCAMS.info, Site Builder Report, Talend, The Best VPN, Twitter, Web Hosting Secret Revealed
  • TARGETED PLATINUM: DLA Piper, Microsoft, Oath, OSU Open Source Labs, Sonatype
  • TARGETED GOLD: Atlassian, The CrytpoFund, Datadog, PhoenixNAP, Quenda
  • TARGETED SILVER: Amazon Web Services, HotWax Systems, Rackspace
  • TARGETED BRONZE: Bintray, Education Networks of America, Google, Hopsie, No-IP, PagerDuty, Peregrine Computer Consultants Corporation, Sonic.net, SURFnet, Virtru 

To Sponsor The Apache Software Foundation, visit http://apache.org/foundation/sponsorship.html . To make a one-time or monthly recurring donation, please visit https://donate.apache.org/

# # #

Report prepared by Sally Khudairi, Vice President Marketing & Publicity, with contributions by Rich Bowen, Vice President Conferences; Sharan Foga, Vice President Community Development; Mark Thomas, Vice President Brand Management; Greg Stein, ASF Infrastructure Administrator; Tom Pappas, Vice President Finance; and Daniel Ruggeri and Kevin McGrail, Vice Presidents Fundraising.

For more information, subscribe to the announce@apache.org mailing list and visit http://www.apache.org/, the ASF Blog at http://blogs.apache.org/, the @TheASF on Twitter, and https://www.linkedin.com/company/the-apache-software-foundation.

(c) The Apache Software Foundation 2018.

Tuesday November 27, 2018

Support Apache: Individual Giving and Corporate Gifts Campaigns

Giving Tuesday is here, kicking off our end-of-year Individual Giving and Corporate Gifts campaigns.


It's one of our favorite times of the year, as giving back feels so good. Here's how you can help:

Individual Donations.

  • Giving to Apache is easy! Click https://donate.apache.org/ to make a one-time or monthly recurring donation using a debit/credit card, ACH electronic transfer, or PayPal. You'll also receive a receipt for your tax-deductible contribution via email.

  • Purchasing Programs. Those of you who shop from Amazon can start your retail journey at https://smile.amazon.com/ so a portion of your purchase will be donated to the ASF. Now that's smart shopping!

  • Additional Options. If you'd rather mail us a check or send a Bitcoin donation or explore other contribution options, please visit http://apache.org/foundation/contributing.html

Corporate Gifts.

Employers of all sizes can feel good as well! This includes companies such as:

  • Bloomberg, whose employee volunteer and giving program provides numerous service opportunities year-round for a wide variety of philanthropic activities. Employees who have earned 25 or 50 hours of volunteer time can request that a donation of $2,500 or $5,000 be made to their select charity with whom has an established relationship Bloomberg Philanthropies. This is the second year that the ASF is among the candidate organizations that employees can donate their hours to as part of their "Dollars For Your Hours" program.

  • Microsoft, who works through volunteer matching platform Benevity to allow their developers to contribute to Open Source projects and communities that they are passionate about. The program donates $25 per volunteer hour, which enables Microsoft developers to contribute back to the ASF while logging hours towards for matching. The Apache Software Foundation has benefited from this and their "Tech Talent for Good" program for several years.

Some organizations contribute to the ASF in the form of a cash donation --whether it's a one-time gift or recurring monthly made at https://donate.apache.org/ , or a matching gifts program, where the company matches the financial donation of an employee to the ASF. We have received contributions that reflected dollar-for-dollar matches, sometimes multiple times the contribution made by employees.

Corporate Sponsorship is also a great way to support the ASF on an annual basis. Those wishing to quickly become a Sponsor using a credit card, ACH transfer, or PayPal may easily do so at https://donate.apache.org/ ; otherwise we invite interested parties to review our Sponsorship program at http://apache.org/foundation/sponsorship.html or contact us at fundraising(at)apache(dot)org.

We thank you in advance for your generous consideration. Through your support, the ASF is able to continue to develop, incubate, and steward 350+ Open Source projects and their communities and keep Apache for everyone. For more information on the ASF's operations and how we put your donated dollars at work, please see our Annual Report for FY2018 https://s.apache.org/FY2018AnnualReport .

# # # 

Calendar

Search

Hot Blogs (today's hits)

Tag Cloud

Categories

Feeds

Links

Navigation