The Apache Software Foundation Blog

Tuesday November 28, 2017

The Apache Software Foundation Announces Apache® Impala™ as a Top-Level Project

High performance analytic database for Apache Hadoop in-Cloud or on-premises in use at Caterpillar, Cox Automotive, Jobrapido, Marketing Associates, the New York Stock Exchange, phData, and Quest Diagnostics, among others.

Forest Hill, MD —28 November 2017— The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today that Apache® Impala™ has graduated from the Apache Incubator to become a Top-Level Project (TLP), signifying that the project's community and products have been well-governed under the ASF's meritocratic process and principles.
Apache Impala is a modern, high-performance analytic database for Apache Hadoop. The massively parallel processing (MPP) SQL query engine allows for analytical queries on data stored on-premises (in HDFS or Apache Kudu) or in Cloud object storage via SQL or business intelligence tools without having to migrate data sets into specialized systems or proprietary formats.

"The Impala project has grown a lot since we entered incubation in December 2015," said Jim Apple, Vice President of Apache Impala. "With the help of our mentors and the Incubator, we have grown as a community and adopted the Apache Way, all while the Impala contributors have helped make Impala more stable and performant."

In addition to using the same unified storage platform as other Hadoop components, Impala also uses the same metadata, SQL syntax (Apache Hive SQL), ODBC driver, and user interface (Impala query UI in Hue) as Hive. This provides a familiar and unified platform for real-time or batch-oriented queries. Impala provides:
  • A familiar SQL interface that data scientists and analysts already know;
  • The ability to query high volumes of data (Big Data) in Apache Hadoop;
  • Distributed queries in a cluster environment, for convenient scaling and to make use of cost-effective commodity hardware;
  • The ability to share data files between different components with no copy or export/import step; for example, to write with Apache Pig, transform with Hive and query with Impala. Impala can read from and write to Hive tables, enabling simple data interchange using Impala for analytics on Hive-produced data; and
  • A single system for big data processing and analytics, so customers can avoid costly modeling and ETL just for analytics.

Impala was inspired by Google's F1 database, which also separates query processing from storage management. It was originally released in 2012 and entered the Apache Incubator in December 2015. The project has had four releases during its incubation process.

"In 2011, we started development of Impala in order to make state-of-the-art SQL analytics available to the user community as open-source technology," said Marcel Kornacker, original founder of the Impala project. "The graduation to an Apache Top-Level Project is a recognition of the exceptional developer community that stands behind this project."

Apache Impala is deployed across a number of industries such as financial services, healthcare, and telecommunications, and is in use at companies that include Caterpillar, Cox Automotive, Jobrapido, Marketing Associates, the New York Stock Exchange, phData, and Quest Diagnostics. In addition, Impala is shipped by Cloudera, MapR, and Oracle.

"Apache Impala is our interactive SQL tool of choice. Over 30 phData customers have it deployed to production," said Brock Noland, Chief Architect at phData. "Combined with Apache Kudu for real-time storage, Impala has made architecting IoT and Data Warehousing use-cases dead simple. We can deploy more production use-cases with fewer people, delivering increased value to our customers. We're excited to see Impala graduate to a top-level project and look forward to contributing to its success."

"We use Apache Impala to boost performance of our SQL queries against our data lake," said Matteo Coloberti, Head of Analytics at Jobrapido. "Impala is an incredible service that gives us impressive performance on queries."

"We used to distribute Microsoft Excel reports to clients every one or two days but now they can search on their own by customer, sales deal, or even service type," said Andy Frey, CTO of Marketing Associates. "Apache Impala is used to query millions of rows to identify specific records that match the clients' criteria. We've even given clients a 'Query Hadoop' option that allows them to create simple SQL statements and query Hadoop directly via Impala. We're able to offer a faster, richer, and more accurate selection of services without the labor or latency concerns that we used to have."

"The Apache Impala community is growing, and we welcome new contributors to join in our efforts in our code, documentation, issue tracker, and discussion forums," added Apple.

Catch Apache Impala in action at Not Another Big Data Conference, taking place 12 December 2017 in Palo Alto, CA.

Availability and Oversight
Apache Impala software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For downloads, documentation, and ways to become involved with Apache Impala, visit http://impala.apache.org/ and https://twitter.com/ApacheImpala

About the Apache Incubator
The Apache Incubator is the entry path for projects and codebases wishing to become part of the efforts at The Apache Software Foundation. All code donations from external organizations and existing external projects wishing to join the ASF enter through the Incubator to: 1) ensure all donations are in accordance with the ASF legal standards; and 2) develop new communities that adhere to our guiding principles. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF. For more information, visit http://incubator.apache.org/

About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server --the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 680 individual Members and 6,300 Committers across six continents successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official user conference, trainings, and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Alibaba Cloud Computing, ARM, Bloomberg, Budget Direct, Capital One, Cash Store, Cerner, Cloudera, Comcast, Facebook, Google, Hewlett Packard, Hortonworks, Huawei, IBM, Inspur, iSIGMA, ODPi, LeaseWeb, Microsoft, PhoenixNAP, Pivotal, Private Internet Access, Red Hat, Serenata Flowers, Target, WANdisco, and Yahoo. For more information, visit http://apache.org/ and https://twitter.com/TheASF

© The Apache Software Foundation. "Apache", "Impala", "Apache Impala", "Hadoop", "Apache Hadoop", "Hive", "Apache Hive", "Kudu", "Apache Kudu", "Pig", "Apache Pig", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #

Friday November 24, 2017

The Apache News Round-up: week ending 24 November 2017

Happy post-US-Thanksgiving Friday! We appreciate your continued enthusiastic interest and readership; here's what we've been up to:

Support Apache –we depend on the generous support from people like you. Please, consider making a donation to help sustain the ASF's work. There are many ways to make a donation, from debit/credit cards to ACH bank payments to PayPal to Bitcoin to shopping at Amazon and more. Every dollar helps. http://apache.org/foundation/contributing.html

ASF Board –management and oversight of the business affairs of the corporation in accordance with the Foundation's bylaws.
 - Next Board Meeting: 20 December. Board calendar and minutes http://apache.org/foundation/board/calendar.html

ASF Infrastructure –our distributed team on three continents keeps the ASF's infrastructure running around the clock.
 - 7M+ weekly checks yield snappy performance at 99.52% uptime http://status.apache.org/

ASF Operations Factoid –this week, 192 Apache contributors changed 325,974 lines of code over 986 commits. Top 5 contributors, in order, are: Stephen Mallette, Jorge Bay Gondra, Karl Wright, Mark Thomas, and Randall Leeds.

Apache Apex™ Malhar –an enterprise grade Big Data-in-motion platform that unifies stream and batch processing.
 - Apache Apex Malhar 3.8.0 released http://apex.apache.org/

Apache BookKeeper™ –a scalable, fault-tolerant, and low-latency storage service optimized for real-time workloads.
 - Apache BookKeeper 4.5.1 released https://bookkeeper.apache.org/

Apache Commons™ Daemon –software library that provides a generic Daemon (Unix) or Service (Windows) wrapper for Java code.
 - Apache Commons Daemon 1.1.0 released http://commons.us.apache.org/proper/commons-daemon/

Apache Groovy™ –a multi-facet programming language for the JVM.
 - Apache Groovy 2.4.13 released https://groovy.apache.org/

Apache Jackrabbit™ –a scalable, high-performance hierarchical content repository designed for use as the foundation of modern world-class Web sites and other demanding content applications.
 - Apache Jackrabbit 2.16.0 released http://jackrabbit.apache.org/

Apache Kafka™ –distributed, fault tolerant, publish-subscribe messaging.
 - Apache Kafka 0.11.0.2 released http://kafka.apache.org/

Apache Log4j™ –a well known framework for logging application behavior.
 - Apache Log4j 2.10.0 released https://logging.apache.org/log4j/2.x/

Apache Lucy™ Clownfish –"symbiotic" object system pairs with "host" dynamic language environments and facilitates the development of high performance host language extensions.
 - Apache Clownfish 0.6.2 released http://lucy.apache.org/

Apache SIS™ –a Java language library for developing geospatial applications (Spatial Information System).
 - Apache Apache SIS 0.8 released http://sis.apache.org/

Did You Know?

 - Did you know that Amazon Rekognition uses Apache MXNet (incubating) for Deep Learning to solve complex problems such as image recognition and natural language speech? http://mxnet.apache.org/

 - Did you know that Dell, MailChimp, Nordstrom, Oracle, and Toyota use Apache Lucene Solr and Apache Spark for their Big Data search solutions? http://lucene.apache.org/ and http://spark.apache.org/

 - Did you know that you can participate in the Apache Mesos annual survey for a change to win a DJI Spark Drone or an Apple Watch 3? https://twitter.com/ApacheMesos/status/931560074488754176


Apache Community Notices:

 - Foundation Statement –Apache Is Open. https://s.apache.org/PIRA

 - "Success at Apache" focuses on the processes behind why the ASF "just works". 1) Project Independence https://s.apache.org/CE0V 2) All Carrot and No Stick https://s.apache.org/ykoG 3) Asynchronous Decision Making https://s.apache.org/PMvk4) Rule of the Makers https://s.apache.org/yFgQ 5) JFDI --the unconditional love of contributors https://s.apache.org/4pjM 6) Meritocracy and Me https://s.apache.org/tQQh 7) Learning to Build a Stronger Community https://s.apache.org/x9Be 8) Meritocracy. https://s.apache.org/DiEo 9) Lowering Barriers to Open Innovation https://s.apache.org/dAlg 10) All My Roads Led to Apache https://s.apache.org/l9OO 11) Scratch Your Own Itch. https://s.apache.org/7Amk

 - Follow the ASF on social media: @TheASF on Twitter and on LinkedIn at https://www.linkedin.com/company/the-apache-software-foundation (re-tweets/shares/likes most appreciated!)

 - Presentations from ApacheCon https://s.apache.org/Hli7 and Apache: Big Data https://s.apache.org/tefE are available; as well as videos https://s.apache.org/AE3m and audio recordings https://feathercast.apache.org/

 - Do friend and follow us on the Apache Community Facebook page https://www.facebook.com/ApacheSoftwareFoundation/and Twitter account https://twitter.com/ApacheCommunity

 - The list of Apache project-related MeetUps can be found at http://apache.org/events/meetups.html

 - Members of the Apache community will be out in force at Open Source Summit Paris 6-7 December 2017 http://www.opensourcesummit.paris/

 - ASF Quarterly Report: Operations Summary Q1 FY2018 https://s.apache.org/cEUm

 - ASF Annual Report is available at https://s.apache.org/FY2017AnnualReport

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Friday November 17, 2017

The Apache News Round-up: week ending 17 November 2017

Happy Friday, everyone! Let's review what the Apache community at-large has been up to over the past week:

ASF Board –management and oversight of the business affairs of the corporation in accordance with the Foundation's bylaws.
 - Next Board Meeting: 20 December. Board calendar and minutes http://apache.org/foundation/board/calendar.html

ASF Infrastructure –our distributed team on three continents keeps the ASF's infrastructure running around the clock.
 - 7M+ weekly checks yield brilliant performance at 99.69% uptime http://status.apache.org/

ASF Operations Factoid –this week, 180 Apache contributors changed 314,925 lines of code over 965 commits. Top 5 contributors, in order, are: Stephen Mallette, Gary Gregory, Dusan Balek,Tilman Hausherr, and Ravindra Pesala.

Apache Bigtop™ –Big Data management platform.
 - Apache Bigtop 1.2.1 released http://bigtop.apache.org/

Apache CXF™ –an Open Source services framework that helps you build and develop services using frontend programming APIs like JAX-WS and JAX-RS.
 - New security advisory CVE-2017-12624 released for Apache CXF http://mail-archives.apache.org/mod_mbox/www-announce/201711.mbox/%3CCAB8XdGBgipTU4-ajO0j8Khi67kziTcTqwCQbCcpRicGLd81dNA%40mail.gmail.com%3E

Apache Groovy™ –a multi-facet programming language for the JVM.
 - Apache Groovy 2.6.0-alpha-2 released https://groovy.apache.org/

Apache Jackrabbit™ –a scalable, high-performance hierarchical content repository designed for use as the foundation of modern world-class Web sites and other demanding content applications.
 - Apache Jackrabbit 2.15.8 and Jackrabbit Oak 1.7.11 released http://jackrabbit.apache.org/

Apache Mnemonic (incubating) –an Open Source Java-based storage-class memory oriented durable object platform for linked objects processing and analytics.
 - Apache Mnemonic-0.10.0-incubating released

Apache Phoenix™ –enables OLTP and SQL-based operational analytics for Apache Hadoop.
 - Apache Phoenix 4.13 released https://phoenix.apache.org/

Apache UIMA™ –a component architecture and framework for the analysis of unstructured content like text, video and audio data.
 - Apache UIMA Java SDK 3.0.0-beta and uimaFIT 2.4.0 released http://uima.apache.org

Apache ZooKeeper™ –a high-performance coordination service for distributed applications.
 - Apache ZooKeeper 3.4.11 released http://zookeeper.apache.org/

Did You Know?

 - Did you know that you can help test the Apache Struts 2.5.14 test build? https://lists.apache.org/thread.html/958bed42bb445caf1f4e80f1137ff315b70ea3299c5a765cccb9280a@%3Cdev.struts.apache.org%3E

 - Did you know that LinkedIn is leveraging Apache Calcite to provide richer operators in Dali (Data Access at LinkedIn) Views? http://calcite.apache.org/

 - Did you know that Archemy's ArchNav (extensible ontology-driven search engine and knowledge repository) uses Apache Fortress for security? http://directory.apache.org/fortress/


Apache Community Notices:

 - Foundation Statement –Apache Is Open. https://s.apache.org/PIRA

 - "Success at Apache" focuses on the processes behind why the ASF "just works". 1) Project Independence https://s.apache.org/CE0V 2) All Carrot and No Stick https://s.apache.org/ykoG 3) Asynchronous Decision Making https://s.apache.org/PMvk 4) Rule of the Makers https://s.apache.org/yFgQ 5) JFDI --the unconditional love of contributors https://s.apache.org/4pjM 6) Meritocracy and Me https://s.apache.org/tQQh 7) Learning to Build a Stronger Community https://s.apache.org/x9Be 8) Meritocracy. https://s.apache.org/DiEo 9) Lowering Barriers to Open Innovation https://s.apache.org/dAlg 10) All My Roads Led to Apache https://s.apache.org/l9OO 11) Scratch Your Own Itch. https://s.apache.org/7Amk

 - Follow the ASF on social media: @TheASF on Twitter and on LinkedIn at https://www.linkedin.com/company/the-apache-software-foundation (re-tweets/shares/likes most appreciated!)

 - Presentations from ApacheCon https://s.apache.org/Hli7 and Apache: Big Data https://s.apache.org/tefE are available; as well as videos https://s.apache.org/AE3m and audio recordings https://feathercast.apache.org/

 - Do friend and follow us on the Apache Community Facebook page https://www.facebook.com/ApacheSoftwareFoundation/and Twitter account https://twitter.com/ApacheCommunity

 - The list of Apache project-related MeetUps can be found at http://apache.org/events/meetups.html

 - The ASF will be participating at China Open Source Conference COSCon '17 18-19 November in Shanghai http://www.huodongxing.com/go/coscon17

 - Apache community members share leadership best practices on Open Source governance, community leadership, open development, and more at FOSS Backstage in Berlin on 20 November 2017 https://berlinbuzzwords.de/17/news/foss-backstage-micro-summit-registration-open-now

 - Meet members of the Apache CloudStack community at the CloudStack European User Group on 21 November in Leipzig https://www.eventbrite.co.uk/e/cloudstack-european-user-group-tickets-38657799519?aff=estw

 - New to the Apache Subversion annual hackathon: a meet-and-greet event with the project Committers! Join us on 23 November in Aachen https://wiki.apache.org/subversion/Aachen2017MeetAndGreet

 - Members of the Apache community will be out in force at Open Source Summit Paris 6-7 December 2017 http://www.opensourcesummit.paris/

 - ASF Quarterly Report: Operations Summary Q1 FY2018 https://s.apache.org/cEUm

 - ASF Annual Report is available at https://s.apache.org/FY2017AnnualReport

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Friday November 10, 2017

The Apache News Round-up: week ending 10 November 2017

And it's Friday already ... time flies when you're as productive as the Apache community! Here's what happened this week:

ASF Board –management and oversight of the business affairs of the corporation in accordance with the Foundation's bylaws.
 - Next Board Meeting: 15 November. Board calendar and minutes http://apache.org/foundation/board/calendar.html

ASF Infrastructure –our distributed team on three continents keeps the ASF's infrastructure running around the clock.
 - 7M+ weekly checks yield astute performance at 99.19% uptime http://status.apache.org/

ASF Operations Factoid –this week, 422 Apache contributors changed 857,635 lines of code over 2,005 commits. Top 5 contributors, in order, are: Jian He, Mark Thomas, Tilman Hausherr, Svatopluk Dedic, and Carlos Sierra Andrés.

Apache Commons™ Lang –provides helper utilities for the java.lang API, notably String manipulation methods, basic numerical methods, object reflection, concurrency, creation and serialization and System properties.
 - Apache Commons Lang 3.7 released http://commons.apache.org/lang/

Apache CouchDB™ –pioneering Open Source database that scales from Big Data to Mobile.
 - Apache CouchDB 2.1.1 and 1.7.0 released http://couchdb.apache.org/

Apache Freemarker (incubating) –a Java library template engine to generate text output (HTML web pages, e-mails, configuration files, source code, etc.) based on templates and changing data.
 - Apache FreeMarker 2.3.27-incubating released http://freemarker.org/

Apache HttpComponents™ Core –a set of HTTP/1.1 and HTTP/2 transport components that can be used to build custom client and server side HTTP services with a minimal footprint.
 - HttpComponents Core 5.0 beta1 released http://hc.apache.org/

Apache Jena™ –a framework for developing Semantic Web and Linked Data applications in Java.
 - Apache Jena 3.5.0 released http://jena.apache.org/

Apache Kylin™ –an Open Source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Apache Hadoop, supporting extremely large datasets.
 - Apache Kylin 2.2.0 released https://kylin.apache.org/

Apache OpenMeetings™ –provides video conferencing, instant messaging, white board, collaborative document editing and other groupware tools using API functions of the Red5 Streaming Server for Remoting and Streaming.
 - Apache OpenMeetings 4.0.0 released http://openmeetings.apache.org

Apache Qpid™ –a messaging library for the Advanced Message Queuing Protocol 1.0 (AMQP 1.0, ISO/IEC 19464, http://www.amqp.org).
 - Apache Qpid Proton 0.18.1 and Qpid JMS 0.27.0 released http://qpid.apache.org/

Apache UIMA™ –a component architecture and framework for the analysis of unstructured content like text, video and audio data.
 - Apache UIMA Java SDK 2.10.2 released http://uima.apache.org

Did You Know?

 - Did you know that Apache Community Development (ComDev) issue a monthly blog? Catch up at https://s.apache.org/rE1T

 - Did you know that the Italian Army uses Apache Syncope for identity management? http://syncope.apache.org/

 - Did you know that the following Apache projects are celebrating anniversaries in November? Many happy returns to Apache Ant (15 yrs); Apache Labs (11 yrs); Apache HttpComponents (10 yrs); Apache Attic, Buildr, CouchDB, and Qpid (9 yrs); Apache Community Development (8 yrs); Apache OODT and ZooKeeper (7 yrs); Apache Kafka and Syncope (5 yrs); Apache Ambari and Marmotta (4 yrs); Apache BookKeeper, Drill, and MetaModel (3 yrs); Apache Brooklyn, Groovy, Kylin, and REEF (2 yrs); and Apache Geode (1 yr)!


Apache Community Notices:

 - Foundation Statement –Apache Is Open. https://s.apache.org/PIRA

 - "Success at Apache" focuses on the processes behind why the ASF "just works". 1) Project Independence https://s.apache.org/CE0V 2) All Carrot and No Stick https://s.apache.org/ykoG 3) Asynchronous Decision Making https://s.apache.org/PMvk4) Rule of the Makers https://s.apache.org/yFgQ 5) JFDI --the unconditional love of contributors https://s.apache.org/4pjM 6) Meritocracy and Me https://s.apache.org/tQQh 7) Learning to Build a Stronger Community https://s.apache.org/x9Be 8) Meritocracy. https://s.apache.org/DiEo 9) Lowering Barriers to Open Innovation https://s.apache.org/dAlg 10) All My Roads Led to Apache https://s.apache.org/l9OO 11) Scratch Your Own Itch. https://s.apache.org/7Amk

 - Follow the ASF on social media: @TheASF on Twitter and on LinkedIn at https://www.linkedin.com/company/the-apache-software-foundation (re-tweets/shares/likes most appreciated!)

 - Presentations from ApacheCon https://s.apache.org/Hli7 and Apache: Big Data https://s.apache.org/tefE are available; as well as videos https://s.apache.org/AE3m and audio recordings https://feathercast.apache.org/

 - Do friend and follow us on the Apache Community Facebook page https://www.facebook.com/ApacheSoftwareFoundation/and Twitter account https://twitter.com/ApacheCommunity

 - The list of Apache project-related MeetUps can be found at http://apache.org/events/meetups.html

 - The ASF will be participating at China Open Source Conference COSCon '17 18-19 November in Shanghai http://www.huodongxing.com/go/coscon17

 - Apache community members share leadership best practices on Open Source governance, community leadership, open development, and more at FOSS Backstage in Berlin on 20 November 2017 https://berlinbuzzwords.de/17/news/foss-backstage-micro-summit-registration-open-now

 - Meet members of the Apache CloudStack community at the CloudStack European User Group on 21 November in Leipzig https://www.eventbrite.co.uk/e/cloudstack-european-user-group-tickets-38657799519?aff=estw

 - Members of the Apache community will be out in force at Open Source Summit Paris 6-7 December 2017 http://www.opensourcesummit.paris/

 - ASF Quarterly Report: Operations Summary Q1 FY2018 https://s.apache.org/cEUm

 - ASF Annual Report is available at https://s.apache.org/FY2017AnnualReport

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Friday November 03, 2017

The Apache News Round-up: week ending 3 November 2017

Enter November! The Apache community has been working on the following over the past week:

ASF Board –management and oversight of the business affairs of the corporation in accordance with the Foundation's bylaws.
 - Next Board Meeting: 15 November. Board calendar and minutes http://apache.org/foundation/board/calendar.html

ASF Infrastructure –our distributed team on three continents keeps the ASF's infrastructure running around the clock.
 - 7M+ weekly checks yield pert performance at 99.02% uptime http://status.apache.org/

ASF Operations Factoid –this week, 460 Apache contributors changed 915,743 lines of code over 2,359 commits. Top 5 contributors, in order, are: Stephen Mallette, Daniel Templeton, Gary Gregory, Tilman Hausherr, and Paul King.

Apache Any23™ –Anything To Triples is a library, a Web service, and a command line tool that extracts structured data in RDF format from a variety of Web documents.
 - Apache Any23 2.1 https://any23.apache.org

Apache Geode™ –low latency, high concurrency data management solutions.
 - Apache Geode 1.3.0 released http://geode.apache.org/

Apache Hive™ –Big Data warehouse that facilitates querying and managing large datasets residing in distributed storage.
 - CVE-2017-12625 Apache Hive information disclosure vulnerability for column masking http://mail-archives.apache.org/mod_mbox/www-announce/201710.mbox/%3C3791103E-80D5-4E75-AF23-6F8ED54DDEBE%40apache.org%3E

Apache Ignite™ –in-memory computing platform that is durable, strongly consistent, and highly available with powerful SQL, key-value and processing APIs.
 - Apache Ignite 2.3.0 released https://ignite.apache.org/

Apache Jackrabbit™ –a fully conforming implementation of the Content Repository for Java Technology API (JCR).
 - Apache Jackrabbit 2.14.4 and Jackrabbit Oak 1.6.6 released http://jackrabbit.apache.org/

Apache Juneau™ –Open Source framework for quickly and easily creating Java-based REST microservices and APIs.
 - The Apache Software Foundation Announces Apache® Juneau™ as a Top-Level Project https://s.apache.org/IvJH 

Apache Kafka™ –Open Source enterprise-grade scalable streaming platform.
 - The Apache Software Foundation Announces Apache® Kafka® v1.0.0 https://s.apache.org/8jww
 - Apache Kafka 1.0.0 released https://kafka.apache.org/

Apache Lucene™ –a high-performance, full-featured text search engine library written entirely in Java.
 - Solr Reference Guide for Solr 7.1 released https://www.apache.org/dyn/closer.cgi/lucene/solr/ref-guide/apache-solr-ref-guide-7.1.pdf

Apache MXNet (incubating) –a deep learning framework designed for both efficiency and flexibility.
 - Apache MXNet (incubating) 0.12.0 released http://mxnet.incubator.apache.org/

Apache OpenNLP™ –a Machine Learning-based toolkit for the processing of natural language text.
 - Language Detector Model 1.8.3 released http://opennlp.apache.org/

Apache PDFBox™ –an Open Source Java tool for working with PDF documents.
 - Apache PDFBox 2.0.8 released http://pdfbox.apache.org/

Apache Yetus™ –a collection of libraries and tools that enable contribution and release processes for software projects. 
 - Apache Yetus 0.6.0 released https://yetus.apache.org/

Did You Know?

 - Did you know that you can learn about Open Source governance, community leadership, open development, and more from dozens of members of the Apache community at FOSS Backstage Micro-Summit in Berlin on 20 November? https://berlinbuzzwords.de/17/news/foss-backstage-micro-summit-registration-open-now 

 - Did you know that Apache Struts has new documentation? http://struts.apache.org/docs/

 - Did you know that Yelp runs massively parallel integration tests on Apache Mesos with Task Processing? http://mesos.apache.org/


Apache Community Notices:

 - Foundation Statement –Apache Is Open. https://s.apache.org/PIRA

 - "Success at Apache" focuses on the processes behind why the ASF "just works". 1) Project Independence https://s.apache.org/CE0V 2) All Carrot and No Stick https://s.apache.org/ykoG 3) Asynchronous Decision Making https://s.apache.org/PMvk4) Rule of the Makers https://s.apache.org/yFgQ 5) JFDI --the unconditional love of contributors https://s.apache.org/4pjM 6) Meritocracy and Me https://s.apache.org/tQQh 7) Learning to Build a Stronger Community https://s.apache.org/x9Be 8) Meritocracy. https://s.apache.org/DiEo 9) Lowering Barriers to Open Innovation https://s.apache.org/dAlg 10) All My Roads Led to Apache https://s.apache.org/l9OO 11) Scratch Your Own Itch. https://s.apache.org/7Amk

 - Follow the ASF on social media: @TheASF on Twitter and on LinkedIn at https://www.linkedin.com/company/the-apache-software-foundation (re-tweets/shares/likes most appreciated!)

 - Presentations from ApacheCon https://s.apache.org/Hli7 and Apache: Big Data https://s.apache.org/tefE are available; as well as videos https://s.apache.org/AE3m and audio recordings https://feathercast.apache.org/

 - Do friend and follow us on the Apache Community Facebook page https://www.facebook.com/ApacheSoftwareFoundation/and Twitter account https://twitter.com/ApacheCommunity

 - The list of Apache project-related MeetUps can be found at http://apache.org/events/meetups.html

 - Apache community members share leadership best practices on Open Source governance, community leadership, open development, and more at FOSS Backstage in Berlin on 20 November 2017 https://berlinbuzzwords.de/17/news/foss-backstage-micro-summit-registration-open-now

 - Meet members of the Apache CloudStack community at the CloudStack European User Group on 21 November in Leipzig https://www.eventbrite.co.uk/e/cloudstack-european-user-group-tickets-38657799519?aff=estw

 - Members of the Apache community will be out in force at Open Source Summit Paris 6-7 December 2017 http://www.opensourcesummit.paris/

 - ASF Quarterly Report: Operations Summary Q1 FY2018 https://s.apache.org/cEUm

 - ASF Annual Report is available at https://s.apache.org/FY2017AnnualReport

 - Find out how you can participate with Apache community/projects/activities --opportunities open with Apache HTTP Server, Avro, ComDev (community development), Directory, Incubator, OODT, POI, Polygene, Syncope, Tika, Trafodion, and more! https://helpwanted.apache.org/

 - Are your software solutions Powered by Apache? Download & use our "Powered By" logos http://www.apache.org/foundation/press/kit/#poweredby

= = =

For real-time updates, sign up for Apache-related news by sending mail to announce-subscribe@apache.org and follow @TheASF on Twitter. For a broader spectrum from the Apache community, https://twitter.com/PlanetApache provides an aggregate of Project activities as well as the personal blogs and tweets of select ASF Committers.

# # #

Wednesday November 01, 2017

The Apache Software Foundation Announces Apache® Kafka® v1.0.0

Popular Open Source enterprise-grade scalable streaming platform in use at Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank, Target, The New York Times, Uber, Yelp, and Zalando, among others.

Forest Hill, MD —1 November 2017— The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, announced today the availability of Apache® Kafka® v1.0.0, the latest version of the Open Source distributed streaming platform.

Apache Kafka is capable of handling trillions of events per day, and provides a unified platform for handling real-time data feeds and scalable distributed applications. A single Kafka broker can handle hundreds of megabytes of reads and writes per second from thousands of clients.

"Apache Kafka is playing a bigger role as companies are moving to real-time streaming and embracing stream processing," said Jun Rao, Vice President of Apache Kafka. "The 1.0.0 release is an important milestone for the Apache Kafka community as we're committed to making it ready for enterprise adoption."

Initially conceived as a messaging queue, Kafka is based on an abstraction of a distributed commit log. Kafka provides low-latency, high-throughput, fault-tolerant publish and subscribe pipelines and is able to process streams of events. Kafka provides reliable, millisecond responses to support both customer-facing applications and connecting downstream systems with real-time data. Kafka is unique in that it can publish and subscribe to streams of data like a messaging system, process streams of data efficiently and in real time and store streams of data safely in a distributed, replicated cluster.

The Apache Kafka 1.0.0 release includes performance improvements with exactly-once semantics, significantly faster TLS and CRC32C implementations with Java 9 support, significantly faster controlled shutdown, and better JBOD support, among other general improvements and bug fixes. This release represents a significant milestone as companies run Kafka at enterprise scale with the ability to:
  • Publish and subscribe to streams of data at massive scale
  • Process streams of data with state of the art real-time stream processing capabilities and exactly-once semantics
  • Store streams of data durably for the long term

Apache Kafka is in use at large and small companies worldwide, including Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank, Target, The New York Times, Uber, Yelp, and Zalando, among others.

"We enjoy Kafka's great features and vibrant community. Kafka enabled us to process trillions of messages per day in a scalable way. This opened up a completely new frontier for us to efficiently process data in motion to help us better serve Netflix members around the world," said Allen Wang, Senior Software Engineer at Netflix.

"Yelp uses Apache Kafka to power everything from application logs to analytics, enabling us to more easily and efficiently connect people with great local businesses," said Justin Cunningham, Software Engineer at Yelp. "The 1.0 release is a major milestone, and we're thrilled that Apache Kafka has continuously added innovative new features, while enhancing the reliability and scalability that Yelp depends on as our mobile traffic grows."

"Apache Kafka is Uber's data platform that reliably delivers trillions of messages per day, and empowers the real-time business intelligence to serve all the users around the world," said Lei Lin, Engineer Manager at Uber. "It's very exciting to see the new milestone of Apache Kafka 1.0 release and we are looking forward to this release."

"We invite everyone to download Apache Kafka 1.0.0 and try it out," added Rao. "We welcome community participation and look forward to engaging with users and hearing feedback at upcoming conferences and meetups as well as through the mailing list and pull requests."

Catch Apache Kafka in action at Kafka Summit 2018 in London and San Francisco https://kafka-summit.org/ , and at numerous local meetups https://kafka.apache.org/events .

Availability and Oversight
Apache Kafka software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project's day-to-day operations, including community development and product releases. For downloads, documentation, and ways to become involved with Apache Kafka, visit https://kafka.apache.org/ and https://twitter.com/apachekafka .

About The Apache Software Foundation (ASF)
Established in 1999, the all-volunteer Foundation oversees more than 350 leading Open Source projects, including Apache HTTP Server -- the world's most popular Web server software. Through the ASF's meritocratic process known as "The Apache Way," more than 680 individual Members and 6,300 Committers successfully collaborate to develop freely available enterprise-grade software, benefiting millions of users worldwide: thousands of software solutions are distributed under the Apache License; and the community actively participates in ASF mailing lists, mentoring initiatives, and ApacheCon, the Foundation's official user conference, trainings, and expo. The ASF is a US 501(c)(3) charitable organization, funded by individual donations and corporate sponsors including Alibaba Cloud Computing, ARM, Bloomberg, Budget Direct, Capital One, Cash Store, Cerner, Cloudera, Comcast, Confluent, Facebook, Google, Hortonworks, HP, Huawei, IBM, InMotion Hosting, iSigma, LeaseWeb, Microsoft, ODPi, PhoenixNAP, Pivotal, Private Internet Access, Produban, Red Hat, Serenata Flowers, Target, WANdisco, and Yahoo. For more information, visit http://www.apache.org/ and https://twitter.com/TheASF

© The Apache Software Foundation. "Apache", "Kafka", "Apache Kafka", and "ApacheCon" are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.

# # #

Calendar

Search

Hot Blogs (today's hits)

Tag Cloud

Categories

Feeds

Links

Navigation