Entries tagged [spark]

Tuesday June 18, 2019

Release of Apache Bigtop 1.4.0

On behalf of the Apache Bigtop team, I'd love to announce the general
availability of the Bigtop 1.4.0 release.

The release is available here:
    https://bigtop.apache.org/download.html#releases

A few highlights of this release include:
- Integration Test Framework 2.0: one-stop integrated build and test
  framework at a single entry: ./gradlew [1]
- Newly developed Smoke Test CI Matrix to guard the quality of releases [2]
- Hadoop 2.8.5, Spark 2.2.3, Flink 1.6.4, Alluxio 1.8.1 and more [3]
- 100+ JIRAs are resolved in this release

With Bigtop 1.4.0 the community continues to deliver the most advanced big
data stack to date. More details about 1.4.0 release are here:
    https://bigtop.apache.org/release-notes.html

Deploying Bigtop is easy: grab the repo/list file for your favorite Linux
distribution:
  https://www.apache.org/dyn/closer.lua/bigtop/bigtop-1.4.0/repos/
and you'll be running your very own big data cluster in no time!

We welcome your help and feedback. For more information on how to report
problems, and to get involved, visit the project website at:
  https://bigtop.apache.org

Lastly, I want to emphasize that this is a collaborative work done by
project
contributors and other communities, who continue to devote time to make
Bigtop a better software. Thank you all for making this release possible!

Thanks,
Evans Ye, Release Manager

[1] Quickstart Guide: Bigtop Integration Test Framework 2.0
[2] https://ci.bigtop.apache.org/view/Test/job/Bigtop-trunk-smoke-tests-1.4.0/
[3] https://issues.apache.org/jira/browse/BIGTOP-3162

Saturday November 25, 2017

Release of Apache Bigtop 1.2.1

On behalf of the Apache Bigtop team, I'd love to announce the general availability of the Bigtop 1.2.1 release.

A few highlights of the 1.2 series release include:
• 6 Distros, 2 archs(x86 and ppc64le) supported
• A newly introduced Bigtop Sandbox feature, which brings you the best Big Data experience
• A faster Docker Provisioner which is rewritten to fully embrace Docker ecosystem
• OpenJDK 8 support. Yes, all components are built on JDK8
• Hadoop 2.7.3, Spark 2.1.1, HBase 1.1.9, and Zeppelin 0.72 are used
• and many upgrades of the ecosystem projects
(Apex, Crunch, Flume, Ignite, Mahout, Oozie, Phoenix, and many others)

With Bigtop 1.2.1 the community continues to deliver the most advanced big data stack to date. More details: BIgtop 1.2.1 Release

Deploying Bigtop is easy: grab the repo/list file for your favorite Linux distribution:
  https://www.apache.org/dyn/closer.lua/bigtop/bigtop-1.2.1/repos/
and you'll be running your very own bigdata cluster in no time!

Alternatively, you can use Bigtop Provisioner to spin-up a virtual cluster with a single command as explained in Bigtop Provisioner User Guide

Finally, I encourage everyone to give our brand new feature Bigtop Sandbox a try: How to build and run Bigtop Sandbox (Experimental) Feedback is welcome!


I want to emphasize that this is a collaborative work done by project contributors and other communities, who continue to devote time to make Bigtop a better software. Thank you all for making this release possible!

Wednesday February 17, 2016

Release 1.1.0 is out

On behalf of the Apache Bigtop team, I'd love to announce the general availability of the Bigtop 1.1.0 release.

A few highlights of this release include:

  • five different operating systems are supported
  • a brand new ppc64le architecture was added to the support matrix
  • most stable Hadoop 2.7.1 is used
  • new data notebooks project Zeppelin (incubating)
  • addition of Apache Hama
  • toolchain is updated to the latest versions of the development tools
  • standard docker containers are available for builds, testing, and alike
  • on-going improvements in the unattended cluster deployment and testing
  • improvements in the smoke-tests coverage and UX
  • and many upgrades to the latest versions of the ecosystem projects
    (Crunch, Flume, Ignite, Hive, Mahout, Oozie, Phoenix, Pig, Spark, and many others)
With Bigtop 1.1 the community continues on the path of delivering the most advanced, openly-developer data analytics stack to date. This is a true bigtop project, bringing together virtually all of the Apache Software Foundation data processing projects.
This release of the Apache Bigdata platform include close to 260 bug fixes and new features.

Deploying Bigtop is easy: grab the repo/list file for your favorite Linux distribution:
    http://www.apache.org/dist/bigtop/bigtop-1.1.0/repos/
and you'll be running your very own bigdata cluster in no time!
Alternatively, you can use Bigtop provisioner to spin-up a virtual cluster with a single command as explained in
   https://cwiki.apache.org/confluence/display/BIGTOP/Bigtop+Provisioner+User+Guide

I want to emphasize the great work done by the project contributors, and thank everyone in this and other communities who made this release possible!

Thursday September 03, 2015

Not just yet another release of Apache Bigdata stack: Bigtop 1.0 delivers fast data

Bigtop 1.0 is out! And this time around it isn't just about providing our users with latest and more stable versions of the data crunching software, but also a paradigm shift from bigdata towards fastdata.
[Read More]

Calendar

Search

Hot Blogs (today's hits)

Tag Cloud

Categories

Feeds

Links

Navigation