Apache MXNet (incubating)

Wednesday November 01, 2017

Apache MXNet 0.12 Release Adds Support for New NVIDIA Volta GPUs and Sparse Tensor

We are excited about the availability of Apache MXNet version 0.12. With this release, MXNet adds two new important features: support for NVIDIA Volta GPUs and support for Sparse Tensors

Support for NVIDIA Volta GPU Architecture

The MXNet v0.12 release adds support for NVIDIA Volta V100 GPUs, enabling users to train convolutional neural networks up to 3.5 times faster than on the Pascal GPUs. Trillions of floating-point (FP) multiplications and additions for training a neural network have typically been done using single precision (FP32) to achieve high accuracy. However, recent research has shown that the same accuracy can be achieved using half-precision (FP16) data types.

The Volta GPU architecture introduces Tensor Cores. Each Tensor Core can execute 64 fuse-multiply-add ops per clock, which roughly quadruples the CUDA core FLOPS per clock per core. Each Tensor Core performs D = A x B + C, where A and B are half-precision matrices, while C and D can be either half or single-precision matrices, thereby performing mixed precision training. The new mixed-precision training allows users to achieve optimal training performance without sacrificing accuracy by using FP16 for most of the layers of a network, and higher precision data types only when necessary.

You can take advantage of Volta Tensor Cores to enable FP16 training in MXNet by passing a simple command, "--dtype float16" to the MXNet training script. For example, you can invoke imagenet training script with command: train_imagenet.py --dtype float16

Sparse Tensor Support

MXNet v0.12 adds support for sparse tensors to efficiently store and compute tensors allowing developers to perform sparse matrix operations in a storage and compute-efficient manner and train deep learning models faster. MXNet v0.12 supports two major sparse data formats: Compressed Sparse Row (CSR) and Row Sparse (RSP). The CSR format is optimized to represent matrices with a large number of columns where each row has only a few non-zero elements. The RSP format is optimized to represent matrices with a huge number of rows where most of the row slices are complete zeros. For example, the CSR format can be used to encode the feature vectors of input data for a recommendation engine, whereas the RSP format can be used to perform the sparse gradient updates during training. This release enables sparse support on CPU for most commonly used operators such as matrix dot product and element-wise operators. Sparse support for more operators will be added in future releases.

Follow these tutorials to learn how to use the new sparse operators in MXNet.

Get Apache MXNet 0.12 from downloads page . Read more about this release in Release Notes .

Or, You can download and play with MXNet easily using one of the options below:

If you want to learn more about MXNet visit https://mxnet.incubator.apache.org/. Finally, you are welcome to join and also invite your friends to the dynamic and growing MXNet community by subscribing to dev@mxnet.incubator.apache.org


Hi! I have installed apache + nginx on my website and I surpised about the speed of my website! Static = apache and php dynamic = nginx!

Posted by Jessica on April 18, 2019 at 07:28 AM UTC #

Hi Jessica. I have did it too - static elements from the site from apache and dynamic from nginx and the site works fine. Thanks alot

Posted by Nathan on June 25, 2019 at 01:03 PM UTC #

Hi guys. I have made it too. static elements from the site from apache and dynamic from nginx and the site works fine. This seems to be a going to a new mainstream. Thanks

Posted by Vao on June 25, 2019 at 01:08 PM UTC #

cool. thanks for sharing I love the attention to detail. You are just amazing. And I really loved your work.

Posted by nolvadex on July 19, 2019 at 06:26 PM UTC #

In fact, I have been using your service for a long time, especially I like the way you write an article about updates in detail, thank you for that. Ben, Web Dev at https://apkdrod.com/

Posted by Apkdrod on July 29, 2019 at 05:02 PM UTC #

I think these parameters will fit my blog.

Posted by MyFreeCams on October 25, 2019 at 02:49 PM UTC #

Thank you for the info! I will use it for my project http://mindepcasinos.com/

Posted by lizmcconel on November 28, 2019 at 01:59 PM UTC #

Conversations and dates I've had with men on https://wizzlove.com/reviews/wellhello-review wellhello were very good to excellent matches for me. I felt safe with my dates and they were respectful of my boundaries. Being my favorite, this dating site is no different than the rest in that we have to be very careful about who and how much we choose to trust and who we choose to date.

Posted by Kate Kross on December 04, 2019 at 07:03 PM UTC #

Thanks for the info, but I have a question. Can I use Apache MXNet 0.12 or higher with Amazon AWS? I read in one article ( https://www.sysnettechsolutions.com/en/install-wordpress/ ) that older versions of MXNet did not fully work on AWS. For example, when I run the new version of MXNet on AWS, can I install WordPress with MXNet described in the article here?

Posted by John David on February 03, 2020 at 12:29 AM UTC #

Post a Comment:
Comments are closed for this entry.



Hot Blogs (today's hits)

Tag Cloud