Weekly BigData Roundup – Aug. 7, 2016

Microsoft releases a .Net framework for Apache Spark, named Mobius.

Libraries

Mobius
C# language binding and extensions to Apache Spark

Kafka-ETL-Consumer
Kafka ETL consumes avro encoded data from Kafka and saves it to Parquet on HDFS

NNPACK
Acceleration package for neural networks on multi-core CPUs

Lasagne
Lightweight library to build and train neural networks in Theano

Elephas
Elephas is an extension of Keras, which allows you to run distributed deep learning models at scale with Spark

Sklearn-Theano
Scikit-learn compatible tools using theano

Toolsets

Embulk
An open-source bulk data loader that helps data transfer between various databases, storages, file formats, and cloud services.

Trained image classification models for Keras
Keras code and weights files for popular deep learning models.

Examples

Fifth Elephant 2016
Building a scalable Data Science Platform ( Luigi, Apache Spark, Pandas, Flask)

TensorFlow tutorial
A tutorial on TensorFlow

Lasagne Recipes
A collection of recipes for using Lasagne


You can find a lot more tools, frameworks and libraries at PocketCluster Index. Go check it out! Looking into adding your repo? tweet to @stkim1!

E-mail Subscribtion
Subscribe for upcoming posts!
Join Slack
Join the channel!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s