Weekly BigData Roundup – Aug. 1, 2016

Facebook has opensourced a DeepLearning framework Torchnet. Here is a detailed blog post on the release.

Libraries

Ibis
Productivity-centric Python data analysis framework for SQL systems and the Hadoop platform. Co-founded by the creator of pandas.

Livy
Livy is an open source REST interface for interacting with Apache Spark from anywhere

Distributed
Distributed computation in Python

Hdbscan
A high performance implementation of HDBSCAN clustering.

Hivemall
Scalable machine learning library for Hive/Hadoop

Mlxtend
A library of extension and helper modules for Python’s data analysis and machine learning libraries

Auto sklearn
Auto-sklearn is an automated machine learning toolkit and a drop-in replacement for a scikit-learn estimator

Mongo Spark
The MongoDB Spark Connector

Frameworks

Minio
Minio is an object storage server compatible with Amazon S3.

Torchnet
Torchnet is a framework for torch which provides a set of abstractions aiming at encouraging code re-use as well as encouraging modular programming.

Toolsets

Datacleaner
A Python tool that automatically cleans data sets and readies them for analysis

DeepMining
The Deep Mining project aims at finding the best hyperparameter set for a Machine Learning pipeline.

Examples

DAT4
General Assembly’s Data Science course material in Washington, DC

Pandas Exercises
Practice your pandas skills!


You can find a lot more tools, frameworks and libraries at PocketCluster Index. Go check it out! Looking into adding your repo? tweet to @stkim1!

E-mail Subscribtion
Subscribe for upcoming posts!
Join Slack
Join the channel!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s