Weekly BigData Roundup – May 12, 2016

This week’s roundup lists a cool new project, Sparkoin, a blockchain analyzer based on Apache Spark!

Frameworks

DistributedLog
DistributedLog (DL) is a high-performance, replicated log service, offering durability, replication and strong consistency as essentials for building reliable distributed systems.

Spring XD
Spring XD makes it easy to solve common big data problems such as data ingestion and export, real-time analytics, and batch workflow orchestration

Libraries

Sparkoin
Blockchain Analyzer based on Apache Spark

locis
Implementation of A Parallel Spatial Co-location Mining Algorithm Based on MapReduce

Toolsets

Hygieia
CapitalOne DevOps Dashboard

hygiea-screenshot1

BigDataDevKit
Big Data Development Kit (Hadoop / Spark / Zeppelin / IntelliJ)

Metrics Elasticsearch Reporter
Metrics reporter, which reports to elasticsearch

Spark SQL Performance Tests
This is a performance testing framework for Spark SQL in Apache Spark 1.6+.

redash
Connect to any data source, easily visualize and share your data.

Sql4D
Sql interface to druid.

sparkmagic
Jupyter magics and kernels for working with remote Spark clusters

flintrock
A command-line tool for launching Apache Spark clusters.

Examples

Spark Deep Learning
Deep Learning on Spark tutorial

Pipeline
Complete Pipeline Training at Big Data Scala By the Bay.

 


You can find a lot more tools, frameworks and libraries at PocketCluster Index. Go check it out! Looking into adding your repo? tweet to @stkim1!

E-mail Subscribtion
Subscribe for upcoming posts!
Join Slack
Join the channel!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s