Weekly BigData Roundup – May 12, 2016

This week’s roundup lists a cool new project, Sparkoin, a blockchain analyzer based on Apache Spark!

Frameworks

DistributedLog
DistributedLog (DL) is a high-performance, replicated log service, offering durability, replication and strong consistency as essentials for building reliable distributed systems.

Spring 😄
Spring 😄 makes it easy to solve common big data problems such as data ingestion and export, real-time analytics, and batch workflow orchestration

Libraries

Sparkoin
Blockchain Analyzer based on Apache Spark

locis
Implementation of A Parallel Spatial Co-location Mining Algorithm Based on MapReduce

Toolsets

Hygieia
CapitalOne DevOps Dashboard

hygiea-screenshot1

BigDataDevKit
Big Data Development Kit (Hadoop / Spark / Zeppelin / IntelliJ)

Metrics Elasticsearch Reporter
Metrics reporter, which reports to elasticsearch

Spark SQL Performance Tests
This is a performance testing framework for Spark SQL in Apache Spark 1.6+.

redash
Connect to any data source, easily visualize and share your data.

Sql4D
Sql interface to druid.

sparkmagic
Jupyter magics and kernels for working with remote Spark clusters

flintrock
A command-line tool for launching Apache Spark clusters.

Examples

Spark Deep Learning
Deep Learning on Spark tutorial

Pipeline
Complete Pipeline Training at Big Data Scala By the Bay.

 


You can find a lot more tools, frameworks and libraries at PocketCluster Index. Go check it out! Looking into adding your repo? tweet to @stkim1!

E-mail Subscribtion
Subscribe for upcoming posts!
Join Slack
Join the channel!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s