Machine learning researcher applying deep learning to transportation and the urban environment.
pysparkling now supports stream processing with discrete streams, called DStream. This post shows a simple example that uses this new API.
in Tech · March 11, 2017
A pure Python implementation of Apache Spark’s RDD interfaces. pysparkling does not depend on Java and has a small execution overhead. It can be a fast test runner for Spark applications.
in Tech · May 29, 2015
in Tech · April 25, 2014