sparkml

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

spark 机器学习:利用jupyter工作来讲解算法原理并运行相关例子

Because its never late to start taking notes and 'public' it...

This code is used to build & run a Docker container for performing predictions against a Spark ML Pipeline.

JPMML-SparkML plugin for converting LightGBM-Spark models to PMML

Machine learning utilities for model conversion, serialization, loading etc

Recommendation engine in Java. Based on an ALS algorithm (Apache Spark). Train a new model after N seconds.

Helper functions for building complex Spark ML pipelines

A collection of “cookbook-style” scripts for simplifying data engineering and machine learning in Apache Spark.

bigdata examples about spark and flink

Free High-Quality Financial Data in Azure

Transformation of Akamai Logs with Spark ETL and discover of Values and similarities in logs used SparkML and H2O ML

BigData Engineering Capstone Project with Tech-stack : Linux, MySQL, sqoop, HDFS, Hive, Impala, SparkSQL, SparkML, git

Twitter Sentiment Analysis using Spark, MongoDB, and Google Cloud

Predicting the arrival delay time of commercial flights

Repo for using scala in a kaggle house price prediction.

Using SparkML to build different machine learning models for simulating a small scale of big data management

Online latent state estimation with Spark

Topic modeling from Facebook news pages

A machine learning at scale demo on flight delay prediction. The project includes an exploration of a series of data transformation and ML pipelines in Apache Spark (via Databricks).