Spotify

Repositories

• scio

  A Scala API for Apache Beam and Google Cloud Dataflow.

  bigquery data streaming scala beam google-cloud ml
  Scala Apache-2.0 387 1,984 71 (22 issues need help) 5 Updated Oct 5, 2020

• backstage

  Backstage is an open platform for building developer portals

  infrastructure microservices cncf dx developer-experience developer-portal hacktoberfest
  2 packages TypeScript Apache-2.0 587 7,941 172 (81 issues need help) 34 Updated Oct 5, 2020

• klio
  Python Apache-2.0 0 8 0 5 Updated Oct 5, 2020

• featran

  A Scala feature transformation library for data science and machine learning

  data scala spark tensorflow ml xgboost algebird
  Scala Apache-2.0 57 383 10 (5 issues need help) 0 Updated Oct 5, 2020

• comet-common

  Comet is an alert distribution framework which allows you to distribute alerts all the way to the resource owner with customizable owner lookup, de-duplication, alert formatting as well as automated follow up and metrics.
  Python Apache-2.0 13 8 0 0 Updated Oct 5, 2020

• magnolify

  A collection of Magnolia add-on modules

  cats bigquery scala avro tensorflow google-cloud datastore
  Scala Apache-2.0 12 45 9 0 Updated Oct 5, 2020

• annoy-java

  Approximate nearest neighbors in Java
  Java Apache-2.0 39 106 5 0 Updated Oct 5, 2020

• mobius

  A functional reactive framework for managing state evolution and side-effects.

  android java state-management functional-reactive-programming mobius
  Java Apache-2.0 51 786 7 3 Updated Oct 5, 2020

• styx

  "The path to execution", Styx is a service that schedules batch data processing jobs in Docker containers on Kubernetes.
  Java Apache-2.0 38 188 4 2 Updated Oct 5, 2020

• luigi

  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

  python hadoop scheduling orchestration-framework luigi
  Python Apache-2.0 2,173 13,782 38 14 Updated Oct 5, 2020

• dbeam

  DBeam exports SQL tables into Avro files using JDBC and Apache Beam
  1 package Java Apache-2.0 38 138 10 (1 issue needs help) 15 Updated Oct 5, 2020

• tfreader

  TensorFlow TFRecord reader CLI tool

  cats cli scala tensorflow fs2 tfrecords graal-native
  Scala Apache-2.0 8 27 1 1 Updated Oct 4, 2020

• scio-idea-plugin

  Scio IDEA plugin

  scala intellij idea scala-macros
  Scala Apache-2.0 10 27 3 1 Updated Oct 4, 2020

• scio.g8

  A Giter8 template for scio

  scala giter8-template scio
  Scala Apache-2.0 16 24 1 1 Updated Oct 4, 2020

• ratatool

  A tool for data sampling, data generation, and data diffing

  bigquery scala protobuf avro parquet scalacheck
  Scala Apache-2.0 48 268 15 (2 issues need help) 5 Updated Oct 4, 2020

• noether

  Scala Aggregators used for ML Model metrics monitoring

  machine-learning scala
  Scala Apache-2.0 12 70 4 3 Updated Oct 4, 2020

• elitzur
  Scala Apache-2.0 5 12 0 9 Updated Oct 4, 2020

• big-data-rosetta-code

  Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code

  scala spark bigdata scalding scio
  Scala Apache-2.0 24 232 1 1 Updated Oct 4, 2020

• web-api-auth-examples

  Basic examples to authenticate and fetch data using the Spotify Web API
  HTML Apache-2.0 915 1,145 20 15 Updated Oct 3, 2020

• heroic

  The Heroic Time Series Database

  java elasticsearch cassandra monitoring time-series ha tsdb
  Java Apache-2.0 101 813 52 1 Updated Oct 3, 2020

• NFGrapher

  Implementation and spec for the Native Format Score Library
  TypeScript Apache-2.0 1 6 1 2 Updated Oct 3, 2020

• NFDecoder

  A cross platform decoder for producing PCM data from encoded audio media formats.
  C++ Apache-2.0 0 11 1 0 Updated Oct 3, 2020

• NFHTTP

  A cross platform C++ HTTP library that interfaces natively to other platforms.
  C Apache-2.0 29 498 9 (1 issue needs help) 2 Updated Oct 3, 2020

• proto-requests
  TypeScript Apache-2.0 1 3 0 0 Updated Oct 2, 2020

• homebrew-public

  Homebrew formula for open-source software developed by Spotify

  homebrew spotify
  Ruby Apache-2.0 22 42 0 0 Updated Oct 2, 2020

• ffwd

  a flexible metric forwarding agent

  java monitoring metrics
  Java Apache-2.0 31 71 17 1 Updated Oct 2, 2020

• annoy

  Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

  python golang c-plus-plus lua nearest-neighbor-search locality-sensitive-hashing approximate-nearest-neighbor-search
  C++ Apache-2.0 833 7,613 21 3 Updated Oct 2, 2020

• zoltar

  Common library for serving TensorFlow, XGBoost and scikit-learn models in production.

  java machine-learning tensorflow xgboost model-serving
  Java Apache-2.0 28 112 17 (12 issues need help) 11 Updated Oct 2, 2020

• dockerfile-mode

  An emacs mode for handling Dockerfiles
  Emacs Lisp Apache-2.0 59 381 9 3 Updated Sep 30, 2020

• web-scripts

  A collection of base configs and CLI wrappers used to speed up development @ Spotify.
  TypeScript Apache-2.0 32 264 12 12 Updated Sep 29, 2020