TFX is an end-to-end platform for deploying production ML pipelines
-
Updated
May 12, 2022 - Python
#
apache-beam
Here are 170 public repositories matching this topic...
Google-provided Cloud Dataflow template pipelines for solving simple in-Cloud data tasks
bigquery
google-cloud-storage
google-cloud-dataflow
apache-beam
bigtable
google-cloud-spanner
dataflow-templates
-
Updated
May 12, 2022 - Java
Yet Another UserAgent Analyzer
java
parse
user-agent
hive
snowplow
user-agent-parser
snowflake
analyzer
pig
apache-beam
apache-flink
udf
flink
nifi-processors
snowplowanalytics
apache-hive
nifi-processor
trino-plugin
-
Updated
May 12, 2022 - Java
cfezequiel
commented
Oct 14, 2020
Is your feature request related to a problem? Please describe.
Change split values from all caps to lower case.
This makes file/directory naming more consistent with the split.
Describe the solution you'd like
TRAIN -> train
VALIDATION -> validation
TEST -> test
Describe alternatives you've considered
- No change
- There's a bit of skew when it comes to mapping split val
Clojure API for a more dynamic Google Dataflow
-
Updated
Apr 25, 2022 - Clojure
timsn
commented
Feb 3, 2022
When looking through the FlinkCluster CRD I can see there are securityContext definitions for Jobmanager, Taskmanger and Job specs. All of these are of the type PodSecurityContext which is fine.
Besides that it would great to be able to set the corresponding Container [SecurityContext](https://kube
good first issue
Good for newcomers
alxmrs
commented
Feb 9, 2022
Check out TODO in unit_test.py.
Collection of transforms for the Apache beam python SDK.
-
Updated
Apr 14, 2022 - Python
Repository to quickly get you started with new Machine Learning projects on Google Cloud Platform. More info(slides):
-
Updated
Oct 27, 2018 - Python
Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow
-
Updated
Oct 12, 2020 - Java
Some class materials for a data processing course using PySpark
-
Updated
Dec 18, 2021 - Python
Opinionated serverless event analytics pipeline
-
Updated
Sep 23, 2020 - Go
Microservices in Post-Kubernetes Era. A polyglot monorepo
kotlin
jenkins
microservice
monorepo
semantic-versioning
semantic-release
apache-beam
gitflow
conventional-changelog
gitflow-workflow
sprintboot
gradle-kotlin-dsl
conventional-commits
gitops
micronaut
quarkusio
-
Updated
May 8, 2022 - Kotlin
Apache Beam examples for running on Google Cloud Dataflow.
aws-s3
google-cloud-storage
google-cloud
google-cloud-dataflow
apache-beam
google-cloud-platform
google-cloud-pubsub
-
Updated
Sep 17, 2018 - Java
Log analysis pipeline utilizing Apache Beam
-
Updated
Feb 3, 2022 - Java
Asgarde allows simplifying error handling with Apache Beam, with less code, more concise and expressive code.
-
Updated
Apr 20, 2022 - Java
Convenient Dataflow pipelines for transforming data between cloud data sources
-
Updated
Apr 28, 2022 - Java
Presents an optimized Apache Beam pipeline for generating sentence embeddings (runnable on Cloud Dataflow).
-
Updated
Mar 7, 2022 - Python
Source code for the YouTube video, Apache Beam Explained in 12 Minutes
-
Updated
Oct 23, 2020 - Python
An io connector of Apache Beam to access MySQL databases.
-
Updated
Dec 22, 2021 - Python
The Proxima platform.
apache-spark
iot-platform
apache-beam
apache-flink
batch-processing
analytical-platform
streaming-processing
unified-data-processing
data-mesh
-
Updated
May 10, 2022 - Java
Statistical processing of COVID-19 data using Apache Beam for Google Cloud Dataflow in Python. Project for the exam of "Sistemi ed Applicazioni Cloud" (2019-20), Magistrale di Ingegneria Informatica at the Dipartimento di Ingegneria Enzo Ferrari.
-
Updated
Apr 20, 2020 - Python
Scala examples for using Apache Beam Java API (2.1.0)
-
Updated
Nov 7, 2017 - Scala
Public source code for the Batch Processing with Apache Beam (Python) online course
-
Updated
Sep 29, 2020 - Python
Tokenize Japanese text on BigQuery with Kuromoji in Apache Beam/Google Dataflow at scale
-
Updated
Apr 22, 2022 - Java
A fluent API layer for tensorflow extended e2e machine learning pipelines
-
Updated
Sep 8, 2020 - Python
Improve this page
Add a description, image, and links to the apache-beam topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the apache-beam topic, visit your repo's landing page and select "manage topics."
Related question GoogleCloudPlatform/flink-on-k8s-operator#114