#
data-integration
Here are 253 public repositories matching this topic...
zhongjiajie
commented
Mar 10, 2022
Search before asking
- I had searched in the feature and found no similar feature requirement.
Description
Should combine Spark and Flink engine to a single page instead of in different. For example we doris sink in both [Spark](https://seatunnel.apache.org/docs/spark/configuration/sink-plugi
Privacy and Security focused Segment-alternative, in Golang and React
react
go
golang
security
privacy
data-warehouse
data-integration
hacktoberfest
warehouse-management
data-synchronization
hybrid-cloud
customer-data
rudder
customer-data-platform
rudder-labs
segment-alternative
rudderstack
customer-data-pipeline
customer-data-lake
warehouse-first
-
Updated
Mar 10, 2022 - Go
Upserts, Deletes And Incremental Processing on Big Data.
bigdata
stream-processing
data-integration
datalake
apachespark
hudi
apachehudi
incremental-processing
apacheflink
-
Updated
Mar 10, 2022 - Java
Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days
golang
bigquery
postgres
clickhouse
snowflake
data-integration
data-collection
redshift
data-connectors
-
Updated
Mar 10, 2022 - TypeScript
Community-curated list of software packages and data resources for single-cell, including RNA-seq, ATAC-seq, etc.
python
bioinformatics
analysis
clustering
gene-expression
data-visualization
dimensionality-reduction
awesome-list
data-integration
atac-seq
single-cell
rna-seq-data
scrna-seq-data
cell-cycle
cell-differentiation
gene-expression-profiles
analysis-pipeline
cell-populations
rna-seq-experiments
cell-clusters
-
Updated
Feb 11, 2022
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
-
Updated
Oct 27, 2021 - Python
IritaSee
commented
Jan 3, 2022
In this PR, I wanted to solve issue #25 by creating a CSV file to list and also help the brand property matching process. This PR including:
-
Compile a list of all brand names and operator names from the name-suggestion-index as a CSV with the columns
id,display_name, andwiki_dataintmpfolder.
Deadline: 05.01.2022 -
Create a PySpark UDF similar to the ones in the osm
Fast, sensitive and accurate integration of single-cell data with Harmony
-
Updated
Oct 29, 2021 - R
汇总Apache Hudi相关资料
bigdata
apache
stream-processing
data-integration
datalake
hudi
apachehudi
incremental-processing
hudi-resources
-
Updated
Mar 6, 2022
Use SQL to build ELT pipelines on a data lakehouse.
sql
apache-spark
etl
pipelines
data-engineering
data-lake
data-transfer
delta
data-integration
upsert
elt
data-pipeline
datalake
data-ingestion
spark-sql
zeppelin-notebook
apache-iceberg
lakehouse
incremental-updates
-
Updated
Jan 3, 2022 - JavaScript
wisnesky
commented
Sep 11, 2019
Complete algorithm: http://web.cecs.pdx.edu/~mpj/pubs/polyrec.html
NicheNet: predict active ligand-target links between interacting cells
rna-seq
gene-expression
network-inference
data-integration
single-cell-rna-seq
single-cell-omics
intercellular-communication
ligand-receptor
ligand-target
-
Updated
Feb 15, 2022 - R
Reference mapping for single-cell genomics
deep-learning
data-integration
single-cell
rna-seq-analysis
batch-correction
multimodal-deep-learning
multiomics
-
Updated
Feb 23, 2022 - Jupyter Notebook
An example mini data warehouse for python project stats, template for new projects
-
Updated
Jul 21, 2020 - Python
Hetionet: an integrative network of disease
-
Updated
Dec 10, 2020 - HTML
lovromazgon
commented
Jul 15, 2021
We should add a Github action that runs make generate and succeeds if there is no diff. It should run on each push to a PR.
We could do the same with proto files (generate them and make sure there's no diff).
Framework and command-line tools for integrating FollowTheMoney data streams from multiple sources
-
Updated
Feb 17, 2022 - Python
scikit-fusion: Data fusion via collective latent factor models
-
Updated
May 27, 2021 - Python
WInte.r is a Java framework for end-to-end data integration. The WInte.r framework implements well-known methods for data pre-processing, schema matching, identity resolution, data fusion, and result evaluation.
-
Updated
Feb 26, 2022 - Java
The Common Core Ontology Repository holds the current released version of the Common Core Ontology suite.
semantics
interoperability
data-integration
ontologies
owl-ontology
bfo
cco
applied-ontology
semantic-consistency
ontology-suite
-
Updated
Oct 6, 2021
-
Updated
Feb 2, 2022 - Python
An Efficient RML-Compliant Engine for Knowledge Graph Construction
-
Updated
Feb 24, 2022 - Python
an data-centric integration platform
-
Updated
Aug 9, 2021 - Java
First Party data integration solution built for marketing teams to enable audience and conversion onboarding into Google Marketing products (Google Ads, Campaign Manager, Google Analytics).
python
bigquery
google
conversions
dataflow
data-integration
googleanalytics
googleads
audiences
customermatch
audience-targeting
-
Updated
Mar 10, 2022 - Python
Scalable RDF Knowledge Graph Construction with [R2]RML Mappings
-
Updated
Feb 25, 2022 - Python
A .NET class library that allows you to import data from different sources into a unified destination
mysql
html
json
csv
sql-server
csharp
xml
sqlite
excel
tabular-data
data-import
oracle
databases
powerpoint
vcard
data-integration
schema-matching
sqlce
schema-mapping
msaccess
-
Updated
Feb 11, 2022 - C#
The Data Engineering Book - หนังสือวิศวกรรมข้อมูล ของคนไทย เพื่อคนไทย
data
book
data-engineering
data-integration
hacktoberfest
data-pipeline
data-engineer
data-ingestion
data-infrastructure
-
Updated
Jan 10, 2022
Utilities for creating ETL pipelines with mara
-
Updated
Jul 7, 2020 - PLpgSQL
Improve this page
Add a description, image, and links to the data-integration topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the data-integration topic, visit your repo's landing page and select "manage topics."
We should do something like https://blog.questionable.services/article/kubernetes-deployments-configmap-change/ to ensure that if the pod sweeper has a different config map the underlying pod gets rolled.