#

data-integration

Here are 249 public repositories matching this topic...

airbytehq / airbyte

Open

New Source: Mambu

ikanez commented Feb 3, 2022

Tell us about the new connector you’d like to have

Which source and which destination?
Source: mambu (https://api.mambu.com/)
Destination: S3, RDS, Redshift
Do you need a specific version of the underlying data source e.g: you specifically need support for an older version of the API or DB?
Want to support for since 1.0.

Describe the context around this new connector

Why do yo

Read more

type/enhancement good first issue area/connectors new-connector

Open

Basic Normalization: Overrule default parameter values (query_tag a.o.)

3

Open

Add container name for source/destination container launched by Airbyte worker

Find more good first issues

apache / incubator-seatunnel

Open

Please translate the FAQ into English

7

dailidong commented Dec 15, 2021

Please translate the FAQ into English
the FAQ issue are as follows, apache/incubator-seatunnel#267

Read more

good first issue

Open

[Feature][UT] add unit test

4

rudder-server

rudderlabs / rudder-server

Privacy and Security focused Segment-alternative, in Golang and React

react go golang security privacy data-warehouse data-integration hacktoberfest warehouse-management data-synchronization hybrid-cloud customer-data rudder customer-data-platform rudder-labs segment-alternative rudderstack customer-data-pipeline customer-data-lake warehouse-first

Updated Feb 16, 2022
Go

apache / hudi

Upserts, Deletes And Incremental Processing on Big Data.

bigdata stream-processing data-integration datalake apachespark hudi apachehudi incremental-processing apacheflink

Updated Feb 16, 2022
Java

jitsu

jitsucom / jitsu

Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days

golang bigquery postgres clickhouse snowflake data-integration data-collection redshift data-connectors

Updated Feb 16, 2022
TypeScript

seandavi / awesome-single-cell

Community-curated list of software packages and data resources for single-cell, including RNA-seq, ATAC-seq, etc.

python bioinformatics analysis clustering gene-expression data-visualization dimensionality-reduction awesome-list data-integration atac-seq single-cell rna-seq-data scrna-seq-data cell-cycle cell-differentiation gene-expression-profiles analysis-pipeline cell-populations rna-seq-experiments cell-clusters

Updated Feb 11, 2022

mara / mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

python data pipeline etl postgresql data-integration

Updated Oct 27, 2021
Python

kuwala

kuwala-io / kuwala

Open

OSM-POI: including brand property

4

IritaSee commented Jan 3, 2022

In this PR, I wanted to solve issue #25 by creating a CSV file to list and also help the brand property matching process. This PR including:

Compile a list of all brand names and operator names from the name-suggestion-index as a CSV with the columns id, display_name, and wiki_data in tmp folder.
Deadline: 05.01.2022
Create a PySpark UDF similar to the ones in the osm

Read more

enhancement good first issue pipeline/osm-poi

Open

Running demo on Windows

7

Open

OSM-POI: Introduce subcategories

immunogenomics / harmony

Fast, sensitive and accurate integration of single-cell data with Harmony

algorithm r scrna-seq data-integration

Updated Oct 29, 2021
R

cuebook / cuelake

Use SQL to build ELT pipelines on a data lakehouse.

sql apache-spark etl pipelines data-engineering data-lake data-transfer delta data-integration upsert elt data-pipeline datalake data-ingestion spark-sql zeppelin-notebook apache-iceberg lakehouse incremental-updates

Updated Jan 3, 2022
JavaScript

leesf / hudi-resources

汇总Apache Hudi相关资料

bigdata apache stream-processing data-integration datalake hudi apachehudi incremental-processing hudi-resources

Updated Jan 23, 2022

CategoricalData / CQL

Open

Add type inference for open APG terms

wisnesky commented Sep 11, 2019

Complete algorithm: http://web.cecs.pdx.edu/~mpj/pubs/polyrec.html

Read more

good first issue APG

Open

Randomizer for instance presentations

Open

A few suggestions to attract contributors and make the project more robust

4

Find more good first issues

saeyslab / nichenetr

NicheNet: predict active ligand-target links between interacting cells

rna-seq gene-expression network-inference data-integration single-cell-rna-seq single-cell-omics intercellular-communication ligand-receptor ligand-target

Updated Feb 15, 2022
R

theislab / scarches

Reference mapping for single-cell genomics

deep-learning data-integration single-cell rna-seq-analysis batch-correction multimodal-deep-learning multiomics

Updated Feb 8, 2022
Jupyter Notebook

mara / mara-example-project-2

An example mini data warehouse for python project stats, template for new projects

bigquery sql etl pypi data-integration

Updated Jul 21, 2020
Python

hetio / hetionet

Hetionet: an integrative network of disease

neo4j network rephetio hetionet hetnet drug-repurposing data-integration

Updated Dec 10, 2020
HTML

ceumicrodata / mETL

mito ETL tool

python pipeline etl data-integration etl-framework

Updated Jun 1, 2021
Python

conduit

ConduitIO / conduit

Open

Add CI action for generated code

lovromazgon commented Jul 15, 2021

We should add a Github action that runs make generate and succeeds if there is no diff. It should run on each push to a PR.

We could do the same with proto files (generate them and make sure there's no diff).

Read more

good first issue housekeeping

opensanctions / nomenklatura

Framework and command-line tools for integrating FollowTheMoney data streams from multiple sources

data-integration deduplication record-link

Updated Feb 9, 2022
Python

mims-harvard / scikit-fusion

scikit-fusion: Data fusion via collective latent factor models

embeddings matrix-factorization data-integration latent-features data-fusion knowledge-graphs

Updated May 27, 2021
Python

olehmberg / winter

WInte.r is a Java framework for end-to-end data integration. The WInte.r framework implements well-known methods for data pre-processing, schema matching, identity resolution, data fusion, and result evaluation.

identity-resolution tabular-data data-integration schema-matching data-fusion

Updated Jan 4, 2022
Java

CommonCoreOntology / CommonCoreOntologies

The Common Core Ontology Repository holds the current released version of the Common Core Ontology suite.

semantics interoperability data-integration ontologies owl-ontology bfo cco applied-ontology semantic-consistency ontology-suite

Updated Oct 6, 2021

slowkow / harmonypy

🎼 Integrate multiple high-dimensional datasets with fuzzy k-means and locally linear adjustments.

data-science data-integration

Updated Feb 2, 2022
Python

SDM-TIB / SDM-RDFizer

An Efficient RML-Compliant Engine for Knowledge Graph Construction

knowledge-graph data-integration rml

Updated Feb 15, 2022
Python

datasphere-oss / datasphere-integration

an data-centric integration platform

etl kettle esb data-integration elt data-sharing realtime-messaging data-bus data-interchange

Updated Aug 9, 2021
Java

megalista

google / megalista

First Party data integration solution built for marketing teams to enable audience and conversion onboarding into Google Marketing products (Google Ads, Campaign Manager, Google Analytics).

python bigquery google conversions dataflow data-integration googleanalytics googleads audiences customermatch audience-targeting

Updated Feb 15, 2022
Python

munchy-bytes / SchemaMapper

A .NET class library that allows you to import data from different sources into a unified destination

Updated Feb 11, 2022
C#

dataengineercafe / data-engineering-book

The Data Engineering Book - หนังสือวิศวกรรมข้อมูล ของคนไทย เพื่อคนไทย

data book data-engineering data-integration hacktoberfest data-pipeline data-engineer data-ingestion data-infrastructure

Updated Jan 10, 2022

mara / mara-etl-tools

Utilities for creating ETL pipelines with mara

sql etl data-integration date-dimension sql-utils

Updated Jul 7, 2020
PLpgSQL

oeg-upm / morph-kgc

Scalable RDF Knowledge Graph Construction with [R2]RML Mappings

python database rdf knowledge-graph data-integration r2rml rml

Updated Feb 16, 2022
Python

Improve this page

Add a description, image, and links to the data-integration topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the data-integration topic, visit your repo's landing page and select "manage topics."