Skip to content
#

etl-framework

Here are 114 public repositories matching this topic...

leventyalcin
leventyalcin commented Jan 20, 2021

Hi,

I was trying to install logstash on Amazon Linux 2. After installing it, I couldn't start/enable the service. After some debugging, I noticed the systemd configuration installed by /usr/share/logstash/bin/system-install. However, I do my tests and development mostly on AWS t3.nano and this binary is memory intensive and won't work on low memory.

The exit code could have been checked

AlvaroMarquesAndrade
AlvaroMarquesAndrade commented Sep 17, 2020

Pivot missing categories breaks FeatureSet/AggregatedFeatureSet

Summary

When defining a feature set, it's expected that pivot will have all categories and, as a consequence, the resulting Source dataframe will be suitable to be transformed. When a different behavior happens, FeatureSet and AggregatedFeatureSet breaks.

Feature related:

Age: legacy

ecourtial
ecourtial commented Jun 15, 2020

In some use case, we might need many instance of the same component (ETL, CSV Extractor...).

So far there is two way to proceed:

  • Use DI. But your constructor could become huge.
  • Use DI + clone. But become difficult to test.

We might consider to create a factory. It would be a class with one public method get(), with two parameters:

  • The classname of the request component
  • The option

Improve this page

Add a description, image, and links to the etl-framework topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the etl-framework topic, visit your repo's landing page and select "manage topics."

Learn more