pipelines

Tasks:

• Port the content from GH readme to Docusaurus (main Docs website)
• Incorporate relevant CLI content into the Getting Started with Airbyte OSS guide
• Identify other places in Docs where we can incorporate CLI content

Summary

If there is a global default-get-timeout set on the web node, it is not possible to override that timeout for the implicit get step that is used to pull the image_resource configured on a task.

Steps to reproduce

Start up Concourse with default-get-timeout set very low

$ wget https://concourse-ci.org/docker-compose.yml

$ echo "      CONCOURSE_DEFAULT_GET

Use case

Polyaxon tracking can be used to automatically log all information generated by Ludwig.

We should probably think about adding support for Polyaxon's tracking module in Ludwig contrib.

Is your feature request related to a problem? Please describe.
It's cumbersome to create the same step twice.

Describe the solution you'd like
Add a button to duplicate a step in the pipeline editor.

Ideas
We could combine this with some other ideas in a context menu (right click).

Credit to Serhii Ostapchuk for contributing this on Slack.

https://docs.ploomber.io/en/latest/api/_modules/tasks/ploomber.tasks.PythonCallable.html#ploomber.tasks.PythonCallable

• simple example with a couple of tasks and a few variations (one product, many products)
• link to other relevant sections in the docs and other examples in projects

Problem
Some of our transformers & estimators are not thoroughly tested or not tested at all.

Solution
Use OpTransformerSpec and OpEstimatorSpec base test specs to provide tests for all existing transformers & estimators.

Contact Details [Optional]

support@zenml.io

Describe the feature you'd like

Currently our CLI offers a way to install the python packages that are required for a given integration. However, some of our integrations also have system requirements that are necessary to make them work (graphviz, kubectl, etc. ).
All system requirements should be listed on an integration level, just

Receive events from MSK with IAM auth config https://docs.aws.amazon.com/msk/latest/developerguide/iam-access-control.html

Is your feature request related to a problem? Please describe.
The elyra-pipeline CLI displays a documentation link when help is invoked, e.g.

$ elyra-pipeline --help
Usage: elyra-pipeline [OPTIONS] COMMAND [ARGS]...

  Run Elyra pipelines in your local environment or submit them to an external
  service, such as Kubeflow Pipelines or Apache Airflow.

  Find more information at:

Feature request

Add the Pull Request body to the event for GitHub comment update eventTypes. This should be an opt-in

This would be essentially adding the add-pr-body interceptor logic to the existing GitHub interceptor.

Use case

1. Running CI based on updates to comments in a GitHub PR
2. See use cases in tekoncd/plumbing

Hi!

When using the unprivileged image, it's not possible to load custom configurations.

# podman run -p 8080:8080 -e GITLAB_MONITOR_CONFIG=/tmp/config.json timoschwarzer/gitlab-monitor:unprivileged
/wrapper.sh: line 4: can't create /usr/share/nginx/html/config.json: Permission denied

Indeed, root is needed to create a new file in /usr/share/nginx/html, and it looks like wrapper.s