Summary

https://docs.dagster.io/overview/io-managers/io-managers

Reproduction

seems there is a bug in DB2LUWSchemaProvider class, when loading columns of table, it didn't trim the tailing space of the schema name, causes linq query didn't return any column.

the problem is in the GetColumns method here:

var tableId     = dataConnection.Connection.Database + "." + rd.GetString(0) + "." + rd.GetString(1);

and it should be:

var tableId     = dataConnect

问题描述：关于工程中某个工作流节点单独执行不报错，保存工作流时提示：NotClassDefFoundError：Cloud not initialize class dispatch.Http$

问题原因：linkis-publish微服务关于netty-3.6.2.Final.jar升级包缺失

问题解决：将升级包上传重启linkis-publish微服务即可。

The functions in this file should be factored out to a separate utility lib as they are reused in bitcoin-etl https://github.com/blockchain-etl/ethereum-etl/blob/develop/ethereumetl/misc_utils.py

Overview:

Developers may run mage commands against multiple different versions of panther.

The mage logs do not specify the version of panther.

If we have the git commit we can be sure of the command context.

Example:

Specifically I am running integration tests for release testing. I pulled the repo and achieved successful integration test results. Pull resulted in updates to

Tell us about the problem you're trying to solve

When specifying a Dataset_id, the Google UI often includes the project_id in its naming like this: project_id:dataset_id

Describe the solution you’d like

In the BigQuery destination code, we could accept both syntax:

• project_id:dataset_id
• dataset_id

So it's smoother for the end user whether project_id is specified or not?

if they are not class methods then the method would be invoked for every test and a session would be created for each of those tests.

`class PySparkTest(unittest.TestCase):
@classmethod
def suppress_py4j_logging(cls):
logger = logging.getLogger('py4j')
logger.setLevel(logging.WARN)

@classmethod
def create_testing_pyspark_session(cls):
    return Sp

Right now, these aren't caught until we try to gob-encode. Consider failing faster in type-checking to avoid too much confusion/loss when it works with local execution.