data-engineering
Here are 751 public repositories matching this topic...
-
Updated
Apr 11, 2021
-
Updated
Apr 2, 2021
-
Updated
Apr 10, 2021
Current behavior
LocalStorage saves flows by default in a local that looks like Users/username. LocalStorage and LocalRun work well together because Prefect will able to find the Flow in that default location. The issue is when we combine LocalStorage with other RunConfigs. Users will get an error that looks like `Failed to load and execute Flow's environment: ModuleNotFoundError("No module
Describe the bug
When trying to run scaffolding (profiling) command, it fails because of commas in columns.
To Reproduce
Steps to reproduce the behavior:
- Run
great_expectations suite scaffold scaffold-nameon datasource where commas are in column - Bug
pandas.errors.ParserError: Error tokenizing data. C error: Expected 1 fields in line 5323 saw 2
Expected behavior
D
-
Updated
Apr 13, 2021 - Go
-
Updated
Jan 13, 2021
-
Updated
Apr 13, 2021 - Python
-
Updated
Apr 12, 2021 - JavaScript
Auth system test
The current system tests use the default admin user for all requests.
The auth test should create users with less privileges and check actions are passing or blocked according to the permissions.
-
Updated
Apr 13, 2021 - Jupyter Notebook
-
Updated
Mar 8, 2021 - Jupyter Notebook
-
Updated
Mar 9, 2020 - Python
Hi ,
I am using some basic functions from pyjanitor such as - clean_names() , collapse_levels() in one of my code which I want to productionise.
And there are limitations on the size of the production code base.
Currently ,if I just look at the requirements.txt for just "pyjanitor" , its huge .
I don't think I require all the dependencies in my code.
How can I remove the unnecessary ones ?
if they are not class methods then the method would be invoked for every test and a session would be created for each of those tests.
`class PySparkTest(unittest.TestCase):
@classmethod
def suppress_py4j_logging(cls):
logger = logging.getLogger('py4j')
logger.setLevel(logging.WARN)
@classmethod
def create_testing_pyspark_session(cls):
return Sp
-
Updated
Mar 4, 2021
-
Updated
Apr 13, 2021 - R
-
Updated
Mar 5, 2020 - Python
-
Updated
Mar 21, 2021 - Ruby
-
Updated
Feb 13, 2021
-
Updated
Apr 10, 2021
-
Updated
Feb 7, 2021 - CSS
-
Updated
Apr 9, 2021 - TypeScript
Egeria's open metadata labs use python notebooks to drive sequences of REST API calls to Egeria's runtime platform called the OMAG Server Platform. There is one function called printAssetUniverse that needs work. This function is designed to provide a data scientist with detailed information about an Asset (such as a file or a database). This includes name, description, its location, content,
-
Updated
Nov 29, 2018 - Java
sqlite does not provide helpful error messages when the parent folder does not exist
-
Updated
Apr 2, 2021
-
Updated
Apr 20, 2020 - Python
-
Updated
Mar 22, 2021 - Python
Improve this page
Add a description, image, and links to the data-engineering topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the data-engineering topic, visit your repo's landing page and select "manage topics."
Screenshot
Using Superset 1.0.1
Here for dates fields :
Here for some prices
Description
When analysing data in a table, one expects them to be ni