arrow

Feature Request

Many locales have the bare minimum when it comes to test cases. While I understand it can be tedious and repetitive to write out test case

Is your feature request related to a problem? Please describe.

The row_equality_comparator constructor currently accepts a bool to indicate if nulls are considered equal or not. In libcudf, we prefer to use scoped enums instead of bools and we already have a [`

In pandas assert_frame_equals has the check_exact flag which allows for inexact number comparisons with tolerances defined by the rtol (relative tolerance) and atol (absolute tolerance). This would be nice to have in polars as well, since it allows for ignoring floating point rounding error

We no longer need to control the number of concurrent kernels, since now we control the number of concurrent tasks

I think it would be useful if ROAPI can not only use Arrow IPC for response encoding, but also as a dataset format.

Problem description

Reading a dataset with eager's read functionality raises a ValueError when providing columns.

Example code (ideally copy-pastable)

import pandas as pd

from tempfile import TemporaryDirectory
from functools import partial
from storefact import get_store_from_url

from kartothek.io.eager import store_dataframes_as_dataset, read_dataset_as_data

It would be helpful to have Fletchgen output warnings for unused metadata fields that start with fletcher_. For example, (this happened to me) when someone adds fletchgen_epc to Schema metadata instead of Field metadata.

use https://crates.io/crates/rustc-hash rather than the old unmaintained fxhash crate.