deduplication

Considering issues like #5954 are bad to solve / debug without this information, borg should debug log full paths of all caches / indexes it uses.

Creating an issue to capture this discussion on the Kopia Discourse forum with @jkowalski. Per his reply:

"It’s not intentional, but Kopia indeed expects this to be a file and not symlink today. Happy to review PR to fix it."

What follows is an embedding of the original post I wrote up for convenience:

Is your feature request related to a problem? Please describe.
Currently, MapType are not supported for Spark DataFrames

Describe the solution you'd like
Add support for MapType Spark DataFrame columns

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other co

Right dduper has minimal test script to check basic functionality See ci/gitlab/*.sh . Enhance it add RAID tests.

I just discovered this now. I'm wondering if you could create some sort of feature comparison table to show how this compares to restic (and maybe even other popular tools) so that we can easily evaluate if this will suit our needs.

Moreover, perhaps it would be worth adding some detail to the readme explaining why this exists as opposed to just continuing to contribute to restic or others tool