partition_by with "$" on local filesystem

[sebastianfuchsprivate]

Environment

Delta-rs version: 0.10.1

Binding: Python

Environment:

• Cloud provider: n/a
• OS: Linux/Ubuntu/WSL
• Other: local filesystem (ext4)

---

Bug

What happened:
error in reading DeltaTable (deltalake.table.DeltaTable) - FileNotFoundError

What you expected to happen:
Load of DeltaTable

How to reproduce it:
Create a DeltaLake on local filesystem which contains a partition with "$" - deltalake.writer.write_deltalake(path, df, name = name, partition_by = partition). Try to read it dt = deltalake.table.DeltaTable(path) and access the columns df = dt.to_pandas(columns=cols).

More details:
When the DeltaLake is written with a partition_by the "$" char is replaced with "%2524". On read the $ is kept, a file not found error is thrown. In my case:
On write where partition is "Exchange_Code" which contains a value of "ID$", the directory created is "Exchange_Code=ID%2524" which contains a file 10-38fbb976-1e37-4fe1-b008-31194f837d9c-0.parquet.
On read the error is: "FileNotFoundError: Object at location path/Exchange_Code=ID$/10-38fbb976-1e37-4fe1-b008-31194f837d9c-0.parquet not found: No such file or directory (os error 2)"

The parquet file itself is accessible from OS level.

[sebastianfuchsprivate]

Might be related to #1079, sorry haven't seen this earlier