compact fails with merged schemas

[cmettler]

Environment

Delta-rs version: deltalake-0.16.3

Binding: python

---

Bug

What happened:
writing two dataframes with different schemas with schema_mode='merge' causes a compact to fail

What you expected to happen:
succesfully compact the files with the merged schema

How to reproduce it:

df1 = pd.DataFrame({'A':[1]})
write_deltalake(target_table, df1,engine="rust",storage_options=storage_options,mode='append',schema_mode='merge')

df2 = pd.DataFrame({'B':[2]})
write_deltalake(target_table, df2,engine="rust",storage_options=storage_options,mode='append',schema_mode='merge')

dt = DeltaTable(target_table,storage_options=storage_options)
dt.optimize.compact()

fails with: SchemaMismatchError: Could not find column B