Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

When will upgrade object_store to 0.8? #1858

Closed
RobinLin666 opened this issue Nov 14, 2023 · 3 comments
Closed

When will upgrade object_store to 0.8? #1858

RobinLin666 opened this issue Nov 14, 2023 · 3 comments
Labels
enhancement New feature or request

Comments

@RobinLin666
Copy link
Contributor

Description

Use Case

There are a lot of features and bug fixes in object_store 0.8, when it will upgrade?

Related Issue(s)
@RobinLin666 RobinLin666 added the enhancement New feature or request label Nov 14, 2023
@rtyler
Copy link
Member

rtyler commented Nov 14, 2023

We're more or less beholden to our transitive dependencies like datafusion upgrading unfortunately.

I'm hoping to see a datafusion 33 in the next week or two

@rtyler rtyler closed this as completed Nov 14, 2023
@RobinLin666 RobinLin666 mentioned this issue Nov 16, 2023
Merged
@RobinLin666
Copy link
Contributor Author

We're more or less beholden to our transitive dependencies like datafusion upgrading unfortunately.

I'm hoping to see a datafusion 33 in the next week or two

Hi @rtyler, I saw the datafusion 33 is ready, but it still use 0.7 object_store, it means that delta-rs can only use 0.7 version of object_store? :-(

@ion-elgreco
Copy link
Collaborator

@rtyler :)

ion-elgreco pushed a commit that referenced this issue Mar 15, 2024
@RobinLin666
fix: compatible to write to local file systems that do not support ha…
9812bec 
…rd link (#1868)

compatible to write to local file systems that do not support hard link.

# Description

When we write to the local file system, sometimes hard link is not
supported, such as blobfuse, goofys, s3fs, so deal with it with
compatibility.

It is important to note that:
There is another problem with blobfuse, that is, when it comes to
rename, it will report errors. Because rename did not release the file
handle before.
See here for details: #1765

Arrow-rs is required to cooperate with the modification, for example:
https://github.com/GlareDB/arrow-rs/pull/2/files
Because object_store has been upgraded to 0.8, there are a lot of
breaking change, so I haven't changed this one for the time being. Will
fix it after upgrading to 0.8
#1858

# Related Issue(s)

#1765
 
#1376 

# Documentation
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@rtyler @ion-elgreco @RobinLin666