Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Snapshot restoration from an Azure File Share fails #126

Open
triantafillos opened this issue Jan 3, 2024 · 0 comments
Open

Snapshot restoration from an Azure File Share fails #126

triantafillos opened this issue Jan 3, 2024 · 0 comments

Comments

@triantafillos
Copy link

triantafillos commented Jan 3, 2024

Hello and Happy New Year!

I have a cluster running on AKS and qdrant deployed via the helm chart, running on a single node. I want to restore a collection from a snapshot while deploying qdrant. I have the snapshot on a file share on a storage account. I have created a PV to the file share and a PVC for the PV. I am trying to use the "snapshotRestoration" functionality on the helm values. However, when I try to install with helm, I get an error that there is not such a file or directory.

The file share on the storage account is called snapshots and inside I have the snapshot file (test_collection-5941431224246310-2023-12-21-09-59-22.snapshot).

The section on my helm values for the snapshot is:

updateConfigurationOnChange: true
snapshotRestoration:
  enabled: true
  pvcName: snapshots-pvc
  snapshots:
    - /snapshots/test_collection-5941431224246310-2023-12-21-09-59-22.snapshot:test_collection

After I install via helm, the error I get in the logs of the pod is:

2024-01-03T08:08:34.900384Z  INFO storage::content_manager::consensus::persistent: Loading raft state from ./storage/raft_state.json    
2024-01-03T08:08:34.900675Z  INFO qdrant::snapshots: Recovering snapshot test_collection from /snapshots/test_collection-5941431224246310-2023-12-21-09-59-22.snapshot    
2024-01-03T08:08:34.900682Z  INFO qdrant::snapshots: Collection path: ./storage/collections/test_collection    
2024-01-03T08:08:34.912670Z ERROR qdrant::startup: Panic backtrace: 
   0: qdrant::startup::setup_panic_hook::{{closure}}
   1: <alloc::boxed::Box<F,A> as core::ops::function::Fn<Args>>::call
             at /rustc/d5c2e9c342b358556da91d61ed4133f6f50fc0c3/library/alloc/src/boxed.rs:2007:9
   2: std::panicking::rust_panic_with_hook
             at /rustc/d5c2e9c342b358556da91d61ed4133f6f50fc0c3/library/std/src/panicking.rs:709:13
   3: std::panicking::begin_panic_handler::{{closure}}
             at /rustc/d5c2e9c342b358556da91d61ed4133f6f50fc0c3/library/std/src/panicking.rs:597:13
   4: std::sys_common::backtrace::__rust_end_short_backtrace
             at /rustc/d5c2e9c342b358556da91d61ed4133f6f50fc0c3/library/std/src/sys_common/backtrace.rs:151:18
   5: rust_begin_unwind
             at /rustc/d5c2e9c342b358556da91d61ed4133f6f50fc0c3/library/std/src/panicking.rs:593:5
   6: core::panicking::panic_fmt
             at /rustc/d5c2e9c342b358556da91d61ed4133f6f50fc0c3/library/core/src/panicking.rs:67:14
   7: qdrant::snapshots::recover_snapshots
   8: qdrant::main
   9: std::sys_common::backtrace::__rust_begin_short_backtrace
  10: main
  11: <unknown>
  12: __libc_start_main
  13: _start
    
2024-01-03T08:08:34.912689Z ERROR qdrant::startup: Panic occurred in file src/snapshots.rs at line 70: Failed to recover snapshot test_collection: Service internal error: File IO error: No such file or directory (os error 2)

Is there something I am configuring incorrectly or something I am missing? Can someone help?

Thanks in advance

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant