Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Copy to SFTP fails #443

Closed
NiJoao opened this issue Jun 7, 2018 · 5 comments
Closed

Copy to SFTP fails #443

NiJoao opened this issue Jun 7, 2018 · 5 comments

Comments

@NiJoao
Copy link

NiJoao commented Jun 7, 2018

Hi,
I don't seem to be able to copy my 700GB local repository to an SFTP one.

Local Chunk folder:

Chunk folder on the SFTP:
149 GB, 45 533 Files, 256 Folders. (copied via SFTP client, same error when empty)

Steps made on the local machine:

mkdir -p Downloads\repo
cd C:\Users\USER\Downloads\repo

.duplicacy\duplicacy_win_x64_2.1.0.exe init -e -c 4M repo D:\Partilha\Backups\Duplicacy
## The repository already existed, used same password, everything succeeded.
.duplicacy\duplicacy_win_x64_2.1.0.exe add -copy default -e -bit-identical offsite_storage repo sftp://USER@SERVER:PORT/Duplicacy
## Succeedes, creates the fodlers and config files on the server.

.duplicacy\duplicacy_win_x64_2.1.0.exe list -all
## This succeeds, lists thousands of chunks.
.duplicacy\duplicacy_win_x64_2.1.0.exe list -all -storage offsite
## This succeeds, listing nothing.

.duplicacy\duplicacy_win_x64_2.1.0.exe -d copy -threads 1 -to offsite -upload-limit-rate 800 -id Some_ID -r 1

The last command outputs Hundreds of lines "Listing chunks", but ends with:

....
Listing chunks/02/
Listing chunks/01/
Listing chunks/00/

Found 30618 chunks on destination storage
Chunks to copy = 215, to skip = 53, total = 268
Total chunks in source snapshot revisions = 268

Copying chunk 91a618e10a617207cf52cf040a994cde40d73ef3c4025370a170d0fee1905be2 to 91a618e10a617207cf52cf040a994cde40d73ef3c4025370a170d0fee1905be2
Chunk 91a618e10a617207cf52cf040a994cde40d73ef3c4025370a170d0fee1905be2 has been downloaded
Copying chunk ee9f5c4dbf9a75b3da95308413243c5b22ed321212e07069dbb5c026f73f8ec7 to ee9f5c4dbf9a75b3da95308413243c5b22ed321212e07069dbb5c026f73f8ec7
Fetching chunk ee9f5c4dbf9a75b3da95308413243c5b22ed321212e07069dbb5c026f73f8ec7
Chunk ee9f5c4dbf9a75b3da95308413243c5b22ed321212e07069dbb5c026f73f8ec7 has been downloaded
Chunk 1aa6cc484101ce32d355e65a376834b7ea3c9b5d9dafdd29fcd027d9bef3ab95 (3/268) skipped at the destination
Copying chunk dd1b9b6c86e6e004cee70857b16fbf3ec8b5e2fb743823b81ab09b8435cb1344 to dd1b9b6c86e6e004cee70857b16fbf3ec8b5e2fb743823b81ab09b8435cb1344
Fetching chunk dd1b9b6c86e6e004cee70857b16fbf3ec8b5e2fb743823b81ab09b8435cb1344
Chunk dd1b9b6c86e6e004cee70857b16fbf3ec8b5e2fb743823b81ab09b8435cb1344 has been downloaded
Failed to upload the chunk 91a618e10a617207cf52cf040a994cde40d73ef3c4025370a170d0fee1905be2: file does not exist

Ends with a similar error "
Failed to upload the chunk HEX_STRING: file does not exist".
Everytime that chunk exists locally and not on SFTP server.

duplicacy check also succeedes.

Regards

@NiJoao
Copy link
Author

NiJoao commented Jun 7, 2018

Ok, I've noticed that even a direct backup to an sftp target is not working.
Same error.

Is SFTP backup working for someone?
No other info appears even with " -d -v".
Can you improve the debug message "file does not exist", as it's uninformative and clearly wrong?

I'm using freeFTPd, and other clients can connect fine and send files.
Apparently freeFTPd only supports "1 SFTP channel per connection". Is this the cause?

@gilbertchen
Copy link
Owner

If you pass the -threads 1 option then it should use one channel only.

Any chance you can try a different ssh server for Windows? It looks like freeFTPd hasn't been updated in 5 years.

@NiJoao
Copy link
Author

NiJoao commented Jun 11, 2018

Yeah, I too believe this is freeFTPd fault.
Can you recommend me a good and cheap SFTP server for windows?
I tried every single free server for windows and couldn't find one that's just good-enough.
OpenSSH was almost OK, but then I found that creating new SFTP/SSH users requires creating them also in the Windows OS...

And if not using SFTP, what do you suggest to simulate the computer-to-computer backup (actually Local/NAS + Offsite backup) between my home-network and my offsite windows machine (currently with freeFTPd SFTP server)?

Thanks

@Ossssip
Copy link

Ossssip commented Jun 11, 2018

Duplicacy works fine with Bitvise SSH Server. It is free for personal non-commercial use (the source code is closed, I believe). Configuration GUI is a bit bulky, but there is an option to create users without windows accounts ("virtual accounts").

@NiJoao
Copy link
Author

NiJoao commented Jun 11, 2018

Nice suggestion!
Installed, tested, and everything is working fine.
Thanks a lot!
The personal license limitations are very reasonable and compatible with my use-case.

Note to all: Don't use freeFTPd as a Duplicacy server!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants