hi everyone,
I am looking for the best way to sync a file server folder to sharefile. This folder is pretty big: 126GB, 112.000 files, 29.600 folders.
I started using the sharefile migration tool - took about 7 hours to upload all files - everything great so far.
Because a lot of files change on daily basis I need to keep the files in sync between the file server and sharefile.
I guess the perfect solution would have been the sharefile enterprise sync manager - but this is not supported anymore as far as I can see.
Next solution would be the powershell sdk - I created a script and am using the following command:
Sync-SfItem -LocalPath $LocalPath -ShareFilePath "sfDrive:" -Recursive -Strict -Synchronize -Upload
I hope the parameters are correct (I want to upload only the changed files)
Script is working - but it seems to take way too long. Last run took about 2 days! and ended with the following error:
Sync-SfItem : A system error occurred.
I have no idea what this should tell me - I know it uploaded several files, but definitly not all new files. Any way to troubleshoot this?
Is the sync-sfitem not the right tool for syncing such a big folder? Or do I need to create several sync-sfitem commands for the different subfolders, so that each command doesn't have to check that much data?
Or should I use another way? Network share to sharefile and robocopy? FTP Upload?
Hopy you guys can help me!
I am looking for the best way to sync a file server folder to sharefile. This folder is pretty big: 126GB, 112.000 files, 29.600 folders.
I started using the sharefile migration tool - took about 7 hours to upload all files - everything great so far.
Because a lot of files change on daily basis I need to keep the files in sync between the file server and sharefile.
I guess the perfect solution would have been the sharefile enterprise sync manager - but this is not supported anymore as far as I can see.
Next solution would be the powershell sdk - I created a script and am using the following command:
Sync-SfItem -LocalPath $LocalPath -ShareFilePath "sfDrive:" -Recursive -Strict -Synchronize -Upload
I hope the parameters are correct (I want to upload only the changed files)
Script is working - but it seems to take way too long. Last run took about 2 days! and ended with the following error:
Sync-SfItem : A system error occurred.
I have no idea what this should tell me - I know it uploaded several files, but definitly not all new files. Any way to troubleshoot this?
Is the sync-sfitem not the right tool for syncing such a big folder? Or do I need to create several sync-sfitem commands for the different subfolders, so that each command doesn't have to check that much data?
Or should I use another way? Network share to sharefile and robocopy? FTP Upload?
Hopy you guys can help me!
Luke Skrzypek, Employee
Windows Integrated Authentication to avoid login prompts. https://citrix.sharefile.com/share/view/sc1aee5c38ff45ab9
For Powershell, can you post more of your script? Specifically, how you're authenticating and creating the sfdrive?
Arne Lammert
As far as I can tell the drive mapper doesn't run as a service, so it needs to have someone logged in in Windows to work, doesn't it?
Wouldn't SAML need an active windows user either to work?
Powershell:
here are the important parts of the script:
ran this one time to create spfs:
$sfClient = New-SfClient -Name ((Join-Path $env:USERPROFILE "Documents") + "\YourSubdomain.sfps") -Account <*hidden*>
- script commands to run everytime:
$sfClient = Get-SfClient -Name ((Join-Path $env:USERPROFILE "Documents") + "\YourSubdomain.sfps")
New-PSDrive -Name sfDrive -PSProvider ShareFile -Client $sfClient -Root $ShareFileFolder
Sync-SfItem -LocalPath $LocalPath -ShareFilePath "sfDrive:" -Recursive -Strict -Synchronize -Upload
Luke Skrzypek, Employee
You're right that it doesn't run as a service. However, your backup script/task could programmaticly launch the DriveMapper executable to mount the drive. I was thinking that if your tasks runs as a SAML user it could skip the authentication prompt, although I haven't tried it personally.
Powershell:
Could you share what user you're authenticating as? Same link as before will work if you want to keep it private.
Arne Lammert
Ah ok, I will try that, thanks!
Powershell:
I uploaded the user, hope thats what you meant
Luke Skrzypek, Employee
I checked and we had some networking issues yesterday that coincide with the times when you saw the errors. They have since been resolved.