Jump to content


Photo

some tidbits about SyncToy 2.1


  • Please log in to reply
16 replies to this topic

#1 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,530 posts

Posted 05 May 2012 - 02:09 PM

2 days ago I was trying to do a backup of my WHS2011 ServerFolders directory to the RAID array in my Lian-Li EX-503 external enclosure when something went seriously awry. The RoboCopy procedure started throwing "file system corrupt" and "destination not available" errors at me.

Sure enough, when I tried to access some of the directories manually, I couldn't. I ran CHKDSK on the drive (NTFS) and it found a pile of problems, and supposedly fixed them. However, when I tried to run the backup again, I got the same errors.

Rather than fool around with it any more, I decided to reformat the array and copy everything back to it (thank goodness I have so many backups of my data).

While contemplating the task ahead, I thought it might be interesting to try using SyncToy 2.1 instead of RoboCopy. I did a couple of quick tests and it seemed that SyncToy was faster than RoboCopy. I'm not sure why; maybe it's multi-threaded of something.

Anyway, SyncToy ran into a major problem. When the Preview of the copy operation was almost complete it threw an error, stating that it encountered a file with an "invalid FileTime". I wasn't sure if it was the file currently showing in the progress meter or some other file, so I created a new Folder Pair of only the directory that contained the suspect file — doing a Preview of that Folder Pair did not repeat the error.

So now I knew it wasn't the file being displayed. The obvious question is, "Which file is it?". I had no way of knowing, so I started doing some internet searching. I came across a thread on social.microsoft.com/forums that contained a post by a guy named ISDigital. In his post he included a URL to a utility he wrote that will search a specified directory tree for files with invalid FileTime entries.

I downloaded the utility and ran it on my WHS2011. It found about 30 files with invalid FileTime entries. Surprisingly, it also offered to fix them.... nice utility. I haven't checked, but I presume it uses the current time to fix the errors.

Anyway, after fixing the invalid FileTime entries, SyncToy no longer threw any errors. It is currently restoring all the files to my EX-503.

So, it appears SyncToy, besides being able to copy file and folder structures from place to place, can also inform you of inconsistencies in file entries. It's too bad it can't also fix them (that would have been a nice 'extra'), but the utility I downloaded can. You can get it here: http://www.isdigital...lidFileTime.zip

I will update this thread if I find any more interesting tidbits about SyncToy.

If at first you don't succeed, do it like your mother told you.


#2 pcdoc

pcdoc

    HSS Legend

  • Moderators
  • 3,559 posts
  • LocationLos Angeles, California

Posted 05 May 2012 - 03:59 PM

2 days ago I was trying to do a backup of my WHS2011 ServerFolders directory to the RAID array in my Lian-Li EX-503 external enclosure when something went seriously awry. The RoboCopy procedure started throwing "file system corrupt" and "destination not available" errors at me.

Sure enough, when I tried to access some of the directories manually, I couldn't. I ran CHKDSK on the drive (NTFS) and it found a pile of problems, and supposedly fixed them. However, when I tried to run the backup again, I got the same errors.

Rather than fool around with it any more, I decided to reformat the array and copy everything back to it (thank goodness I have so many backups of my data).

While contemplating the task ahead, I thought it might be interesting to try using SyncToy 2.1 instead of RoboCopy. I did a couple of quick tests and it seemed that SyncToy was faster than RoboCopy. I'm not sure why; maybe it's multi-threaded of something.

Anyway, SyncToy ran into a major problem. When the Preview of the copy operation was almost complete it threw an error, stating that it encountered a file with an "invalid FileTime". I wasn't sure if it was the file currently showing in the progress meter or some other file, so I created a new Folder Pair of only the directory that contained the suspect file — doing a Preview of that Folder Pair did not repeat the error.

So now I knew it wasn't the file being displayed. The obvious question is, "Which file is it?". I had no way of knowing, so I started doing some internet searching. I came across a thread on social.microsoft.com/forums that contained a post by a guy named ISDigital. In his post he included a URL to a utility he wrote that will search a specified directory tree for files with invalid FileTime entries.

I downloaded the utility and ran it on my WHS2011. It found about 30 files with invalid FileTime entries. Surprisingly, it also offered to fix them.... nice utility. I haven't checked, but I presume it uses the current time to fix the errors.

Anyway, after fixing the invalid FileTime entries, SyncToy no longer threw any errors. It is currently restoring all the files to my EX-503.

So, it appears SyncToy, besides being able to copy file and folder structures from place to place, can also inform you of inconsistencies in file entries. It's too bad it can't also fix them (that would have been a nice 'extra'), but the utility I downloaded can. You can get it here: http://www.isdigital...lidFileTime.zip

I will update this thread if I find any more interesting tidbits about SyncToy.


Wow, good information to know and good catch. Never heard of this issue so this is a first for me. Glad you got fixed and glad you had your EX for those quick recoveries. What 2T limit... :D

Main Server - WHS 2011, Core I5-2500, 12T RAID 5 (5x3T) + 2T of Mirror + 2T of backup
Second Server - 2008R2, Core I5-2500, 12T RAID 5
Main Systems - Core I7-2600k, 16 Gigs DDR3-1600, 180 Gig Intel 330 SSD Max IOPS 240 Gig Vertex 3, 2T Sata 3 for local Backup
Other systems - Core I7-2600, Core I3-530's, Core I5-2500, Core I7-920, Core I3-2100, and G620 (see System List)
My Blogs - The Docs Blog and Tablet Resource
BYOB Videos - TheBYOBPodcast
For a complete system List: Computer Systems


#3 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,530 posts

Posted 05 May 2012 - 09:52 PM

Wow, good information to know and good catch. Never heard of this issue so this is a first for me. Glad you got fixed and glad you had your EX for those quick recoveries. What 2T limit... :D


:D Yes, just one of the advantages of copying data to back it up rather than using a backup program.

BTW, got a question for you. As a fellow EX-503 owner, do you have any idea where I could get more drive 'handles' for 503s? I've run out of space with my current offsite backup solution and am thinking of using my 2nd EX-503 as a JBOD box with 2 sets of drives.

I would back up my data to one set of drives in the 503, take the set off site, then use a 2nd set of drives to back up the next night. Then I would rotate the drive sets each night. Only problem is, I think the drive 'handles' are required in order to support the drives in the 503. I looked at the Lian-Li website but couldn't find anything about the drive 'handles'.

If at first you don't succeed, do it like your mother told you.


#4 pcdoc

pcdoc

    HSS Legend

  • Moderators
  • 3,559 posts
  • LocationLos Angeles, California

Posted 05 May 2012 - 10:01 PM

:D Yes, just one of the advantages of copying data to back it up rather than using a backup program.

BTW, got a question for you. As a fellow EX-503 owner, do you have any idea where I could get more drive 'handles' for 503s? I've run out of space with my current offsite backup solution and am thinking of using my 2nd EX-503 as a JBOD box with 2 sets of drives.

I would back up my data to one set of drives in the 503, take the set off site, then use a 2nd set of drives to back up the next night. Then I would rotate the drive sets each night. Only problem is, I think the drive 'handles' are required in order to support the drives in the 503. I looked at the Lian-Li website but couldn't find anything about the drive 'handles'.


Don't know of any aftermarket places that sell them but you might try to contact Lian-li and see if that gets you anywhere. If you are going to get into plugging things in and our I would probably consider a different device that does not need handles or trays.

Main Server - WHS 2011, Core I5-2500, 12T RAID 5 (5x3T) + 2T of Mirror + 2T of backup
Second Server - 2008R2, Core I5-2500, 12T RAID 5
Main Systems - Core I7-2600k, 16 Gigs DDR3-1600, 180 Gig Intel 330 SSD Max IOPS 240 Gig Vertex 3, 2T Sata 3 for local Backup
Other systems - Core I7-2600, Core I3-530's, Core I5-2500, Core I7-920, Core I3-2100, and G620 (see System List)
My Blogs - The Docs Blog and Tablet Resource
BYOB Videos - TheBYOBPodcast
For a complete system List: Computer Systems


#5 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,530 posts

Posted 06 May 2012 - 07:33 AM

Don't know of any aftermarket places that sell them but you might try to contact Lian-li and see if that gets you anywhere. If you are going to get into plugging things in and our I would probably consider a different device that does not need handles or trays.


I have used the Contacts page of the Lian-Li site to send a message, but it's a somewhat odd page; not sure if they will contact me or not. I've also considered just making some handles of my own out of aluminum.

I do have a couple of toasters I'm using at the moment. I've considered just ganging them to get more drive space. I've also considered just getting bigger drives, but I have all these 1TB drives laying around; seems a shame not to use them.

If at first you don't succeed, do it like your mother told you.


#6 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,530 posts

Posted 06 May 2012 - 01:10 PM

Another item about Synctoy I'd like to mention is that, despite it being primarily a GUI application, it does have a Command Line Mode. In SyncToy 2.0 (and previous perhaps, but I'm not sure) it was possible to specify a '-R' argument that would let you run SyncToy and specify a Folder Pair Definition to execute. For example, you could open a Command Prompt Window and type SynToy -R CopyFolderAtoFolderB. Assuming CopyFolderAtoFolderB was a legitimate Folder Pair Definition then SyncToy would run using the configuration of that pair.

In SyncToy 2.1 things have changed a bit. There is now an actual SyncToyCMD.exe file. It still requires the '-R' argument, just like SyncToy 2.0. I'm not sure why the separate app, except maybe it made it possible to run without any GUI involvement, so it made auto-scripting easier.

I haven't tried it yet because my restore copying to my EX-503 is still ongoing, but I plan to set up a Scheduled Task that will run a series of SyncToyCMD.exe commands from a batch file. When I do, I'll post results here.

BTW, SyncToy requires the Microsoft Sync Framework 2.0 for it to run, but it will auto-install it if required.

If at first you don't succeed, do it like your mother told you.


#7 TommySharp

TommySharp

    HSS Member

  • Members
  • 20 posts
  • LocationNew Zealand

Posted 07 May 2012 - 01:11 AM

I use a windows scheduled task to run all me synctoy paired folders at 2am every night. Works a treat!
Regards,

Tommy

#8 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,530 posts

Posted 07 May 2012 - 07:15 AM

I use a windows scheduled task to run all me synctoy paired folders at 2am every night. Works a treat!


Thanks for the confirmation. Can you also confirm that it works without anyone being logged in? That's on my list of things to test.

If at first you don't succeed, do it like your mother told you.


#9 TommySharp

TommySharp

    HSS Member

  • Members
  • 20 posts
  • LocationNew Zealand

Posted 10 May 2012 - 04:30 AM

I have my server automatically logged on if it ever reboots as I have some video surveillance software that doesn't run as a service.

But I'm pretty sure it would work so long as you setup the scheduled task correctly.
Regards,

Tommy

#10 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,530 posts

Posted 10 May 2012 - 04:58 PM

UPDATE

When I tried to use SyncToy to back up my Client Computer Backups folder, it failed. Not surprisingly, and similar to WHSv1, it failed because the files were locked by the backup service.

On WHSv1 the service is called WHSbackup, so it was pretty easy to identify. On WHS2011 it's not hard, but there are 2 services running, and I didn't know which one to shut down, or if it was necessary to shut down both of them. I took a stab in the dark and shut down Windows Server Client Computer Backup Provider Service. It worked, so I didn't even bother trying the other service, Windows Server Client Computer Backup Service.

If at first you don't succeed, do it like your mother told you.


#11 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,530 posts

Posted 10 May 2012 - 05:17 PM

So I've now created my CMD batch file and a Scheduled Task to run it at 3am every night. The CMD file has 3 SynctoyCMD.exe commands in it:
  • shut down my email server, run SyncToyCMD.exe to back it up, then restart the email server
  • shut down Windows Server Client Computer Backup Provider Service, back up the Client Backup files, then restart the service
  • back up everything else in ServerFolders.
Here are a couple of paragraphs from the Help file:

The SyncToy log can be viewed by choosing the View Log option from the SyncToy File menu. The View Log dialog also has an option for deleting the current log contents. The log file is placed under the user's local application data folder (on Windows Vista: %LOCALAPPDATA%\Microsoft\SyncToy\2.0\SyncToyLog.log, on Windows XP: "%USERPROFILE%\Local Settings\Application Data\Microsoft\SyncToy\2.0\SyncToyLog.log")


SyncToy supports a verbose level of logging for helping troubleshoot issues you may be having during synchronization operatons. To enable verbose logging, you'll need to manually edit the configuration file named SyncToy.config under the SyncToy install location (by default installed to "%PROGRAMFILES%\SyncToy 2.1"). Open the SyncToy.config file in your favorite text editor and change the value property of the SyncToyTraceLevel switch from "Info" to "Verbose", e.g.: add name="SyncToyTraceLevel" value="Verbose"


However, the log is just a text file, so you could edit it as you please with Notepad to keep the parts you want, or even rename it and keep it for archive purposes.

If at first you don't succeed, do it like your mother told you.


#12 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,530 posts

Posted 13 May 2012 - 10:21 AM

Just discovered that, when using SyncToyCMD.exe, the name of the folder pair specified after the "-R" parameter is case sensitive. I had a capital "O" in the name of 3 folder pairs, but a lowercase "o" in the CMD file. When I tried to run the CMD, SyncToyCMD.exe failed with a "Folder pair not found" error. Be warned.

If at first you don't succeed, do it like your mother told you.


#13 mrossco

mrossco

    HSS Champion

  • HSS Writers
  • 462 posts
  • LocationSt. Louis, MO

Posted 15 May 2012 - 05:14 AM

Good stuff!  Something that I learned with SyncToy is to use the UNC paths for shares instead of direct folder access when I can.  Then, I'm in a better position if I ever move the folder from one array to another.

Try performance-pcs or frozencpu for your EX-503 handles.  Lian-Li reuses parts across multiple products, so they may be there under a different name.
Office PC - Intel Core i7-3930K, ASUS Sabertooth X79, G.SKILL Ripjaws Z Series 16GB, EVGA GeForce GTX 680 SLI, OCZ Vertex 2 120GB x 2 RAID 0 (OS), WD RE4 2TB x 4 RAID 10 (Data), Corsair AX1200, Lian-Li PC-6FNWX
WHS - Intel S3210SHLC, Intel X3060, 8GB DDR2 ECC, Intel RS2WC080 RAID, WD5000BEVT 500GB (OS), WD RE4-GP x 4 RAID 1 (Data)
HTPC - Intel Core i3-2120T, Intel DH67CFB3, 4GB Kingston DDR3, Seagate Momentus XT 500GB 2.5" Hybrid, Silverstone LC-19
Hyper-V - Intel X3470, Intel S3420GPLC, 32GB Kinston ECC, LSI MegaRAID 9240-4i, OCZ Vertex Plus 60GB SSD (OS), WD RE4 500GB x 4 (VHD), WD EARS 2TB (ISO Storage and Backups)
Linksys E3200 | D-Link DGS-2208 | Samsung Focus (AT&T)

#14 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,530 posts

Posted 15 May 2012 - 08:07 AM

Good stuff! Something that I learned with SyncToy is to use the UNC paths for shares instead of direct folder access when I can. Then, I'm in a better position if I ever move the folder from one array to another.

Try performance-pcs or frozencpu for your EX-503 handles. Lian-Li reuses parts across multiple products, so they may be there under a different name.


Thanks. Would not have thought of them for Lian-Li parts. It would be nice to not have to make them myself. I don't have a bandsaw so I would have to cut out the profiles using a jigsaw; not ideal.

If at first you don't succeed, do it like your mother told you.


#15 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,530 posts

Posted 13 June 2012 - 12:48 PM

Well, a major issue has come up. The Folder Pair that is supposed to back up the Client Computer Backups doesn't work. I thought I was getting Alzheimer's. The first time the automated backup procedure ran, it came back with an error to the effect that the Client Computer Backups Folder Pair needs to be synced once before SyncToyCMD.exe can be used.

I thought to myself, "I'm sure I did that, but, maybe I forget to.", so I did it again.

The next day I checked the log again: same error. Dang! So, I ran the sync manually 1 more time. Next day, the automated routine gave the same error.

So, there's something about the Client Computer Backups folder that's 'special'. If anyone has any ideas, shout 'em out..

If at first you don't succeed, do it like your mother told you.


#16 jmwills

jmwills

    HSS Genius

  • Donating Member
  • 5,090 posts
  • LocationHuntsville, AL

Posted 13 June 2012 - 04:11 PM

Permissions perhaps or an excluded file type. Is there a limit to the file size?
Windows 7 Desktop - Antec 100 Case, Intel D8H67BL, OCZ 550W PSU, Intel i3-530 CPU w/16GB G-Skill DDR3 1333 RAM
Server 2012 - Fractal Arc Midi, CoolerMaster M600 PSU, ASUS P8H67V, Intel i5-2500 CPU w/32GBG-Skill DDR3 1333 RAM, 90 GIG OCZ SSD OS Drive – Roles: Hyper-V (WHS-SharePoint-DC-SQL-Exchange-WSE 2012), Print Server - Rocket RAID 2720 5x2TB
HTPC Build - Silverstone GD05 Case, ASUS P7H55-M PRO, CoolerMaster M600W PSU, Intel i3-530 CPU w/4GB G-Skill DDR3 1333 RAM. OCZ 60GB SSD Drive for the OS with a 120GB WD 2.5" Blue drive for data storage.
Travel Laptop: Dell XPSL502X 15.6"

#17 ikon

ikon

    HSS Genius

  • Donating Member
  • 8,530 posts

Posted 14 June 2012 - 08:03 AM

None that I'm aware of. In the meantime, I've back to using RoboCopy, because I know for sure it works.

If at first you don't succeed, do it like your mother told you.





0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users