Conversation

Notices

1. kat (boneidol@indy.im)'s status on Sunday, 04-Feb-2018 07:51:54 EST kat
   I've been trying to copy a single 4TiB ZFS dataset between 2 machines for > 1week now. 
   On dedicated 1Gb/s network with jumbo frames it takes ~ 20 hours over SSH ... however SSH keeps dying after ~ 12 hours with "Broken Pipe" :-(
   1. kat (boneidol@indy.im)'s status on Sunday, 04-Feb-2018 08:00:43 EST kat

      in reply to
      `zfs send tank/foo@then | ssh user@backup zfs recv tank/foo` fails
      `zfs send tank/foo@then > foo.zfs; scp zoo.zfs user@backup:/tank/` fails
      1. kat (boneidol@indy.im)'s status on Sunday, 04-Feb-2018 08:04:39 EST kat

         in reply to
         Anyway, I had enough space on the local box to dump the stream to file; and have copied it remote using netcat
         `zfs send tank/foo@then > foo.zfs` 
         `cat foo.zfs  | nc backup 9000`
         1. kat (boneidol@indy.im)'s status on Sunday, 04-Feb-2018 08:05:12 EST kat

            in reply to
            Now to see if the stream will import at the other end.
            1. kat (boneidol@indy.im)'s status on Sunday, 04-Feb-2018 08:08:28 EST kat

               in reply to
               I guess 4TiB will not seem like very much data to some people. But it's like 3,000,000 floppy disks, and it's a single file. - remember how much of a chore copying floppy disks was ?  In 20 years, it'll be like "OMFG remember when you thought copying 4TiB was hard,  lol"
               1. kat (boneidol@indy.im)'s status on Sunday, 04-Feb-2018 08:13:06 EST kat

                  in reply to
                  https://indy.im/attachment/1110 4TiB data copying
            2. kat (boneidol@indy.im)'s status on Monday, 05-Feb-2018 14:03:22 EST kat

               in reply to
               It's imported!  woot... 
               now can send incremental snapshots; just the daily diffs.  Life gets easier! 
         2. mcscx (mcscx@quitter.se)'s status on Sunday, 04-Feb-2018 08:22:15 EST mcscx

            in reply to
            @boneidol I'd do "md3sum foo.zfs" on both sides, just to make sure. Sometimes systems with long uptimes get a bit weird.
            1. kat (boneidol@indy.im)'s status on Sunday, 04-Feb-2018 08:32:30 EST kat

               in reply to
               @mcscx what is md3sum ? I can't find it in FreeBSD ?  I think I will do a md5 of the files though.  They sizes are the same, it's just everything takes *so* *long*!
               1. lnxw48a1 (lnxw48a1@nu.federati.net)'s status on Sunday, 04-Feb-2018 08:35:21 EST lnxw48a1

                  in reply to
                  @boneidol I believe @mcscx meant md5sum. I've never seen md3sum (though I have seen both md4sum and md6sum).
               2. mcscx (mcscx@quitter.se)'s status on Sunday, 04-Feb-2018 08:36:57 EST mcscx

                  in reply to
                  @boneidol s/md3sum/md5sum/ :-) I'd carry on with the import but keep the 2 file and do the md5sum over night. If possible.
                  1. mcscx (mcscx@quitter.se)'s status on Sunday, 04-Feb-2018 08:39:58 EST mcscx

                     in reply to
                     @boneidol Unless the zfs import thing itself has some built-in integrity check.
                     1. kat (boneidol@indy.im)'s status on Sunday, 04-Feb-2018 08:51:32 EST kat

                        in reply to
                        @mcscx everything in ZFS is checksummed.  https://blogs.oracle.com/bonwick/zfs-end-to-end-data-integrity but if it fails to import, at least I might be able to work out where the failure happened.