{"id":129,"date":"2012-11-14T19:42:54","date_gmt":"2012-11-14T14:12:54","guid":{"rendered":"http:\/\/www.cyberaka.com\/?p=129"},"modified":"2012-11-20T16:06:58","modified_gmt":"2012-11-20T10:36:58","slug":"using-wget-to-do-high-speed-http-transfer-within-lan","status":"publish","type":"post","link":"https:\/\/www.cyberaka.com\/?p=129","title":{"rendered":"Using wget to do high speed HTTP transfer within LAN"},"content":{"rendered":"<div id=\"_mcePaste\">Today I needed to transfer contents between my Linux servers using a CAT5 LAN connection. The source server served files via HTTP and also had a FTP server running. I ruled out using FTP for transfer as I wanted to do the transfer via command line recursively so the natural candidate was wget.\u00a0On the target Linux box I executed the following command to get a good transfer speed:<\/div>\n<blockquote>\n<div>wget -r -nH &#8211;cut-dirs=2 &#8211;no-parent &#8211;reject=&#8221;index.html*&#8221; http:\/\/192.168.111.116\/files\/dump\/<\/div>\n<\/blockquote>\n<div>The speed received was something like this:<\/div>\n<blockquote>\n<div id=\"_mcePaste\">Downloaded: 2476 files, 27G in 45m 49s (10.0 MB\/s)<\/div>\n<\/blockquote>\n<p>This completed the job in a a short while with no residual HTML file being generated in target.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Today I needed to transfer contents between my Linux servers using a CAT5 LAN connection. The source server served files via HTTP and also had a FTP server running. I ruled out using FTP for transfer as I wanted to do the transfer via command line recursively so the natural candidate was wget.\u00a0On the target [&hellip;]<\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[27],"tags":[],"class_list":["post-129","post","type-post","status-publish","format-standard","hentry","category-linux-os"],"_links":{"self":[{"href":"https:\/\/www.cyberaka.com\/index.php?rest_route=\/wp\/v2\/posts\/129","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.cyberaka.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.cyberaka.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.cyberaka.com\/index.php?rest_route=\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.cyberaka.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=129"}],"version-history":[{"count":10,"href":"https:\/\/www.cyberaka.com\/index.php?rest_route=\/wp\/v2\/posts\/129\/revisions"}],"predecessor-version":[{"id":151,"href":"https:\/\/www.cyberaka.com\/index.php?rest_route=\/wp\/v2\/posts\/129\/revisions\/151"}],"wp:attachment":[{"href":"https:\/\/www.cyberaka.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=129"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.cyberaka.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=129"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.cyberaka.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=129"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}