[00:00] mnathani: thing is if you start running multiple copies, your disk is going to spend more and more time grabbing data from file A, B, and C [00:00] But there are more efficent ways to copy "many small files" [00:00] (as in the disk keeps going to A, then, B, then C, back to A, back to B, back to C...) [00:02] right. [00:02] (versus: disk spends time reading "A", then moves to reading "B") [00:02] mnathani: I've found tar to be the most efficient and fastest handler of "many small files" [00:03] tar -c /my/dir | tar -xC /dest/dir [00:03] (make it xvC if you feel like wasting blocking CPU time on writing out progress) [00:51] there's not many multithreaded copiers for linux [00:51] and it's a complicated problem. [00:52] i think it was gizmoguy that linked me something before? [00:52] brycec: cp is actually faster than tar normally for many small files [00:52] hi [00:52] gizmoguy: you ahd some kind of multithreaded copy thing right? [00:53] i can't for the life of me think who else it would have been. [00:53] there's ways with xargs etc too [00:54] grid ftp? [00:54] i don't think it would have been grid ftp [00:54] gridftp uses udt doesn't it? [00:54] the naem does ring a bell [00:56] oh this is windows [00:56] i should have read scroll back better [00:56] if you're booting it into linux to copy, ntfs under linux sucks. [00:56] and you'd probably be better off using dd if you acn [01:00] hmm gnu parallel looks like one solution [01:02] hah i just have my laptop open and I saw irc go purple [01:03] I read your message and no other context :) [01:03] ahh ok [01:04] i can't for the life of me find it now [01:05] hmm, read scrollback now [01:05] I see we want to do it on a local machine [01:05] can't think of what it might have been if I linked you [01:05] I usually use rsync, but it kinda sucks for lots of small files [01:07] maybe it was someone else [01:07] the solution using parallel looks easyish to do [01:08] and you can rsync in a mode that just lists the files, but that's still slow [01:11] for backup so you can reimage or something, i would opt for dd/lz4 myself [01:11] ie dd it to a file, piped through lz4 which doesn't really slow it down [01:12] *** novae has quit IRC (Ping timeout: 245 seconds) [01:14] *** novae has joined #arpnetworks [03:53] *** staticsafe_ has joined #arpnetworks [03:55] *** staticsafe|2 has quit IRC (Ping timeout: 264 seconds) [05:03] *** NiTeMaRe has quit IRC (Ping timeout: 258 seconds) [05:07] *** NiTeMaRe has joined #arpnetworks [05:11] *** staticsafe_ is now known as staticsafe|2 [07:16] *** novae has quit IRC (Ping timeout: 245 seconds) [07:19] *** novae has joined #arpnetworks [07:37] mnathani: my guess is, threading will cause higher disk access.. meaning you start having to add seek times into the mix. every single time I've ever done a multithreaded file copy of any size, it's slower than just doing it single threaded. [07:37] mnathani: and, I just realized I was scrolled up. ignore the half-a-day-late response. chances are good, you've already finished the procedure. LOL [08:06] i started to do the same thing, haha [08:12] haha: http://www.pcgamer.com/review/mad-dog-mccree-review-april-2003-us-edition/ [08:55] *** toddf has quit IRC (Read error: Connection reset by peer) [08:57] *** toddf has joined #arpnetworks [08:57] *** ChanServ sets mode: +o toddf [13:12] #devious loves ARP Networks http://sprunge.us/XPHK [13:13] *** RandalSchwartz has quit IRC (Remote host closed the connection) [13:18] hahaha [13:18] *** RandalSchwartz has joined #arpnetworks [13:18] -NickServ- Last failed attempt from: merlyn!~merlyn@vps1.merlyn.cz on May - 27 17:57:12 2014. [13:18] heh... lotta merlyns there [14:28] brycec: lol cool [14:29] fwiw up_the_irons he found it "pricey", so I wouldn't hold my breath [14:29] yeah np [14:29] He then turned to look at getting OpenBSD running on a free EC2 instance [14:29] so... *shrug* [14:29] ah [14:29] Frankly if he just wants to host a blog, a full blown VPS isn't a good plan. [14:29] right [14:36] up_the_irons: ich vermisse dich in #arpnetworks-de ;) [14:37] heh [14:38] * brycec joins #arpnetworks-en [14:38] lol [14:38] lol [14:39] i would join -es ;) [14:40] ant: ich neu gestartet weechat [14:42] we now have #arpnetworks-es [14:42] ay carumba! [14:43] * brycec is quickly exhausting the Spanish he remembers [14:44] lol [14:45] according to duolingo i should know about 1k works [14:45] *** mikeputnam has joined #arpnetworks [14:45] heh [14:45] wb mikeputnam [14:45] but i found that that's actually not much... [14:46] I can read and understand Spanish decently [14:46] But my vocabulary for speaking is limited to getting by in the Southwestern US [14:48] >.> [14:48] WHOAMI!? [14:50] You are you. [15:02] yea, mine's limited to limited reading comprehension [15:02] most SW spanish speakers tend to speak way too fast for me to pick it up [15:03] I'm studying about 15-20 minutes a day, slowly getting more things understood [15:04] was using rosetta stone, but I wanted something with a bit more handholding, so I'm usng duolingo [15:04] * brycec sighs, one of these days I'll get back to German... [15:06] i'm taking spanish at my university. now the spanish teachers also speak spanish in class...talking about "way too fast"... [15:10] I learned French in high school by immersion. No better way :) But that's at a high school pace... about 1/4-1/2 college speed. [16:50] brycec: how did you immerse? did you go to HS in France? [16:53] up_the_irons: The teacher would only speak French with us [16:53] but never listen french? [16:53] :P [16:54] For ~1hr a day, I only spoke and heard (and read and wrote) French [16:54] or maybe you meant "speak *only* french" [16:54] Peut-etre [16:55] peut-être (avec des accents) [16:55] my first semester of spanish in HS was taught by actions and stuff [16:55] it's the only stuff i remember [16:56] Cher KVM, pourqoi refusez-vous de fermer le dossier? [16:56] lol m0unds [16:56] FERMEZ LE DOSSIER [16:56] second semester was a different teacher and her method was bookwork and forcing us to learn ricky martin songs [16:56] hahaha [16:57] m0unds: What about other spanish songs? Like the Ketch Song? [16:57] *Ketchup [16:57] haha, nope [16:57] just ricky martin [16:57] and making spanish restaurant menus [16:57] the song that is "rapper's delight" phonetically? [16:58] I'm referring to https://www.youtube.com/watch?v=V0PisGe66mY RandalSchwartz [16:58] YouTube Music: "Las Ketchup - The Ketchup Song (Asereje) (Spanish Version) (Official Video)" by AltraModaMusic (3m 31s), 5,679,178 views, 17,033 likes and 1,086 dislikes. Uploaded 2013-04-13T09:03:35.000Z. [16:58] http://i.imgur.com/nnANCJk.gif [16:58] :| [16:58] yesh - that's the one [16:58] from the daughters of "the big tomato" [16:59] which is why they call themselves "Ketchup" [16:59] but the chorus of that song is a phonetic translation of "Rapper's delight" [16:59] they've admitted that [16:59] Sure... [16:59] I had no idea [17:00] Only reason I know the song is from my French class, oddly. One of the "goof off" lessons, and an exercise in singing in !English [17:21] phlux: what menu prog is that on top of: http://img.phluxbox.com/screenshots/aic5ah.png ? [17:22] dzen2? [17:41] jpalmer: Thanks on your input. Its a recurring issue for me, I plan on using the tar method suggested by brycec next time around [17:44] mnathani: What exactly is the use case? Is this something that Clonezilla (and its tools) might be better suited for? [18:26] brycec: how good did you get at French with that 1 hr / day for 4(?) years? [18:36] up_the_irons: it's just i3status with conky [18:42] *** novae has quit IRC (Ping timeout: 245 seconds) [18:49] *** novae has joined #arpnetworks [18:57] up_the_irons: Pretty good, actually. Those 4 years were roughly equivalent to 4 semester of college French. [18:58] phlux: cool [18:58] brycec: cool [18:58] :) [18:58] up_the_irons: cool [19:01] phlux: what's your conky config to produce the one-liner? conky setups i've seen look more like: http://fc00.deviantart.net/fs70/i/2010/169/a/f/Compiz_empowered_desktop_by_laserbeam3.png [19:01] (which is quite cool in itself ;) [19:04] Hey up_the_irons. any update on level3? [19:05] acf_: they finished provisioning new VLAN IDs (took 'em a long while) that don't conflict with our network. Now the ball is in my court to terminate the VLANs, BGP setup, etc... [19:06] i have a host upgrade to do tonight, so i'm thinking i'm going to do the bgp stuff tomorrow night [19:06] Which host is on the chopping block tonight? [19:07] oh cool soon now then :) [19:08] I'm certainly looking forward to it [19:08] hopefully Verizon will go that way :/ [19:08] i am just curious really [19:08] i dunno what diff it'll make to me [19:09] looks like the NTT/Verizon dispute is still ongoing: http://goo.gl/hTrm8l [19:09] http://goo.gl/hTrm8l -> http://kremvax.acfsys.net/smokeping.cgi?displaymode=n;start=2013-06-01%2018:58;end=now;target=Remote.verizon-lsanca [19:10] acf: these things arel ikely to get worse ratehr than better [19:11] seems that way. this is the first one that's really impacted me though [19:20] cox and comcast have both had bad routes to cogent for ages, [19:21] that's not actually extremely bad [19:21] i've seen worse congestion than that before [19:21] that's about what new zealand users on dsl used to get on average everwhere [19:22] cos there was this handover dimensioning for dsl, which was like 48kbit per user or something [19:22] and the only way for isp's to have good speeds were to have lots of low volume users, which is silly. [19:23] it's still actually happening for some rural users, and apparently it's wosre [19:24] wow. I guess I'm just used to the mostly loss-free links from big transit providers [19:24] transit is fine :) [19:24] and this problem was a few yaers ago [19:25] but it affected a LOT of users [19:25] cos DSL is common here, and monopoly etc with wholesaling [19:25] and then the wholesaler had higher dimensioning for their own connections [19:26] ie ... really bad situation.. but no-one can do anything about it [19:26] it's one of the reasons nz had tiny data caps [19:26] it was the "best" solution [19:26] seems like it was mostly caused because of the lack of good backhaul? [19:27] it wasn't just that even [19:27] it was between the wholesaler provider and the isp [19:27] with actual rate limits per user [19:27] so not just straight backhaul congestino [19:27] hmm. but that's why the users were limited so strictly? [19:28] nah, it's cos they could :/ [19:28] i dunno [19:28] it used to cost $500+/month for 2 megabit frame relay here [19:28] then dsl came in which was a lot less than $500/month [19:29] but had 300mb and 600mb and so on data caps [19:29] up_the_irons: mind if I send it to you tomorrow? i'm signing off here tonight - crying baby needs attention! [19:29] but i think telecommunicatins companies always charge what they can [19:29] if no competition prices increase [19:29] if limited competition prices tend to stagnate [19:30] definitely seems that way in the US [19:30] you really need three or more companies to really get competition [19:30] and one of them beign new helps [19:30] ie "needding to get market share" [19:31] but it tends to mean one of the two larger companies has money to burn, and the other doesn't, and so one of them will drop prices even further.. to stop the third party entering the market [19:31] andt he second party struggles [19:31] and then you find cheaper internet of much lower quality [19:31] will be curious if gigabit becomes common if a whole lot of backhaul problems get worse [19:32] cos i imagine traffic will be able to move easier [19:32] ie come in different ways than expected [19:33] common for consumers? [19:34] afaik Google is trying to make that happen [19:58] *** dj_goku has quit IRC (Quit: Lost terminal) [19:59] *** dj_goku has joined #arpnetworks [19:59] *** dj_goku has quit IRC (Changing host) [19:59] *** dj_goku has joined #arpnetworks [20:02] mnathani: if you are sending that data to another machine, I personally prefer rsync and friends. that way if the connection gets interuppted (network hiccup, disk or machine going to sleep, power, human error, etc) the data thats already been transferred, says sane, and it just resumes roughly where the interuption occured. [20:02] s/says/stays/ [20:02] mnathani: if you are sending that data to another machine, I personally prefer rsync and friends. that way if the connection gets interuppted (network hiccup, disk or machine going to sleep, power, human error, etc) the data thats already been transferred, stays sane, and it just resumes roughly where the interuption occured. [20:02] * jpalmer pets BryceBot [20:35] it's actually faster to use tar and rsync if it aborts [20:36] it's quicker to use tar/rsync combination if you want an up to date rsync from scractch too [22:29] phlux: sure of course [22:32] brycec: kvr22 is on the chopping block tonight [22:56] * brycec nods [22:57] * brycec decides his next host naming scheme will be based on MacGuyver and his companions [22:59] *MacGyver [23:06] haha, will you have one named ANGUS? [23:13] To my knowledge, he's not had a companion named Angus... [23:13] (but I'm no expert) [23:36] Oh god... MacGyver (as a show) just showed its age when MacGyver "hacked" his way past a remote-controlled lock by resonating crystal wine glasses. [23:37] yeah now days people would just use a hammer [23:39] perhaps, but then there would be damage to be found [23:39] yeh [23:39] but it's mostly drug addicts that break into things now days [23:40] covert stuff probably happens from inside [23:40] i hear about "chinese hackers" quite a lot that get into things [23:40] i don't thin it's that common though [23:40] there's just a desire to blame the chinese :) [23:41] In this instance, it was a private vault with 200lbs of diamonds [23:41] heh [23:41] with a frequency based lock [23:41] i didn't realise macgyver stole things [23:41] Seriously, who the fuck locks/unlocks their vault with the equivalent of a TV remote? [23:41] Only in Robin Hood fashion [23:42] i dunno isn't it mostly retina based now? [23:42] And he's not stealking, he's moving [23:42] i haven't seen the show in years [23:42] Last vault (bank) I was in, I only saw keys [23:43] wow youtube has full episodes [23:43] * brycec is watching on Netflix [23:43] ahh can't do that here [23:43] * brycec takes it for granted [23:44] hah he has a huge phone [23:45] Radiophone to be specific [23:45] oh he was at home [23:45] i have no idea what epsideo number you are on :) [23:45] oh was he? I have no idea which ep you're watching :p [23:45] is the video quality ok? [23:45] i was watching episode 14 :/ [23:45] i dunno why it sarted there heh [23:45] season 1, ep 5. ' [23:45] but the video quality is terrible :/ [23:46] And yeah, perfect quality (for the time) [23:46] just really artifacty [23:47] Bummer [23:47] we can't get netflix here :/ [23:47] "Sorry, Netflix is not available in your country yet." [23:48] Yeah, I know. You could tunnel through ARP though, but payment may still be tricky. [23:48] yeah i can tunnel i know [23:48] Or you could pir8 <.< [23:48] >.> [23:48] i tried it wit that onther oe :/ [23:48] but there were heaps of adverts [23:48] you mean Hulu? [23:48] yeah that's it [23:49] Yeah well... Hulu sucks [23:49] oh is netflix better [23:49] Substantially [23:49] i assumed it was much of a muchness [23:49] Nooooo [23:49] do you get adverts on netflix? [23:49] For starters, no ads [23:49] not in the slightest [23:49] no banners, no videos, NOTHING [23:50] Since Netflix is 100% paid, there's nothing to be gained from having advertisers [23:50] (not to mention the ill-will about it) [23:50] Hulu on the other hand is owned and run by Old World media, TV networks accustomed to advertising as a significant part of the revenue [23:51] i see [23:51] yeh the ads put me off [23:51] and limited content [23:51] Yes and yes [23:51] how much is netflix? [23:51] $8/mo last I checked [23:51] oh [23:51] that's not muc [23:52] unlimited streaming, etc [23:52] *** doomviking has quit IRC (Ping timeout: 240 seconds) [23:52] "Netflix is the Undisputed TV Streaming King" http://lifehacker.com/tv-streaming-head-to-head-netflix-vs-hulu-vs-amazon-pr-1536006625 [23:53] oh apparently netflix changed something that broke some people proxying [23:55] (can't blame them... Netflix is liable when you break Netflix's agreements with their content providers, the ones stipulating which countries their content is available in. (Yes, licensing is just plain dumb in most every way.)) [23:57] http://www.stuff.co.nz/technology/digital-living/60080388/netflix-nz-glitch-unintentional [23:59] So netflix changed their hostname scheme, and that broke $proxies squid rules, lol