↑back Search ←Prev date Next date→ Show only urls | (Click on time to select a line by its url) |
Who | What | When | |
---|---|---|---|
brycec | Wow, Linux really does have a faster network stack than OpenBSD. Wheezy on this Metal box gets at least 800mbps consistently.
100MB test file downloaded in 1 second :p brycec hates network/Internet mirrors that can't keep up with his own connection | [00:03] | |
mercutio | brycec: it does bug me a little :)
i find my home mirror pretty fast :) well proxy cache, with ssd. i think a lot of the time it's about small file performance. and so having a low ping, and cached on ssd or ram helps. saturating gigabit is quite hard for a hard-disk with lots of small files. | [00:16] | |
brycec | I notice it most with Sourceforge mirrors, many of which barely crack 10mbps | [00:18] | |
mercutio | and raid can't really fix it. using 15k sas disks or something would help more than raid probably. | [00:18] | |
brycec | There's no excuse for that in this day and age. | [00:18] | |
mercutio | oh sourceforge has it's own issues i think. | [00:18] | |
brycec | (*its) | [00:18] | |
mercutio | i get 200 to 300k/sec or something on sourceforge frequuently
actually the worst i find are motherboard wsites. if you ever download anything from a motherboard site i tend to find it can be like 20 to 30k/sec or less! | [00:18] | |
brycec | Heh I don't run into too many of those typically, but yeah they are usually slow. I don't mind much, they aren't running a professional download service :p | [00:19] | |
mercutio | and it's not just because they're in taiwan.
well sourceforge don't charge for downloads. and don't have much of a revenue stream? i find mirrors.kernel.org seems to have consistent speeds. well when it goes to the right mirror hah | [00:19] | |
brycec | Indeed, quite reasonable. It's my goto mirror | [00:20] | |
mercutio | but it doesn't tend to get slow at diff times.
whereas archive.ubuntu.com/security.ubuntu.com can crawl whenever there is a new ubuntu release it shows on my smokeping :) i actually use arp's mirror a lot :) plus nz mirror. the nz mirrors are faster than arp it seems (when similar ping) probably just better raid config, or more users so more likely to be in cache | [00:20] | |
brycec | haha
I'm using ARP's mirrors quite a bit right now too... on-network. I'd get much more use out of it if ARP would just mirror Debian too. (and stop wasting space mirroring architectures they themselves don't support) | [00:22] | |
mercutio | yeah i think he's short on space.
yeah that'd be sensible. | [00:24] | |
brycec | Ditto - he's commented on it before.
Why do we mirror powerpc ISOs for FreeBSD? :p | [00:25] | |
mercutio | maybe you should volunteer to clean it up. | [00:25] | |
brycec | we/they
I didn't know up_the_irons was looking for volunteers | [00:25] | |
mercutio | i have no idea if he is or not :) | [00:25] | |
acf__ | the full Debian archive is ~1TB :/
I looked into downloading it once.. | [00:25] | |
brycec | I've run company mirrors in the past, I have some experience doing so :) | [00:26] | |
mercutio | but i think he's kind of busy with other things. | [00:26] | |
brycec | brycec remembers when Debian was 500GB | [00:26] | |
mercutio | you probably really want 4x3tb disks or something for a large mirror. | [00:26] | |
brycec | He does indeed seem to be quite busy | [00:26] | |
mercutio | if you used zfs and had a ssd cache it could be amazing :)
i was going to setup an openbsd mirror before. | [00:26] | |
brycec | I did that last month :)
(internal only) | [00:27] | |
mercutio | how big is it now? | [00:27] | |
brycec | brycec goes to look | [00:27] | |
mercutio | 472GB?
hangon this site says debian is 578GB | [00:28] | |
brycec | (my vpn seems to be down, ugh) | [00:28] | |
mercutio | oh there's debian CD too which is 327GB
http://mirrors.gigenet.com/ this mirror seems to list sizes even postfix is 1.3gb haha | [00:28] | |
acf__ | https://www.debian.org/mirror/size | [00:29] | |
mercutio | oh mirorring just amd64 is only 100gb
amd64+i386+source would be better | [00:30] | |
acf__ | yea, that should be fine
I'd be very happy about a Debian mirror at ARP I have lots of boxen connected to ARP for IPv6 via a tunnel | [00:30] | |
mercutio | arch is only 41gb
+7gb for iso, +28GB for source. | [00:32] | |
brycec | mercutio: My OpenBSD mirror is 738GB, only mirroring amd64 and i386, releases 4.0 through 5.6 as well as snapshots, Open{SSH,NTPD,BGPD}, LibreSSL, as well as M:tier's openup | [00:33] | |
mercutio | brycec: arp doesn't mirror that many versions | [00:34] | |
brycec | Okay. And? | [00:34] | |
mercutio | that's quite large. | [00:34] | |
brycec | twss | [00:34] | |
BryceBot | Okay! twss! 'that's quite large.' | [00:34] | |
mercutio | 732GB :( | [00:34] | |
brycec | http://sprunge.us/fIVN
brycec meant to include snapshots in that too - 55.7GB | [00:34] | |
mercutio | hmm
i wonder how much disk arp's mirroring is using. | [00:35] | |
acf__ | http://www.amazon.com/dp/B00LO3KR96 | [00:36] | |
BryceBot | Amazon: "WD Red 6TB NAS Hard Drive: 1 to 8-bay RAID Hard Drive: 3.5-inch SATA 6 Gb/s, IntelliPower, 64MB Cache WD60EFRX" | [00:36] | |
brycec | And yes that's quite a few releases. It spans our development of OpenBSD-based systems, so we kinda need to have access to those old versions. (which is hard to come by, these days) | [00:36] | |
mercutio | eww ed :)
wd yeah i've had that issue before brycec actually i'm surprised arp doesnt' go back further it's only got 5.5 and 5.6 | [00:36] | |
brycec | ARP is just rsync'ing from upstream, which doesn't carry older than that | [00:37] | |
mercutio | i nearly bought those cheap external seagate drives.
oh ok i think it was $140 for 5tb or something? http://www.amazon.com/Seagate-Expansion-Desktop-External-STBV5000100/dp/B00JT0EGPW/ref=lp_1254762011_1_2?s=pc&ie=UTF8&qid=1428564996&sr=1-2 | [00:37] | |
BryceBot | Amazon: "Seagate Expansion USB 3.0 5TB Desktop External Hard Drive (STBV5000100)" | [00:38] | |
acf__ | woah | [00:38] | |
mercutio | so you strip them out of their cases... | [00:38] | |
acf__ | yea | [00:38] | |
mercutio | yeah it's pretty good value
but seagate have some weird screw stuff with some of their larger drives. so they won't necessarily work with trays properly. i've got a dying disk on my personal server :( | [00:38] | |
acf__ | is that a 3.5" disk? | [00:39] | |
mercutio | yeah 3.5"
i was hoping to upgrade to 6tb when i got disk failure but i'll probably just stick another 3tb in actually zfs registered no errors. so maybe it fixed itself. [689969.969725] blk_update_request: I/O error, dev sdd, sector 4314598592 you'd /think/ zfs would have an issue there | [00:39] | |
acf__ | that's always scary..
using RAID? | [00:41] | |
mercutio | yeah raid-z | [00:41] | |
acf__ | good :P | [00:41] | |
mercutio | it has 2.6tb of disk free.
but it's in nz. | [00:41] | |
acf__ | is the ARP mirror a dedicated box? | [00:41] | |
mercutio | don't think so | [00:42] | |
acf__ | darn | [00:42] | |
mercutio | i wish amazon wouldn't combine reviews
so amazon charge $73 US for 1tb, $83 US for 3tb. oh it's cheaper for normal 1tb, that was retail, some weird link thing hey Brycec you could run a mirror :)) i wonder if arp would let you provide your own hard-disks i can't figure out if this hard-disk is the weird screw kind of not though | [00:44] | |
bit's smr
so it's randomly slow | [01:06] | ||
..... (idle for 22mn) | |||
*** | mnathani_ has quit IRC (Ping timeout: 244 seconds) | [01:28] | |
.................................................................. (idle for 5h28mn) | |||
RandalSchwartz | you'd have to have a dedicated to have your own hard disk
and then what if it fails? | [06:56] | |
.......................... (idle for 2h7mn) | |||
m0unds | the odd# TB disks tend to have longevity issues
1.5, 3, etc because they do weird stuff to achieve that density so i guess not odd numbers as in 1,3,5 etc, but odd numbers as in half numbers or combinations of half numbers | [09:03] | |
https://www.backblaze.com/blog/hard-drive-reliability-update-september-2014/ oddly enough, it seems like backblaze did a study of sorts w/failure rates | [09:11] | ||
............................... (idle for 2h30mn) | |||
brycec | I don't find it odd that a company that consumes hard drives by the truckload did a study :P | [11:41] | |
.......... (idle for 47mn) | |||
m0unds | nothing odd about it
that was the joke at any rate, not the first time i've seen data saying the weird in-between sizes are unreliable. i just couldn't find the original one i read a while back (had a lot more specific data) | [12:28] | |
brycec | Oh I didn't catch the joke/sarcasm :p | [12:40] | |
m0unds | there was an amusing post on their blog from the middle of the disk shortage that happened following the flooding in thailand
where their cost for standalone consumer disks doubled (or more) so they resorted to buying external drives and "shucking" them from their enclosures https://www.backblaze.com/blog/backblaze_drive_farming-2 | [12:41] | |
.... (idle for 16mn) | |||
brycec | Yeah I remember
My company was doing the very same thing In smaller quantities at least. But we were doing it too. And having friends+family buy-out stores and ship the drives to us | [12:58] | |
.... (idle for 15mn) | |||
*** | poulsen has joined #arpnetworks | [13:14] | |
mercutio | m0unds: sometimes it's hard to know what they're doin ghtough
like 2tb disks can be 2 or 3 paltters with seagate. | [13:25] | |
brycec | Easy to tell by weight and construction, though that usually comes after you've opened store packaging ;P | [13:25] | |
mercutio | i thought 1tb were good myself | [13:31] | |
BryceBot | That's what she said!! | [13:31] | |
mercutio | m0unds: you know there's iossues with that study btw?
shit i so i can't type before coffee. basically they don't have proper vibration protection at blackblaze, and they';re using consumer hard-disks which don't uusually have good vibration tolerance as serve rhard-drives. | [13:33] | |
brycec | I'm pretty sure BB do something about vibrartion stuff
*vibration | [13:35] | |
mercutio | oh? | [13:35] | |
brycec | Seen it mentioned in their detailed builds
https://www.backblaze.com/blog/backblaze-storage-pod-4/ "" "Includes case, anti-vibration assemblies, cross supports, etc." | [13:35] | |
mercutio | the only recent disk failutres i've had have been with wdc black 1tb and seagate 3tb
but that doesn't say much on it's own :) | [13:36] | |
brycec | (I haven't actually seen their writeup on "4.0" before, but it was the first google result) | [13:37] | |
m0unds | our failure rates w/ES2 and 3 seagates was less than 3% | [13:43] | |
mercutio | hard-disk tech doesn't seem to have improved recently | [13:46] | |
m0unds | dynamic spindle speed stuff is kind of nice for energy use reduction | [13:46] | |
mercutio | they're doing some "density improvements" but it seems it coudl be at the expense of reliability/performance. | [13:46] | |
m0unds | yea
i'd be happy not buying another platter disk again | [13:47] | |
mercutio | i'd like cheap bulk ssd that is slower
and to have fast ssd cache in front of it :) i'd really like to justify these 2gb/sec ssd's. but motherboards with m.2 are really expensive. you can get pci-e adapters, but they require a pci-e slot... | [13:48] | |
m0unds | i wish intel's chipsets would have more pcie lanes to share | [14:02] | |
mercutio | and shift to pci-e 3 | [14:02] | |
m0unds | amd provided 48x of bandwidth starting w/their 990fx chipsets | [14:03] | |
mercutio | of pci-e 3? | [14:03] | |
m0unds | whatever the spec was in 2010 when that chipset came out
you could run a gpu at 16 and a nic or sata controller or whatever, and neither would downgrade | [14:03] | |
mercutio | my onboard ethernet is only 2.5GT/s
1 lane | [14:04] | |
m0unds | or two gpus and a nic and still have them at native speeds. only downgrade occurred w/4 gpus + anything else | [14:04] | |
mercutio | where my 10 gigabit is 8 lanes at 5GT/s
so has 16x as much bw i'm wondering how it'd go in a 2x slot | [14:04] | |
m0unds | on my board w/z87 chipset, 1 gpu + 1 nic + 1 other device = gpu at 4x | [14:05] | |
mercutio | most dual/quad gigabit cards are 4x.
does gpu at 4x hurt? | [14:05] | |
m0unds | yep
doesn't really at 8, does for sure at 4 | [14:05] | |
mercutio | for 2d? | [14:05] | |
m0unds | nah, 3
3d | [14:05] | |
mercutio | i'm at 8x/8x on my windows box | [14:05] | |
m0unds | my pc's primary job is entertaining me with explosions and such | [14:05] | |
mercutio | and 16x/4x on my linux box
but the 4x is chipset :( i like 8x/8x | [14:06] | |
m0unds | yea, 8/8 is fine for the most part, esp w/pcie3 | [14:06] | |
mercutio | so video card moving to 4x pci-2 may hurt? | [14:06] | |
m0unds | yea | [14:06] | |
mercutio | even for 2d? | [14:06] | |
m0unds | doubt for 2d
for 3d yes | [14:06] | |
mercutio | hmm
what about chrome | [14:06] | |
m0unds | couldn't tell you
hw rendering is chrome breaks pretty regularly on every platform | [14:07] | |
mercutio | i dunno i'm replacing motherboard anyway. | [14:07] | |
m0unds | s/is/in | [14:07] | |
BryceBot | <m0unds> hw rendering in chrome breaks pretty regularly on every platform | [14:07] | |
mercutio | i used to find linux had amazing chrome performance compared to windows
and i managed to improve my web performance with chromium on windows. so recently i tried my old chromium build, a whole lot of sites complain about old version, but it seems way faster. i was mostly screwing around with allowing more than 16 connections through http proxy iirc i had all these annoying if-modified-since requests going through to proxy and you can't just throw 30 if modified sinces out at once :( and get a list of what's modified i hope http/2 fixes that kind of case, it was pretty common it's kind of well known that web pages will load faster if you rename images, (use unique names) and set long expiriation times to avoid if-modified-since but hardly any real sites do that. | [14:07] | |
*** | mnathani_ has joined #arpnetworks | [14:19] | |
........................... (idle for 2h11mn) | |||
phlux | so i'm doing business cards and a website for my music stuff
i'm thinking i should probably just go with a wordpress install for the music site the people that are going to help me with content aren't exactly tech experts but i want to put video files and an audio player on it so people can pick and choose what to listen to..that sort of thing no idea how to do that portion | [16:30] | |
brycec | Interesting.
phlux: Take a look at Concrete (C5) too | [16:32] | |
mnathani_ | theres porbably a plugin for multimedia content | [16:32] | |
brycec | It aims to be more user-friendly, and more secure | [16:32] | |
mnathani_ | uploading and viewing / listening
s/porbably/probably | [16:32] | |
BryceBot | <mnathani_> theres probably a plugin for multimedia content | [16:32] | |
phlux | I wonder if there's a good multimedia addon for Concerte
Concrete, even
| [16:34] | |
..... (idle for 21mn) | |||
*** | ix33 has left
ix33 has joined #arpnetworks | [16:57] | |
mercutio | phlux: are you doing a facebook page? | [17:05] | |
phlux | yes | [17:05] | |
mercutio | it seems facebook is one of the best ways for promotion these days
as you don't have to go so far out of youur way to check the page | [17:05] | |
phlux | yeah | [17:06] | |
............... (idle for 1h13mn) | |||
*** | poulsen has quit IRC (Remote host closed the connection) | [18:19] | |
.............................................. (idle for 3h46mn) | |||
m0unds | soundcloud has an embeddable player and their free tier allows around 1hr of content | [22:05] |
↑back Search ←Prev date Next date→ Show only urls | (Click on time to select a line by its url) |