#arpnetworks 2015-04-09,Thu

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)

WhoWhatWhen
brycecWow, Linux really does have a faster network stack than OpenBSD. Wheezy on this Metal box gets at least 800mbps consistently.
100MB test file downloaded in 1 second :p
brycec hates network/Internet mirrors that can't keep up with his own connection
[00:03]
mercutiobrycec: it does bug me a little :)
i find my home mirror pretty fast :)
well proxy cache, with ssd.
i think a lot of the time it's about small file performance.
and so having a low ping, and cached on ssd or ram helps.
saturating gigabit is quite hard for a hard-disk with lots of small files.
[00:16]
brycecI notice it most with Sourceforge mirrors, many of which barely crack 10mbps [00:18]
mercutioand raid can't really fix it. using 15k sas disks or something would help more than raid probably. [00:18]
brycecThere's no excuse for that in this day and age. [00:18]
mercutiooh sourceforge has it's own issues i think. [00:18]
brycec(*its) [00:18]
mercutioi get 200 to 300k/sec or something on sourceforge frequuently
actually the worst i find are motherboard wsites.
if you ever download anything from a motherboard site i tend to find it can be like 20 to 30k/sec or less!
[00:18]
brycecHeh I don't run into too many of those typically, but yeah they are usually slow. I don't mind much, they aren't running a professional download service :p [00:19]
mercutioand it's not just because they're in taiwan.
well sourceforge don't charge for downloads.
and don't have much of a revenue stream?
i find mirrors.kernel.org seems to have consistent speeds.
well when it goes to the right mirror hah
[00:19]
brycecIndeed, quite reasonable. It's my goto mirror [00:20]
mercutiobut it doesn't tend to get slow at diff times.
whereas archive.ubuntu.com/security.ubuntu.com can crawl
whenever there is a new ubuntu release it shows on my smokeping :)
i actually use arp's mirror a lot :)
plus nz mirror.
the nz mirrors are faster than arp it seems (when similar ping)
probably just better raid config, or more users so more likely to be in cache
[00:20]
brycechaha
I'm using ARP's mirrors quite a bit right now too... on-network.
I'd get much more use out of it if ARP would just mirror Debian too.
(and stop wasting space mirroring architectures they themselves don't support)
[00:22]
mercutioyeah i think he's short on space.
yeah that'd be sensible.
[00:24]
brycecDitto - he's commented on it before.
Why do we mirror powerpc ISOs for FreeBSD? :p
[00:25]
mercutiomaybe you should volunteer to clean it up. [00:25]
brycecwe/they
I didn't know up_the_irons was looking for volunteers
[00:25]
mercutioi have no idea if he is or not :) [00:25]
acf__the full Debian archive is ~1TB :/
I looked into downloading it once..
[00:25]
brycecI've run company mirrors in the past, I have some experience doing so :) [00:26]
mercutiobut i think he's kind of busy with other things. [00:26]
brycecbrycec remembers when Debian was 500GB [00:26]
mercutioyou probably really want 4x3tb disks or something for a large mirror. [00:26]
brycecHe does indeed seem to be quite busy [00:26]
mercutioif you used zfs and had a ssd cache it could be amazing :)
i was going to setup an openbsd mirror before.
[00:26]
brycecI did that last month :)
(internal only)
[00:27]
mercutiohow big is it now? [00:27]
brycecbrycec goes to look [00:27]
mercutio472GB?
hangon this site says debian is 578GB
[00:28]
brycec(my vpn seems to be down, ugh) [00:28]
mercutiooh there's debian CD too which is 327GB
http://mirrors.gigenet.com/
this mirror seems to list sizes
even postfix is 1.3gb haha
[00:28]
acf__https://www.debian.org/mirror/size [00:29]
mercutiooh mirorring just amd64 is only 100gb
amd64+i386+source would be better
[00:30]
acf__yea, that should be fine
I'd be very happy about a Debian mirror at ARP
I have lots of boxen connected to ARP for IPv6 via a tunnel
[00:30]
mercutioarch is only 41gb
+7gb for iso, +28GB for source.
[00:32]
brycecmercutio: My OpenBSD mirror is 738GB, only mirroring amd64 and i386, releases 4.0 through 5.6 as well as snapshots, Open{SSH,NTPD,BGPD}, LibreSSL, as well as M:tier's openup [00:33]
mercutiobrycec: arp doesn't mirror that many versions [00:34]
brycecOkay. And? [00:34]
mercutiothat's quite large. [00:34]
brycectwss [00:34]
BryceBotOkay! twss! 'that's quite large.' [00:34]
mercutio732GB :( [00:34]
brycechttp://sprunge.us/fIVN
brycec meant to include snapshots in that too - 55.7GB
[00:34]
mercutiohmm
i wonder how much disk arp's mirroring is using.
[00:35]
acf__http://www.amazon.com/dp/B00LO3KR96 [00:36]
BryceBotAmazon: "WD Red 6TB NAS Hard Drive: 1 to 8-bay RAID Hard Drive: 3.5-inch SATA 6 Gb/s, IntelliPower, 64MB Cache WD60EFRX" [00:36]
brycecAnd yes that's quite a few releases. It spans our development of OpenBSD-based systems, so we kinda need to have access to those old versions. (which is hard to come by, these days) [00:36]
mercutioeww ed :)
wd
yeah i've had that issue before brycec
actually i'm surprised arp doesnt' go back further
it's only got 5.5 and 5.6
[00:36]
brycecARP is just rsync'ing from upstream, which doesn't carry older than that [00:37]
mercutioi nearly bought those cheap external seagate drives.
oh ok
i think it was $140 for 5tb or something?
http://www.amazon.com/Seagate-Expansion-Desktop-External-STBV5000100/dp/B00JT0EGPW/ref=lp_1254762011_1_2?s=pc&ie=UTF8&qid=1428564996&sr=1-2
[00:37]
BryceBotAmazon: "Seagate Expansion USB 3.0 5TB Desktop External Hard Drive (STBV5000100)" [00:38]
acf__woah [00:38]
mercutioso you strip them out of their cases... [00:38]
acf__yea [00:38]
mercutioyeah it's pretty good value
but seagate have some weird screw stuff with some of their larger drives.
so they won't necessarily work with trays properly.
i've got a dying disk on my personal server :(
[00:38]
acf__is that a 3.5" disk? [00:39]
mercutioyeah 3.5"
i was hoping to upgrade to 6tb when i got disk failure
but i'll probably just stick another 3tb in
actually zfs registered no errors.
so maybe it fixed itself.
[689969.969725] blk_update_request: I/O error, dev sdd, sector 4314598592
you'd /think/ zfs would have an issue there
[00:39]
acf__that's always scary..
using RAID?
[00:41]
mercutioyeah raid-z [00:41]
acf__good :P [00:41]
mercutioit has 2.6tb of disk free.
but it's in nz.
[00:41]
acf__is the ARP mirror a dedicated box? [00:41]
mercutiodon't think so [00:42]
acf__darn [00:42]
mercutioi wish amazon wouldn't combine reviews
so amazon charge $73 US for 1tb, $83 US for 3tb.
oh it's cheaper for normal 1tb, that was retail, some weird link thing
hey Brycec you could run a mirror :))
i wonder if arp would let you provide your own hard-disks
i can't figure out if this hard-disk is the weird screw kind of not though
[00:44]
bit's smr
so it's randomly slow
[01:06]
..... (idle for 22mn)
***mnathani_ has quit IRC (Ping timeout: 244 seconds) [01:28]
.................................................................. (idle for 5h28mn)
RandalSchwartzyou'd have to have a dedicated to have your own hard disk
and then what if it fails?
[06:56]
.......................... (idle for 2h7mn)
m0undsthe odd# TB disks tend to have longevity issues
1.5, 3, etc
because they do weird stuff to achieve that density
so i guess not odd numbers as in 1,3,5 etc, but odd numbers as in half numbers or combinations of half numbers
[09:03]
https://www.backblaze.com/blog/hard-drive-reliability-update-september-2014/ oddly enough, it seems like backblaze did a study of sorts w/failure rates [09:11]
............................... (idle for 2h30mn)
brycecI don't find it odd that a company that consumes hard drives by the truckload did a study :P [11:41]
.......... (idle for 47mn)
m0undsnothing odd about it
that was the joke
at any rate, not the first time i've seen data saying the weird in-between sizes are unreliable. i just couldn't find the original one i read a while back (had a lot more specific data)
[12:28]
brycecOh I didn't catch the joke/sarcasm :p [12:40]
m0undsthere was an amusing post on their blog from the middle of the disk shortage that happened following the flooding in thailand
where their cost for standalone consumer disks doubled (or more) so they resorted to buying external drives and "shucking" them from their enclosures
https://www.backblaze.com/blog/backblaze_drive_farming-2
[12:41]
.... (idle for 16mn)
brycecYeah I remember
My company was doing the very same thing
In smaller quantities at least. But we were doing it too. And having friends+family buy-out stores and ship the drives to us
[12:58]
.... (idle for 15mn)
***poulsen has joined #arpnetworks [13:14]
mercutiom0unds: sometimes it's hard to know what they're doin ghtough
like 2tb disks can be 2 or 3 paltters with seagate.
[13:25]
brycecEasy to tell by weight and construction, though that usually comes after you've opened store packaging ;P [13:25]
mercutioi thought 1tb were good myself [13:31]
BryceBotThat's what she said!! [13:31]
mercutiom0unds: you know there's iossues with that study btw?
shit i so i can't type before coffee.
basically they don't have proper vibration protection at blackblaze, and they';re using consumer hard-disks which don't uusually have good vibration tolerance as serve rhard-drives.
[13:33]
brycecI'm pretty sure BB do something about vibrartion stuff
*vibration
[13:35]
mercutiooh? [13:35]
brycecSeen it mentioned in their detailed builds
https://www.backblaze.com/blog/backblaze-storage-pod-4/
""
"Includes case, anti-vibration assemblies, cross supports, etc."
[13:35]
mercutiothe only recent disk failutres i've had have been with wdc black 1tb and seagate 3tb
but that doesn't say much on it's own :)
[13:36]
brycec(I haven't actually seen their writeup on "4.0" before, but it was the first google result) [13:37]
m0undsour failure rates w/ES2 and 3 seagates was less than 3% [13:43]
mercutiohard-disk tech doesn't seem to have improved recently [13:46]
m0undsdynamic spindle speed stuff is kind of nice for energy use reduction [13:46]
mercutiothey're doing some "density improvements" but it seems it coudl be at the expense of reliability/performance. [13:46]
m0undsyea
i'd be happy not buying another platter disk again
[13:47]
mercutioi'd like cheap bulk ssd that is slower
and to have fast ssd cache in front of it :)
i'd really like to justify these 2gb/sec ssd's.
but motherboards with m.2 are really expensive.
you can get pci-e adapters, but they require a pci-e slot...
[13:48]
m0undsi wish intel's chipsets would have more pcie lanes to share [14:02]
mercutioand shift to pci-e 3 [14:02]
m0undsamd provided 48x of bandwidth starting w/their 990fx chipsets [14:03]
mercutioof pci-e 3? [14:03]
m0undswhatever the spec was in 2010 when that chipset came out
you could run a gpu at 16 and a nic or sata controller or whatever, and neither would downgrade
[14:03]
mercutiomy onboard ethernet is only 2.5GT/s
1 lane
[14:04]
m0undsor two gpus and a nic and still have them at native speeds. only downgrade occurred w/4 gpus + anything else [14:04]
mercutiowhere my 10 gigabit is 8 lanes at 5GT/s
so has 16x as much bw
i'm wondering how it'd go in a 2x slot
[14:04]
m0undson my board w/z87 chipset, 1 gpu + 1 nic + 1 other device = gpu at 4x [14:05]
mercutiomost dual/quad gigabit cards are 4x.
does gpu at 4x hurt?
[14:05]
m0undsyep
doesn't really at 8, does for sure at 4
[14:05]
mercutiofor 2d? [14:05]
m0undsnah, 3
3d
[14:05]
mercutioi'm at 8x/8x on my windows box [14:05]
m0undsmy pc's primary job is entertaining me with explosions and such [14:05]
mercutioand 16x/4x on my linux box
but the 4x is chipset :(
i like 8x/8x
[14:06]
m0undsyea, 8/8 is fine for the most part, esp w/pcie3 [14:06]
mercutioso video card moving to 4x pci-2 may hurt? [14:06]
m0undsyea [14:06]
mercutioeven for 2d? [14:06]
m0undsdoubt for 2d
for 3d yes
[14:06]
mercutiohmm
what about chrome
[14:06]
m0undscouldn't tell you
hw rendering is chrome breaks pretty regularly on every platform
[14:07]
mercutioi dunno i'm replacing motherboard anyway. [14:07]
m0undss/is/in [14:07]
BryceBot<m0unds> hw rendering in chrome breaks pretty regularly on every platform [14:07]
mercutioi used to find linux had amazing chrome performance compared to windows
and i managed to improve my web performance with chromium on windows.
so recently i tried my old chromium build, a whole lot of sites complain about old version, but it seems way faster.
i was mostly screwing around with allowing more than 16 connections through http proxy iirc
i had all these annoying if-modified-since requests going through to proxy
and you can't just throw 30 if modified sinces out at once :(
and get a list of what's modified
i hope http/2 fixes that kind of case, it was pretty common
it's kind of well known that web pages will load faster if you rename images, (use unique names) and set long expiriation times to avoid if-modified-since
but hardly any real sites do that.
[14:07]
***mnathani_ has joined #arpnetworks [14:19]
........................... (idle for 2h11mn)
phluxso i'm doing business cards and a website for my music stuff
i'm thinking i should probably just go with a wordpress install for the music site
the people that are going to help me with content aren't exactly tech experts
but i want to put video files and an audio player on it
so people can pick and choose what to listen to..that sort of thing
no idea how to do that portion
[16:30]
brycecInteresting.
phlux: Take a look at Concrete (C5) too
[16:32]
mnathani_theres porbably a plugin for multimedia content [16:32]
brycecIt aims to be more user-friendly, and more secure [16:32]
mnathani_uploading and viewing / listening
s/porbably/probably
[16:32]
BryceBot<mnathani_> theres probably a plugin for multimedia content [16:32]
phluxI wonder if there's a good multimedia addon for Concerte
Concrete, even
Something like this: https://www.wonderplugin.com/wordpress-audio-player/
[16:34]
..... (idle for 21mn)
***ix33 has left
ix33 has joined #arpnetworks
[16:57]
mercutiophlux: are you doing a facebook page? [17:05]
phluxyes [17:05]
mercutioit seems facebook is one of the best ways for promotion these days
as you don't have to go so far out of youur way to check the page
[17:05]
phluxyeah [17:06]
............... (idle for 1h13mn)
***poulsen has quit IRC (Remote host closed the connection) [18:19]
.............................................. (idle for 3h46mn)
m0undssoundcloud has an embeddable player and their free tier allows around 1hr of content [22:05]

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)