up_the_irons: brycec: possibly :) hazardous: everypony ***: first2know has joined #arpnetworks
heavysixer has joined #arpnetworks
ChanServ sets mode: +o heavysixer
heavysixer has quit IRC (Quit: heavysixer) m0unds: it seems a lot of providers use consumer grade ssds because of the low cost relative to enterprise-grade ssds with significantly better write endurance. i'd rather have enterprise grade platter disks with predictable performance, tbh ***: heavysixer has joined #arpnetworks
ChanServ sets mode: +o heavysixer
heavysixer has quit IRC (Client Quit)
houst0n has quit IRC (Ping timeout: 248 seconds)
ziyourenxiang has joined #arpnetworks
heavysixer has joined #arpnetworks
ChanServ sets mode: +o heavysixer
heavysixer has quit IRC (Read error: No route to host)
heavysixer has joined #arpnetworks
ChanServ sets mode: +o heavysixer
ziyourenxiang has quit IRC (Quit: ziyourenxiang)
heavysixer has quit IRC (Quit: heavysixer)
heavysixer has joined #arpnetworks
ChanServ sets mode: +o heavysixer
heavysixer has quit IRC (Quit: heavysixer)
heavysixer has joined #arpnetworks
ChanServ sets mode: +o heavysixer
heavysixer has quit IRC (Quit: heavysixer)
heavysixer has joined #arpnetworks
ChanServ sets mode: +o heavysixer
first2know has quit IRC (Ping timeout: 264 seconds)
first2know has joined #arpnetworks
heavysixer has quit IRC (Quit: heavysixer)
heavysixer has joined #arpnetworks
ChanServ sets mode: +o heavysixer
heavysixer has quit IRC (Client Quit)
heavysixer has joined #arpnetworks
ChanServ sets mode: +o heavysixer gizmoguy: m0unds: nah, raid0+0 with consumer SSDs is my prefered setup
you've never seen that kind of speed before m0unds: gizmoguy: delicious
how're you? gizmoguy: pretty busy :/ m0unds: bleck, last couple weeks have been pretty bad here too gizmoguy: yeah I imagine, silly IT
at least I've managed to hire another guy to look after the jobs I don't want to do ;) m0unds: hahaha, that's good
wish i could do that
i just get tasked with All The Things (tm) gizmoguy: yeah, sucks :/ m0unds: we had a pretty fantastic outage a couple weeks back gizmoguy: oh yeah?
what did you do? :P m0unds: here in the desert, we get crazy violent thunderstorms in the summer - one such thunderstorm stalled over the property i work at. direct lightning strikes on both our utility feeds. facilities people had taken the charger off one of our generators because it was giving them fits. gen failed to start because the batteries had died. ups lasted 15 mins and we lost all our edge gear for 90 mins. :D gizmoguy: oh yeah m0unds: same generator also powers our sumps, so we had about 13cm of water in the parking garage, water coming up through drains in the floor gizmoguy: lightning sucks m0unds: and the best part: transient voltage made it through the UPS and nuked two 2960s gizmoguy: good, you needed to replace them anyway :) m0unds: with 2 more 2960s, sadly gizmoguy: ah
that sounds like a sucky outage
what time it happen? m0unds: :)
00:10
i had left at 22:00, was up til 01:00 taking lightning photos (lol) and got called in at 0300 because the tech who was here had no idea what to do gizmoguy: lol m0unds: it was fantastic gizmoguy: it does sound amazing m0unds: just every little hole we had going on that particular weekend was drilled by stupid lightning gizmoguy: yeah it's amazing how deadly lightning can be m0unds: we had footage of the transformers exploding gizmoguy: we had a lightning strike take down our primary DC once
wasn't pretty
lol m0unds: it was incredible. you could see the casing melting and flying all over
solid steel housing gizmoguy: fun times m0unds: yessir! gizmoguy: bet your electricians enjoyed that one m0unds: the utility company had to dig up a good chunk of wire from one of the transformers to the building because it was charred/melted gizmoguy: yeah :/ m0unds: other feed was fine, luckily, or we would have had to shut down for 2 days gizmoguy: phew m0unds: casino environment - 300ish hotel rooms had to be evacuated due to loss of power gizmoguy: evacuted into a thunderstorm? :)
at 1am?
bet they were thrilled m0unds: into shuttles to take them to other hotels
yeah, facility here paid for their accommodations at other places, gave them free hotel stays at a later date, etc gizmoguy: nice
but lots of lost money I imagine m0unds: yep, 100% capacity that night
not as much as we lost shutting down high limit areas and stuff due to my equipment issues
oh well. now, they have me speccing out new UPS gear to separate us from the rest of the facility in that regard. that's going to be no fun either. gizmoguy: lol
I really like the massive kit emerson do
but uh
get some better maintained generators :) m0unds: yeah, doesn't address all the other issues we had at all
yep
three of 4 fired up, that one just happened to be really important. lol
we've got 4x 1.7MW cummins gensets gizmoguy: but uh no UPS is going to stand up to lightning
you got a good collection of lightning arrestors? m0unds: nope
yep
i think the ups' just struggled to filter it well gizmoguy: oh well I better head off and get rid of our broken dishwasher
nice catching up
don't break other stuff before our next chat :0 m0unds: yeah, take it easy - don't have too much fun w/the dishwasher :P
you either, unless it's awesome (breaking stuff) gizmoguy: my most fun (not really) project coming up
I've setup an ISP for a customer in city A
he now wants me to move it to city B (4 hours away) so it's cheaper for him
oh and no outage plz m0unds: better find your wizard hat toddf: gizmoguy: and he wants you to do it on budget on time too, eh? gizmoguy: oh yeah
gave a month or so notice m0unds: perfect ***: heavysixer has quit IRC (Quit: heavysixer)
heavysixer has joined #arpnetworks
ChanServ sets mode: +o heavysixer
heavysixer has quit IRC (Quit: heavysixer)
mnathani has joined #arpnetworks brycec: well at least you were given notice! I've been told, on two separate instances, "We're moving at the end of the week." Utilities/ISPs/etc really prefer more notice than that (as do I)
(literally less than a week's ntoice) ***: heavysixer has joined #arpnetworks
ChanServ sets mode: +o heavysixer
heavysixer has quit IRC (Quit: heavysixer)
Ehtyar has joined #arpnetworks