***: john3213 has left
acf_ has quit IRC (Ping timeout: 252 seconds)
acf_ has joined #arpnetworks
Konata has joined #arpnetworks
mjp has joined #arpnetworks
mjp: any network problems at arp atm?
https://www.google.co.uk/search?q=network+outage+ge-0-7-0-24.r04.lsanca03.us.ce.gin.ntt.net
comes up with: http://irclogger.arpnetworks.com/irclogger_log/arpnetworks?date=2013-09-18,Wed&text=on
***: mjp has quit IRC (Ping timeout: 276 seconds)
brycec: (fwiw nothing showing on my smokeping over the last 12ish hours)(but they've left anyways...)
m0unds: haha
haven't noticed any issues for a while
comcast just deployed some new gear in my area, so i've been seeing +/- .7ms or so to arp for the last few days
-: brycec is having major TWC issues this a.m. :(
brycec: (but it might also be my own gear at fault)
(either way, I'm seeing 300+ms to the cable modem 2 feet away)
m0unds: booooo
brycec: Honestly, this graph is fucking hilarious https://smokeping.cobryce.com/?target=Slaves.cobrycesmokepingslave
(particularly @ 12hrs viwe)
https://smokeping.cobryce.com/?displaymode=n;start=2014-05-18%2021:46;end=now;target=Slaves.cobrycesmokepingslave
***: mjp has joined #arpnetworks
m0unds: whoa
looks like it's trying to draw something, haha
jpalmer: looks like a lie detector, to me.
and, the network is LYING!
***: Konata has quit IRC (Quit: Leaving...)
anisfarhana has quit IRC (Ping timeout: 245 seconds)
mnathani has quit IRC (Ping timeout: 240 seconds)
jlgaddis has quit IRC (Ping timeout: 245 seconds)
pcn has quit IRC (Ping timeout: 240 seconds)
josephb has quit IRC (Ping timeout: 245 seconds)
Konata has joined #arpnetworks
josephb has joined #arpnetworks
pcn has joined #arpnetworks
anis has joined #arpnetworks
mnathani has joined #arpnetworks
jlgaddis has joined #arpnetworks
jlgaddis has quit IRC (Changing host)
jlgaddis has joined #arpnetworks
mjp has quit IRC (Ping timeout: 258 seconds)
up_the_irons: mnathani: for larger amounts of ram, you need registered. udimm's can still certainly be used in servers. all our dedi's have udimm's, but the are of course ECC too. we don't need rdimm's on the dedi's b/c ram count is not too high
mnathani: up_the_irons: thanks
up_the_irons: np
***: Konata has quit IRC (Quit: Leaving...)
mnathani: up_the_irons: How do you manage IP address assignments across ARP Networks customers? Spreadsheet, or something more elegant?
Perhaps something like phpIPAM
up_the_irons: mnathani: internal app i wrote. uses rfc 3531 allocation method (can be used on ipv4 also). parts of it are somewhere on my github.
the "spreadsheet method" lost scale long ago ;)
mnathani: your app take care of historic VLAN assignments as well?
up_the_irons: historic?
it takes care of vlan assignments; not sure what you mean by historic
mnathani: over time, like presently vlan 10 is assigned to a range, but before that it used to be vlan 20 etc
CaZe: What if you get a subpoena for an IP that ended service like six months ago?
mnathani: as customer turn over takes place
up_the_irons: it does not keep history like that, no. i have rancid on all my switches, so if i really wanted to see the past, i could pull it up via CVS (ick, i know)
CaZe: you would respond to the court and say the IP is no longer in use
mercutio: registered ram is actually cheaper at least on ebay
and you can get bigger sticks
up to 16gb on ddr3 i think, which is how people get 192gb of ram etc
(6 per cpu)
up_the_irons: yeah udimm's can be more expensive
mercutio: well ecc udimms can be at least
looks like 8gb cost a bit more still
up_the_irons: yeah i meant ecc
hazardous: hi nerds!!!
-: hazardous hugs channel
RandalSchwartz: geek. not nerd
no pocket protector here
mercutio: sure sure :")
RandalSchwartz: oh - I admit... I used to have an HP41C attached to my belt. but never a pocket protector.
-: RandalSchwartz wonders how many people in channel will be googling HP41C to see what it was.
novae googled it
CaZe wonders how many people in the channel didn't have to google it to know what it was
up_the_irons: lol
mercutio: it's a calculator isn't it?
with reverse polish notation?
oh shit now i must be a nerd
RandalSchwartz: a hospital, what is it!
mercutio: up_the_irons: did hivelocity ever update saying anything more than they'd look into it?
up_the_irons: no
mercutio: it's still down it seems.
up_the_irons: bang on their door
mercutio: heh
i'm not a customer of theirs
but you never know
up_the_irons: still, noc's get emails from the outside all the time
anyway, i've just disabled their session
(just now)
no point leaving up something broken that they don't seem to care to fix
mercutio: ahh ok
it still looks the same sdo far
10.10.10.6 is last hop
did people start using the new ip adddress block much yet?
for coresite
up_the_irons: everyone has migrated
mercutio: ahh ok
is 10.10.10.6 your peering box?
up_the_irons: oh crap, they send routes over any2easy too
mercutio: ahh
up_the_irons: not as easy to filter
i could do it, just not now
mercutio: is this a reverse path filter issue?
with assymetric routing
RandalSchwartz: this weekend.... is upgrade weekend!
just gonna use csup to get from 8.3 to 8.4
minimal ruisk
mercutio: freebsd?
RandalSchwartz: but I also have to go from perl 5.10 to 5.16 :)
yeah
also upgrading to pkgng
mercutio: cautious :)
RandalSchwartz: and probably installing poudeiere to do my package building from now on
-: brycec didn't have to google it... I had an HP-48
mercutio: i haven't seen perl being that annoying recently with upgrades
not compared to in the past
php is still nasty though :)
RandalSchwartz: yeah - I have a half dozen bsdpan though
hopefully none of them have XS
mercutio: it's a bit disconcerting how much stuff doesn't support python3
RandalSchwartz: hmm. WTF. IO::Tty is bsdpan?
brycec: Real schism in the Python world, with python3
RandalSchwartz: should be able to replace that with a real port
mercutio: at least python 2.7 still seems to be supported and you can have both at once
arch linux changed /usr/bin/python or whatever to point to python3
it's a way to break a lot of things.
RandalSchwartz: awesome - http://www.freshports.org/devel/p5-IO-Tty/
so zero bsdpan now
mercutio: cool.
RandalSchwartz: probably have to force-install since it'll have to overwrite the bsdpan stuff
mercutio: up_the_irons: is level3 capacity up yet btw?
up_the_irons: ok, i created a "bad peer" filter and now hivelocity routes should be eradicated
mercutio: well route changed and it's not working
i wonder if it's the reverse path
up_the_irons: mercutio: not yet; everything is done i just need to find time to set up the vlans and turn up the sessions. There was a big delay when I requested that they renumber the vlans they gave me (cuz I had them already in use)
mercutio: it's going via AS11799 now
up_the_irons: oh god
so yeah, bgp collective picked it up
mercutio: well that's from whois
up_the_irons: and they probably have the exact same problem
mercutio: err reverse lookup even
hahaha
shit
you'd think hivelocity would fix it then
cos surely it's affecting lots of people
up_the_irons: yeah
mercutio: i do wonder about the vlan thing
4096 vlans isn't many
it's easy to get clashes
up_the_irons: happens all the time
mercutio: and vlan over vlan is a stupid way to go about things :)
hmm, here vlans are done because there's often national/international split etc
but is there any reason it actually needs to be tagged for you?
brycec: Good point... I don't see why it couldn't be handed off un-tagged,
mercutio: i can see lots of reasons in general bryce :)
i normally advocate tagging...
like there may be a different vlan to send ddos blocks
brycec: tagging is swell, but I figure when it comes to the handoff of a single connection, I reckon they could hand it off un-tagged and let you absorb it as you wish, tag it on your switch, etc
mercutio: also you can do the thing of having two vlans that talk to different routers
that share the same bandwidth allotment
so you plug into switch that then plugs into two routers
which means you have switch as point of failure rather than router
but then you have two switches and two cables, if you want to fix that
but then it's normally failover only, and each router can talk normally, so you can use both routers for transit
and only in the case of switch failure switch cables
and pay for bandwidth allotment rather than two
up_the_irons: mercutio: brycec : it's handed off tagged b/c i request 2 separate sessions (for redundancy)
mercutio: ahh cool, well that's a good enough reason to me :)
-: brycec nods
mercutio: bgp is so slow when sessions go down
staticsafe: yes
mercutio: with all the talk of ddos and 10 gigabit+ links etc
bgp still takes ages to converge
easymac: some carriers run bfd with their customers
mercutio: *cough*
that can make it worse
easymac: how so?
mercutio: bfd can lose sync
when the connection is up
esp. with ddos attacks
and means the total outage time is worse
easymac: i suppose
mercutio: ddos attacks are pretty common these days
easymac: then what's the solution?
mercutio: more common than fibre failures i imagine
RandalSchwartz: upgrade from ddos to dwindows :)
easymac: RandalSchwartz++
mercutio: usually it's fibre level redundancy
with link path fast failover
and redundant sessions
and redundant routing engines
but that starts getting more expensiveetc
staticsafe: redundant all the things
m0unds: RandalSchwartz: baahaaahaaaaa
brycec: Redundancy! Load-balancing with failover!
CARP!
m0unds: aw carp
RandalSchwartz: carp diem
fish of the day
staticsafe: the CARP drama on NANOG recently was great
m0unds: i saw a lady with "carpe deim" tattooed on her back
not to be confused with carpe diem
carp drama?
brycec: lol m0unds
meingtsla: carp damn
brycec: staticsafe: Mailing list? Link to archives?
staticsafe: http://mailman.nanog.org/pipermail/nanog/2014-May/thread.html#66864
m0unds: i forgot to resub to nanog digest - desubbed for a bit because it was getting super spammy
brycec: (I feel like this is starting in the middle of a coversation)
staticsafe: hm
sec
brycec: http://mailman.nanog.org/pipermail/nanog/2014-April/066514.html
staticsafe: http://mailman.nanog.org/pipermail/nanog/2014-April/thread.html#66514
yeah
brycec: (Yay Henning Brauer)
He's a good dev
mercutio: yeah he does seem good
RandalSchwartz: carp dime
10 cents a day
seize the dime!
-: brycec steals RandalSchwartz's dime
brycec: Wow this nong thread is godawful
staticsafe: it got pretty bad yeah
brycec: "So yes, the problem only exists if you are running VRRP and CARP on the same subnet and happen to have a host identifier conflict."
-: brycec wonders why he's wasting so much brainpower on this
mercutio: masochistic
brycec: haha
RandalSchwartz: the problem happens only if the moon is in the seventh house...
mercutio: ryan shea is a troll
oh so is paul wall
i wonder if they're from cisco or something
brycec: (Feels like Paul Wall is the bigger troll, so far)
m0unds: google
haha
mercutio: gmail you mean?
i don't turst people with gmail addressses :/
RandalSchwartz: better than hotmail!
m0unds: no
mercutio: not really
same diff
same with yahoo etc
m0unds: ryan shea @ google.com
brycec: Ryan Shea has a google.com address
RandalSchwartz: or comcast.net
m0unds: is that dude's addr
durr
mercutio: have a work or personal domain
brycec: except @google.com is legit, corporate google
m0unds: yes
RandalSchwartz: I see bizcards that list @comcast.net
and I go... WTF
brycec: I'm with you RandalSchwartz
m0unds: i've seen verizon.net on biz cards before
RandalSchwartz: geez
mercutio: exactly
m0unds: or verizon.com, whichever their hsi email domain is
brycec: I see sooo many doctors offices with @aol.com
mercutio: it doesnt' inspsire confidence
unless it's a small individual
or small company
m0unds: small in stature?
like a mouse?
mercutio: that isn't internet related
but as soon as you're doing internet related stuff it's expected
brycec: I love when doctors offices have a website, but email @isp/webmail.com
m0unds: hahaha, yeah
mercutio: haha
RandalSchwartz: heh
m0unds: my dentist's office recently changed from an @qwestbusiness email (or somesuch)
q.biz or something
RandalSchwartz: seriously - you can't afford $7/year for a forwarding domain? :)
m0unds: haha
it's really funny too when an office uses comcast biz, but they never got help configuring the hosted exchange that gets bundled w/that connection
so you see @comcast.net when they could do @domain.tld via a svc they're effectively paying for
brycec: (TIL that comcastbiz comes with exchange)
m0unds: yeah, it's 2007 or 2010
5 or 10 users too
brycec: It's sad, we have TW-biz, and all I know is IP block we're allocated. No idea what else it comes with
(because the guy who handles the account is useless)
m0unds: ah, rep w/TW?
brycec: No, I meant the company owner who called TW and said "we need Internet" never passed any of the information along
m0unds: just logged in to my acct to look - came with 5 accts, also some amount of sharepoint space too
oh, gotcha
mercutio: i dunno why i reading the web archives of nanog
i'm subscribed
m0unds: hahaha
brycec: He told me that a TW guy was coming out, and the TW guy setup the cable drop and modem and handed me a piece of paper with the IP
lol mercutio
mercutio: i don't read it often
it's got it's own folder
m0unds: yeah, that's part of why i unsubbed
wasn't reading it because i kept seeing the same inane stuff popping up day after day
mercutio: i thought it was interesting that people were talking about new zealand
but not the subject matter argh
m0unds: and i couldn't be bothered to dig into it to see interesting stuff
mercutio: every isp has to be registered here now
m0unds: then there was some event early this year or late last year that resulted in /tons/ of digest msgs, so i unsubbed
mercutio: where isp is a loose term
which basically means anyone that provides network capabilities iirc
brycec: mercutio: Would a home wifi connection qualify as "ISP"? :p
m0unds: hahahaha
mercutio: if you sold it to your neighbours probably
brycec: But if it's given away freely?
Like a coffee-shop?
mercutio: no idea
coffee shops charge for internet here
brycec: Ah
mercutio: mcdonalds has free internet i hear
but i haven't been there
usually 3g is faster than cafe internet anyway :/
m0unds: user@goldenarches.net
mercutio: most are just adsl connections
with shit routerse
brycec: Ouch. I don't know about 3G, but LTE is certainly faster than every hotspot I've tried lately
m0unds: i don't know the last time i used public wifi somewhere
mercutio: where you have to put in some coupon code
which is annoying if you use a tablet
m0unds: at&t provides their own preconfigured gateway for most attwifi hotspots in restaurants and offices and stuff
don't remember what it is, but it handles the captiveportal and network registration stuff
-: brycec isn't surprised
m0unds: probably a lot easier for at&t and for businesses that offer free wifi branded by at&t
haha, can't wait for verizon to start marketing "XLTE" more
FOUR GEE EX EL TEE EE
***: z310 has joined #arpnetworks
m0unds: new belgium gruit is intresting - uses herbs instead of hops for bittering
junos upgrade funtiem