for an extra 500EUR/month one's BCIX port can also extend to AMS-IX those guys are really gettin' around ;) bcix? oh berlin? i think ams-ix is the biggest exchange in the world? bigger than linx. That's what she said!! http://en.wikipedia.org/wiki/List_of_Internet_exchange_points_by_size List of Internet exchange points by size :: This is a list of Internet Exchange Points by size, measured by peak data rate (throughput), with additional data on location, establishment and average throughput. Generally only exchanges with more than ten gigabits per second throughput have been taken into consideration. The numbers in the list represent switched traffic only (no private interconnects) and are rounded to whole gigabits. Take into c how do you define size? :) it looks like de-cix is about the same size That's what she said!! and linx isn't as far behind as i thought it was equnix has mor emembers but lower bandwidth going through it also counting by members is only directly attached there's quite a few people on all of them not directly attached but still advertised. and like it's preferable to be advertised on linx as well as ams-ix if on ams-ix from non europe personally i don't think being on ams-ix would give a huge advantage probably more benefit from level3 being advertised when it is, as level3's got some pretty good europe connectivity mercutio: no they never sent an rfo actually up_the_irons: ahh ok well it looks like looking glass has been working out ok up_the_irons: You Should be at LINX instead of AMS-IX, then I could peer with you directly :) i imagine it's harder to get onto linx. plett: :) but i still think that if being on ams-ix should also be on linx. which means probably doing niether haha it's easy to see the sense in peering locally. mercutio: Shouldn't be any harder. Both have a set of L2 resellers who will resell connections https://www.linx.net/join/linxanywhere.html but peering remotely gets complicated quick, with traffic taking funky routes. Yeah, remote peering probably doesn't make sense for most networks it's all going over the internet anyway... ;) not like there's a secret tunnel from ams to lax that will somehow make things *that* much faster plett: basically if you do it, you want to start doing it in like 4 or 5 places. sure, traceroutes will be shorter, but that probably don't really fool anyone that actually cares he.net got really screwed up when new york had flooding. so having "better" providers can help... thing is that was once, ages ago. and it wasn't down, just extremelly lossy/congested. who are GT? GTT? that's level3 isnt' it? oh, nlayer. mercutio: I work for a .uk based network and we don't have any network outside of the country. We peer at the two london IXPs, LINX and LONAP but no others. We've looked into L2 relaying to get to AMS-IX and DE-CIX but it doesn't make sense from either a commercial or network point of view plett: isn't dsl terrible there anyway? We try to make it not horrible :) and there's like one cable provdier that you probably have to pay to send stuff to i have a friend who used to live in UK peak time congestion, adsl1.. Yeah. All the regional cable networks got bought out and now operate under the Virgin Media brand (which is owned by Libery Global, who I believe do some US cable too?) it seemed surprising to me. you'd think he lived rural or something. but he lived in cambridge. and he refused to deal with virgin, because he couldn't get them to stop harassing him about the previous owner of house. and wouldn't deal with him because he wasn't account holder. Hah. You say that. Cambridge is a surprisingly small place, and remarkably out of the way of anywhere people would want to run cables oh. i thought it was a fancy tech town i don't know much about the uk tbh It has a university which does fancy tech stuff, and therefore has many small companies nearby who do tech stuff, but not much in terms of network infrastructure it seemed to be like what new zealand was like when we had ATM backhaul. surprisingly new zealand seems to be getting some gigabit fibre now. but there's very little local content. And yes, all the copper phone lines in the UK are run by British Telecom (BT) which is the company formed in the 1980s when the phone network was privatised. he moved to the US, and now has congestion issues again. BT are actually being fairly good at rolling out new technology. 80Mb/s VDSL2 is now available to something like 2/3rds of the population, with the majority of the rest getting 24Mb/s ADSL2+ but much faster burst speed. oh nice. yeah that's not bad. There are still some places which can only get 8Mb ADSL1, but that ADSL1 network has effectively 100% coverage i think vdsl is good enough for most people atm tbh 1 megabit upload on adsl kind of sucks for skype video and uploading photos and stuff. They also have a GPON fibre-to-the-premises product which can go up to 300Mb/s. That is technically available anywhere you can get VDSL2, but at an extortionate cost. There are a small number of places which have it instead of VDSL, and it costs normal broadband prices there ahh cool. There is also a trial of G.Fast coming soon, which will in theory give 100Mb/s over copper, basically by moving the DSLAM to the top of the pole in the street or under a manhole cover i reckon fast copper is the way to go atm tbh it's just so much cheaper/easier. Only because it's already there i mean i know fibre is technically better. but it's expensive to instal. true. i suppose it's a question of when not if. and whether now is a good time to dig up roads etc. new zealand's moving to fibre. Not really any more expensive than copper. Yes, you need a fancy cleaving/fusing tool to put the connectors on the end, but installation engineers already carry ££££ of test gear in their vans with speeds of 30/10 or 100/50 but some people are doing fancy plans now already of like 1000/20 and 200/20 the upload speed sucking. Yeah. Even on the fibre-to-the-prem, it's a maximum of 330/30 VDSL is 80/20 or 40/10 here So yeah, all sucky upload speeds the upload speed sucking seems kind of random i think it's so they can charge more for businesses. it's 100/50 on 4g. There are good technical reasons why it's done like it is But it does suck for people who do want good upload speeds On copper you have a maximum frequency which the line can cope with, and you split it up so some frequencies are for upload and some for download. Most people want more download, so that gets way more frequencies allocated to it yeah but on fibre plans gpon can't handle as much upload but it can handle 2:1 or something ratios fine. And it's tricky to do different things for different lines because they will crosstalk with each other. So if the exchange is pumping out lots of power on a frequency for one line, it can't also be listening on that frequency on the next line because all it would hear is itself yeah i know why it's the way it is on dsl adsl annex m improves over adsl2+ and vdsl is basically fine. but i mean why have 1000/20 fibre :) GPON is a little bit different. I don't know how they do it in other countries, but here, it's a single fibre at 2.5Gb/s back to the exchange from the GPON node Each GPON node handles (I think) 48 end user fibre lines, and they are purely passively split and everyone receives everything And they then use TDM to timeslice the upload and download channels so everyone gets a share it can balance stuff so each user gets a fair share Assuming a full GPON node with all 48 lines used, each user would get 52Mb/s to play with (2500/48) yeah i don't think they usually run them anywhere near full They don't here, because the takeup levels are very low due to the price and i think it's like cable in that it's shared frequencys or whatever, but you can oversubscribe It's only a single frequency in GPON (well, two, one for up and one for down) and then TDM timeslicing so everyone can use it it's about twice the cost of naked adsl to get 1000/20 fibre here in areas that support it i think for wholesale cost. maybe a bit less. it's not outlandish though i think the timeslicing can be dynamic i'm not sure how it works though Yes, it can by dynamic If it notices that one node always uses its timeslots for sending data when another node doesn't, it can allocate that one more timeslices on the fly And download, every node receives every packet and looks at the headers to see what's for it, so the head end in the exchange can decide who gets more or less bandwidth cool. The real problem is backhaul costs for wholesale lines. As it's all run by BT, an ISP buying wholesale access has to either have a presence at every exchange or buy backhaul from BT and backhaul costs heaps i imagine A small ISP like us can't afford to have a presence at the many hundreds of exchanges, so has to buy backhaul can you do a buying partnership? It ends up costing about £50 per Mb/s on 95%ile billing after all the billing tricks and incentive rebates etc (which is crazy, when I can buy internet transit for £1 per Mb/s when buying in quanties of 1Gb/s) or collective. wow Yeah so you don't want users doing more than like 60gb/month? is there usage based pricing for users? That depends on the ISP, different companies manage it in different ways We do usage based charging, yes ahh Others do an "unlimited" service and rely on network congestion to limit their users throughput how much does it cost to do your own backhaul? i imagine you can't really allocate each unlimited user a megabit of bandwidth at that kind of costing. i probably do over 1 megabit 95th pernctile at home but it's hard to know actually i might not Not too much for the backhaul itself from exchanges, they are well cabled places after all i dunno if i stream movies more than 5% of month or not :) The real costs are in having a presence at the exchange, a bank of DSL linecards and people on call to go and swap kit out oh i thought this was for fibre The last time I looked, the average per-user allocation in the UK was something like 100Kb/s your own dslams seems silly idea but having cheaper backhaul sounds smart Yes. If we were starting to PoP exchanges now, we'd ignore the copper completely and just buy fibre we used to have 48kbit per user average allocation enforced here or something like that it went up a bit but it meant there was packet loss in peak hours freuqently. and that seemed to be what my friend had :) Then the only kit we need in the exchange is an ethernet switch to take 1Gb/s LX fibres from BT, and aggregate lots of vlans back to us yeah sounds sensible. but you have to do that per exchange not even per city? Depends and an exchange is like 5000 people? For fibre, they've been quite clever, and lots of the small exchanges don't have their own fibre nodes at all, they all backhaul to a regional "mega-exchange" oh that's good So it's not every exchange that you need to get to There's something like 5600 exchanges in the UK. Population density is nowhere near even though, so fibre only covers about 500 exchanges but covers 2/3rd of the population ahh ok still, 500 exchanges is a lot to run fibre to Of those 500 exchanges, you'd probably need a presence at maybe 300 to take fibre everywhere Yes. There's only 20 people in my whole company. I don't want to have to manage kit in that many places all over the UK :) yeah. so it makes sense to band together for smaller providers. Yes and no. On the retail side, we're all competitors of each other yeah. It would be like Ford and Honda sharing a factory to save costs but when it's giving money to bt.. not really. it's like ford and honda lobbying together to reduce petrol taxes. True because they don't want to invest in making electric cars. Hah lots of the smaller isp's here have reasonably friendly relations. I've got to run, I've got to paint a wall and like lobbyed for cheaped adsl tail costs and so forth. ok laters. rwhy oh why won't they let me get an IPv6 block, and an AS for my house?! jpalmer: I've got an IPv4 /24 and AS for my house. I haven't bothered applying for the IPv6 yet though. jpalmer: they will! you just have to multihome your house That's what she said!! pyvpx: actually you don't have to multihome anymore to get a /24 new ARIN policy - https://www.arin.net/policy/proposals/2014_13.html true. but a /22 is way cooler ;p staticsafe: rly where can i apply i am using almost a full /24 and i would like to consolidate hazardous: policy is already in effect you need an ARIN account and a ORG how much is it? hazardous: $500 hmm, I'd pay $500, for some IPv6 plett: my understanding is if you have an active IPv4 space through ARIN, they'll give you IPv6 for no charge. jpalmer: I'm in RIPE region. Here, end-user allocations direct from RIPE are EUR50 per year. An IPv4 block, and IPv6 block and an AS number each count as separate resources and are each chargable And since I already get a /48 of IPv6 space from my ISP and I'm not really multihoming, I don't have a need to get v6 in my own name can new ORGs in RIPE get v4 space anymore? Not end user ORGs, no. If you become an LIR then you get a whopping /22 to provide to your end users. Being an LIR costs something like EUR1300/year ah I got my v4 a couple of years ago before they stopped giving them out im going through the process with ARIN right now, its slow going a /48 is heaps for personal use. Anybody seeing Level3 issues? I can't reach wolfman.devio.us over IPv4, stops shortly into Level3, but others are still connected (presumably different transit) and the IPv6 HE tunnel on that host is still up and working. (For those curious, ARP -> that host mtr's http://sprunge.us/dgbW) trace from Toronto times out in Miami he.net land mnathani: For ipv4? Weird... Thought HE was tunnel traffic and some transit. This long-running mtr shows some very fucked-up routing since I started it weeks ago http://sprunge.us/XeWj up_the_irons: Any ETA on my newest VPS? brycec: can you traceroute out of that host? if you are still connected via v6