been a quite last couple days
quiet is good :)
Wild.
I've used CFEngine before.   puppet seems simpler from the quick look.
jpalmer: i'm gonna get you those docs soon :)
we compared chef and puppet for our needs.  looks like puppet won.
puppet is nice.. just now starting to migrate my manifests/modules to freebsd though
pjs: how's the migration going?
yeah, i'm also starting to use puppet on my vm hosts
I keep hearing about puppet. I wish there were a bsd licensed puppet alike.
up_the_irons, slowly.. didn't have as much time as I thought this past weekend.. kids soccer tourney's and mothers day killed it for me
up_the_irons, I'll get there shortly though
pjs: yeah, migrations are usually like that ;)
what does everyone think about rackspace forcing slicehost customers to migrate to their cloud, and effectively killing slicehost?
up_the_irons, from a business standpoint, it's silly imho, unless slicehost was losing dough
pjs: which i doubt
if i can make money at 1/3 their rates, they certainly should be making money ;)
although perhaps they have high overhead
up_the_irons: wonder how you could get your name infront of slicehost customers, they might just happen to be interested to find alternatives ;-)
toddf: dude i've been thinking about that for a week now
but i can't find a good way ;)
up_the_irons, easily.. facebook.. target everyone who has "liked" the slicehost page
up_the_irons, post the special in relevant geek forums.. buy ads on said forums
pjs: how so?  won't that get my FB account banned? :)
pjs: yeah true
up_the_irons: google ad campaign targeting searches of 'slicehost alternatives' or 'slicehost' etc? ;-)
up_the_irons, no :) of course not.. you pay for the ads :)
pjs: ah!
brb I can prob help
sweet
wow wow wow, look who is on top: http://www.webhostingtalk.com/forumdisplay.php?f=104
;)
I have been waiting like 9 months to get a sticky spot up there!
there are random hosting chat sites that surely will have people complaining of slicehost going away, I'm sure a lot of us would be glad to post happy thoughts of a great alternative, not sure if a custom url viewable in our control panel for gathering referral bonuses would exactly be fair to you, but something similar would certainly incentivize those with free time to help you contact slicehost customers ;-)
yeah i might be able to cook up something like that
I guess that's a blurry line between that and reselling but anyway.
arpnet have 64bit freebsd or just 32bit?
ok sorry, got a call
up_the_irons, so yea, I actually do a lot of internet marketing.. though not related to the IT/Hosting vertical, but still, it's all the same
subq: default is 64bit, but you can install 32bit if you want
would love to see some i/o tests on fbsd boxes, perhaps i will start moving all my freebsd stuff to you guys :)
not sure how confident i am in KVM yet though
subq: i am pretty sure you would be surprised with how snappy it is.  regarding stability, i have some customers here with over 500 days of uptime
i run a lot of freebsd dedicated servers and some linux VMs...but some of the fbsd machines dont really require dedicated, would be nice to put them on VMs
its great to start seeing that available
awesome, are there some i/o tests somewhere ppl post?
subq: for freebsd machines not requiring dedicated hardware, that's pretty much why i'm here :)
many times i have to fire up servers for nginx, php-fpm, mysql...pretty much just websites, and i hate hate hate having to put them on linux
subq: grab a freebsd VM from me, if you're not completely satisfied, i'll refund all your money; that's how confident i am it'll fit your needs
do you have image backups available, btw?
even at added cost
no image backups available yet, sorry (been wanting to add that feature for a while, but LVM snapshots affect performance of the VM a lot)
i may have to test one out then as soon as i get some time where i can acctually do testing :)
up_the_irons, yea, that's one thing I'd really like too.. some sort of automated backup running weekly or something.. probably the only thing about rackspace I'll miss (well that and their iPhone/iPad apps, that I've never had to use but they are useful)
i have some stuff on rackspace because software required ubuntu bleh
subq: if you are doing FreeBSD,    create your own snapshots,  and use bacula to back them up.
rackspace backups are very nice, no included bandwidth huge pain though
jpalmer: or i can just rsync stuff, but image backups are really nice for VMs
can fire up new instances, point to the image backup as the source and boom
subq: bacula can do images, too.
i havent used it i dont think, all my manual stuff is just old style rsync :)
the problem with images are:  they are quite large.  so suddeny most of your alloted bandwidth each month,  is in backup transfers
pjs: send me some info about your internet marketing services (if you're not too busy), i may have work for you :)
well rackspace doesnt charge you for image backups...but like i said, their are plenty of other "cons"
I personally backup the configs and data.  should I have a failure,  I'll reload the OS,   reinstall the software,  then restore the configs and data.
subq: rackspace backups aren't all they are cracked up to be.  I promise you.   the last company I worked for lost 7 YEARS worth of email,   due to faulty rackspace backups.
jpalmer: i have a bunch of servers with them, pretty familiar with the backups, in fact, had to use one this past week
they apparently lost 2 drives in an array, and took like 18 hours to get the data recovered
i had a mail server down and couldnt wait 18 hours, so fired up a new VM using the daily backup image, and only had to change the IP in dns to get back up and running
their notification was horrid mind you
up_the_irons, what's your email? I don't really do much direct consulting anymore but I'd be happy to help you out with some time/knowledge. We'll work something out
subq: we paid almost $400/month for backups with rackspace.   when we needed them,   they failed.      They refunded all the money we'd paid over the years FOR backups,  but a fat lot of good that did.  the data was gone.
always i know when their stuff is down before i ever even get a notice
jpalmer: nasty
a refund in that case doesnt mean a whole lot
where is arpnetworks located?
indeed.  the company went out of business about 8 months later.  pissed off customers,  lost deals.. etc.
subq: LA
pjs: cool thanks, i just pm'd you my email
just told a friend about them for hosting freebsd stuff and he said there are where he is :)
subq, Iw as just complaining about that the other day.. Im usually notifying rackspace about network/server issues effecting my service
up_the_irons, got it ;)
:)
pjs: yeah, it's kind of a joke isn't it?
rackspace support has gone steadily downhill over the past few years.  you couldn't pay ME to host with them.
honestly, true backups should be with _another_ provider ;)
otherwise, your eggs are still in the same basket
i was down like 2 hours and never got a notice (from them)...my monitoring stuff notified me of course
subq, yea. only it's not so funny of a joke when my paying clients are being effected :)
arpnetworks in coresite?
subq: yup
nice, my buddy may be doing some business with you heh, they have a data center there too
subq: sweet
he is network admin for activision heh
but we do a lot of personal stuff with fbsd
subq: whoa really??  then maybe i've seen him, i'm in the same suite as activision, just a few cages over
how funny
homeward bound.  back in an hour.
jpalmer: that rackspace backup thing sounds like a pretty good racket
maybe they don't expect any of the backups to work at all
kind of like insurance
at least with insurance they're suppoed to have funds on standby incase you need them.
"Will Slicehost support IPv6?
No."
i can't believe they don't support IPv6
it's laughable
slicehost is pretty much gone I thought
rackspace "doing away" with it
subq: it is not going away in 2 seconds, customers will be unhappy with forced migration to the cloud for months to come
i always thought slicehost was too high priced anyway
used linode instead
kind of ready to move some stuff off linode though
the i/o has been pretty terrible
the only time io is not snappy at arp is when multiple customers are hitting io hard. nighly cronjobs have been staggered, all is well with the service now. ;-) it's raid10 hardware with non overallocated disk, cpu, mem ... can't make a vps go faster if you tried, IMHO
yeah, ive been testing linode i/o at diff times throughout the day and seeing really low numbers 30s maybe 40s
rackspace which isnt the best imo I pretty much always see triple digits
do you do a dd or what is your 'test'?
have some other "budget" VMs where im seeing 80s
yeah just dd
not doing ioperf or anything :)
what exact cmdline? 80kb/s or what? time by itself is not a benchmark ya know
let me see what exact command im running
dd if=/dev/zero of=test bs=64k count=16k conv=fdatasync
of course that wont work on fbsd, but I dont have any fbsd that isnt dedicated servers (YET) :)
you're writing 1gb for a test?
yeah
roughly
its a little more than 1gb
with 100mb...
$ dd if=/dev/zero of=test bs=1m count=100
100+0 records in
100+0 records out
104857600 bytes transferred in 2.303 secs (45514766 bytes/sec)
(on OpenBSD)
at arp
linode = 1073741824 bytes (1.1 GB) copied, 22.3257 s, 48.1 MB/s
a low cost vps i use = 1073741824 bytes (1.1 GB) copied, 6.36657 s, 169 MB/s
well, you may also wish to consider speed != random io access speed, raid and scsi tends to outperform sata and non raid
rackspace = 1073741824 bytes (1.1 GB) copied, 4.3882 s, 245 MB/s
even if speed benchmarks are not the same
it's nothing more than a rough idea
but it's ok for that
;-)
super low numbers not great, super high numbers better
no
that wouldnt be very nice
i think linode may even flag you after certain amount of io :)
;-)
hmm, need to figure out how to send a break over serial console. wonder if that's possible with '-serial tcp...' and kvm
up_the_irons: ha, well it looks like that other provider I talked about, buckled to pressure and is now doing free /64's :)
G: LOL, good
which I guess is 2^64 times better than a /128
yeah
up_the_irons: saw your reply, I'll send it in next time I'm booted into Fedora or Ubuntu
which'll be after I get round to watching the last 30 minutes of this blu-ray :)
G: roger :)
up_the_irons, so back to my setup. I was thinking I still do need a /28 because I need 5 public facing IP's, to be served from 2 VM's, but the 3 internal VM's will still need to be on the network to be able to go out and pull data from the internet.. unless I do some NAT'ing, which I don't really want to.
pjs: i can accommodate a /28
up_the_irons, ok cool. I just wanted to make sure that wasn't an issue for you
pjs: since you're getting at least 2 VMs
and it's still just the $5/mo? since those are the extra's allocated as each VM instance will automatically be given an IP anyways, right?
up_the_irons, what's the process to order my additional VM's?
pjs: a /28 is $13 per month (13 usable IPs, $1 per IP)
pjs: place a regular order, put in comments which IP we should assign to the new VM
(from your /28, obviously)
cool
up_the_irons, so can you up my /29 to a /28 so I can start requesting my VM's
pjs: sure, pm me your vps uuid
k, one second
How are those freebsd beta accounts going? :)
eyecue: man, i should remove that from the site, we haven't had those in ages
;(~
i was about to start playing with freebsd vm stuff :D
up_the_irons: okay, going to order that second VM now :)
G: ok
So what do people like for 10GbE hardware these days?
Assuming Cisco's pricing is making your eyes water.
it was so much fun knowing a cisco account rep back in the days
they had/have a warehouse of close to eol gear :]
or eos
up_the_irons; i saw obfuscurities tweet last night and took a gander at the site :)
nice... and then you find out the last version of IOS for that device doesn't support ssh.
Yamazaki-kun: We use nexus switches at work.
We're also getting a couple of 3750X's to go into our stack in the DC.
eyecue: cool
on the 65xx chassis Cisco will sell me a 16-port line card for slightly less than, say, Force10 charges for a whole 64-port switch.
up_the_irons; is there a page on the provisioning process for bsd boxens ?
oh, and then that'll be $EVEN_MORE for all the GBICs-or-whatever-they're-called
Which are conveniently different form factors depending on whether your line card is 4- or 16-port.
youre probably aware that colin from the bsd project has gotten freebsd ec2 ami's going and running well lately, id love to start tinkering
It's almost as bad as toner cartridges.
Yamazaki-kun: SFP+
No, the bigger ones.
SFP+ would be fine because then you can just use a Direct Attach cable.
Oh, XFP slots?
yeah, those.
fail.  Our nexuses and 3750X's use SFP+'s.
yeah
The DAC's coming out the back of the nexuses are evil.
http://www.cisco.com/en/US/docs/switches/lan/catalyst6500/hardware/Module_Installation/Mod_Install_Guide/02ethern.html#wp1041355 would imply that if you want SFP+ you need a brand new chassis.
Yay
Well of course you need a new chassis.  The line cards aren't expensive enough.
On the topic of gear, anyone know of an ASA-type box that can do layer-3 ACLs at 10GE?
s/10GE/wirespeed on 10GE/
The new ASA's can do 10GE and they can do layer 3 ACLs, but we doubt their ability to both simultaneously.
Last time I looked at the ASA line, their ability to process traffic without a thermal excursion was in doubt.
But maybe they actually have some effective cooling now.
eyecue: yeah i heard about freebsd running on ec2
Still very beta.
alpha even.
eyecue: not sure what you mean by the provisioning process.  you get a stock freebsd box, that's really it :)
up_the_irons; oh ok, so freebsd is installed manually for your guys/you, rather than spun up by me via a control panel or widget of some description?
eyecue: yes
up_the_irons; i know that the ec2 images boot their kernels off a proprietary amazon data store somewhere, and generate a new pub/prv key pair via amazons api, so end up 'on the network' with ssh accessible
up_the_irons; ahh :D
coolio
up_the_irons: does this mean I can put .1.2 on my current VPS' eth0 and go from there?
G: yup
up_the_irons: fyi, the second VPS isn't appearing on console.cust....
eyecue: to clarify,   a default image is installed for you.   You have the option of re-installing it via VNC.
understood jp, ta :)
ah ha! worked out why IPv6 wasn't working on the new VPS...
invalid gateway for IPv4
up_the_irons: just throwing that out there
G: why would IPv4 have any interaction for IPv6?
and jpalmer: there's also the serial console option as well, some of us actually prefer that...
toddf: I think Debian was parse the interfaces file top to bottom
so an error in the IPv4 config, caused the IPv6 config not to be read, or something crazy like that
bleh heh
the sad thing is, it's about the 5th time I've had the issue, but it always takes me ages to notice it
pilgrimd: haha yeah :)
toddf: but pretty crazy eh?
G: one of those 'too much output on bootup to notice' grumblings I always have about loonix
toddf: oh thats the best bit... nothing in syslog to indicate anything is wrong :)
no "You've made a boo-boo in your config file and it doesn't make sense" either when you try to ifdown/ifup the interface either, just vague errors
At least it's not in XML.
pilgrimd: very true :)