| ↑back Search ←Prev date Next date→ Show only urls | (Click on time to select a line by its url) |
| Who | What | When |
|---|---|---|
| whitefang | up_the_irons: is there still room on kvm14 to get my package upgraded at some point? I know, I should have just gone bigger when you said "take your time to decide"...
I don't need it done any time soon, but yeah, I'm having regrets :P | [00:00] |
| up_the_irons | whitefang: can't say right now. all these VMs are going onto kvr14, it will probably fill up the box
time to order more hardware.. yikes | [00:01] |
| whitefang | well, it would be +256MB RAM and +20GB disk space.
I'm not thinking major upgrade, as much as I'd like to throw down the money on 4GB of RAM all to me. you could just shave a few MB here and there off of everyone moving over to the machine and allocate it to me...I'd be OK with that. time to bounce for a bit, good luck with the damage contol up_the_irons. | [00:02] |
| up_the_irons | whitefang: thanks! | [00:10] |
| DDevine | up_the_irons: Are the servers branded or built from parts? | [00:17] |
| up_the_irons | DDevine: i build them, they are supermicro | [00:17] |
| DDevine | Ah no next day parts :S | [00:18] |
| up_the_irons | well, i *could* have got another raid controller fedex overnight, but i figure what is the use, the data is already corrupted | [00:19] |
| .... (idle for 18mn) | ||
| DDevine | Whole new box? How long has that one been in service? | [00:37] |
| .... (idle for 17mn) | ||
| *** | nakano_ is now known as nakano | [00:54] |
| G | DDevine: he said earlier, first one | [00:58] |
| DDevine | G: Sorry, I have been skipping around many channels and doing lots of little things so I miss a lot of the finer points. | [01:06] |
| up_the_irons | DDevine: mercury has been in service since 01-17-2009 | [01:09] |
| *** | schmir has joined #arpnetworks
nakano is now known as nakano_ | [01:15] |
| .... (idle for 16mn) | ||
| whitefang | don't you mean "had been"? sorry, too soon?
whitefang ducks. | [01:32] |
| *** | wwrl_home has joined #arpnetworks | [01:38] |
| schmir has quit IRC (Remote host closed the connection)
schmir has joined #arpnetworks | [01:44] | |
| up_the_irons | whitefang: oh man
kick me while i'm down why don't ya ;) | [01:56] |
| DDevine | Also, just got an interesting email from Amazon. They now do 5TB files and the Multipart upload can do some interesting stuff. http://fpaste.org/qM53/
You can stream the file into S3 as it is created. | [01:58] |
| up_the_irons | yeah i got that too | [02:01] |
| *** | Arendtsen has joined #arpnetworks | [02:06] |
| whitefang has quit IRC (Read error: Operation timed out)
Ehtyar has joined #arpnetworks | [02:18] | |
| ..... (idle for 21mn) | ||
| whitefang has joined #arpnetworks | [02:42] | |
| ........ (idle for 35mn) | ||
| _Ehtyar has joined #arpnetworks | [03:17] | |
| wwrl_home has quit IRC (Quit: leaving) | [03:24] | |
| Ehtyar has quit IRC (Remote host closed the connection) | [03:35] | |
| ...... (idle for 28mn) | ||
| ziyourenxiang has joined #arpnetworks | [04:03] | |
| .............. (idle for 1h7mn) | ||
| richardquisumbin has quit IRC (Ping timeout: 265 seconds) | [05:10] | |
| ....... (idle for 33mn) | ||
| mike-burns | I expect tarsnap sales to go up. | [05:43] |
| MuskyHusky | oh
RIP mercury | [05:43] |
| ....... (idle for 33mn) | ||
| *** | fink has joined #arpnetworks | [06:17] |
| DDevine | After resolving to actually think more logically about my problems and to be a bit more attentive to detail -- I got my new mail setup working.
The whole experience has been fairly enlightening. I hate mail systems, but I conquered this one. | [06:28] |
| .... (idle for 18mn) | ||
| *** | DDevine has quit IRC (Remote host closed the connection)
nerdd_ has joined #arpnetworks | [06:47] |
| MuskyHusky | im definitely setting up some sort of cronned rsync solution from this
i can't wait to setup my file server...wait whats stopping me? i have the free time....i dont know what distro i want to use | [06:49] |
| fink | freebsd! | [06:50] |
| *** | nerdd has quit IRC (Ping timeout: 276 seconds) | [06:51] |
| mike-burns | FreeBSD. | [06:53] |
| ziyourenxiang | 8.1!
zfs! | [06:53] |
| MuskyHusky | i already have freebsd computers out the yingyang ;p
i want to use linux this time ok maybe debian. | [06:54] |
| fink | meh | [06:55] |
| MuskyHusky | what im particularly interested in setting up is a lvm with 8 hard disks | [06:55] |
| amdprophet | I personally use FreeBSD with ZFS but I have a friend with Linux with BTRFS | [07:04] |
| MuskyHusky | zfs can do single partition across multiple disks? | [07:05] |
| amdprophet | yea | [07:05] |
| *** | ziyourenxiang has quit IRC (Quit: ziyourenxiang) | [07:05] |
| amdprophet | and has some really neat features like filesystem compresssion | [07:05] |
| MuskyHusky | oh cool
might have to check it out then. | [07:06] |
| fink | jbod | [07:07] |
| MuskyHusky | well they are mostly ide drives on different controlelrs | [07:08] |
| *** | ziyourenxiang has joined #arpnetworks | [07:17] |
| ...... (idle for 25mn) | ||
| ziyourenxiang has quit IRC (Quit: ziyourenxiang) | [07:42] | |
| ..... (idle for 23mn) | ||
| schmir has quit IRC (Ping timeout: 276 seconds) | [08:05] | |
| ...... (idle for 25mn) | ||
| jpalmer | whitefang: RAID is for business continuity in the event of a failure. backup is for data recovery in the event of a catastrophic event.
a *lot* of people make the mistake of thinking RAID = backup, when it's actually not. (it seems like you fall into this category, hence my mentioning this after the fact) | [08:30] |
| .... (idle for 15mn) | ||
| toddf | RAID is for some failures, oviously it is not foolproof ;-) | [08:46] |
| ..... (idle for 24mn) | ||
| *** | sentabi has joined #arpnetworks | [09:10] |
| ..... (idle for 21mn) | ||
| lucky has joined #arpnetworks | [09:31] | |
| lucky | Silly question. I have the (old) 768 MB / 20 GB / 200 GB for $20. I see a 768 / 20 GB disk / 400 GB for $20 now. Can I get that extra 200 GB? :)
or new customers only? | [09:35] |
| *** | nerdd_ is now known as nerdd | [09:40] |
| cubelogic has joined #arpnetworks | [09:49] | |
| .......... (idle for 45mn) | ||
| jpalmer | lucky: you can upgrade to the new bandwidth tier for a 1 time fee of $20, if interested, submit a support ticket with your UUID, and permission to charge the $20
lucky: it's $20 per VPS, just to be sure I'm clear. | [10:34] |
| nerdd | Does anybody know what to do, when freebsd-update tells me that it can't identify running kernel when I try upgrading from 7.2 to 8.1? | [10:37] |
| fink | jpalmer: what about upgrading RAM?
nerdd: do you have a custom kernel? | [10:37] |
| lucky | jpalmer, alright. thanks :) | [10:38] |
| jpalmer | fink: not sure the cost of RAM upgrades. I should probably find out. | [10:38] |
| nerdd | Nope, it's generic, and it's a clean setup (my vps was on mercury before the crash) | [10:38] |
| fink | jpalmer: i think i want that in hte next few months | [10:39] |
| ..... (idle for 21mn) | ||
| *** | vapor has quit IRC (Read error: Operation timed out) | [11:00] |
| .... (idle for 15mn) | ||
| up_the_irons | mike-burns: LOL, I should make a deal with tarsnap | [11:15] |
| *** | robotarmy has quit IRC (Remote host closed the connection) | [11:19] |
| ..... (idle for 21mn) | ||
| robotarmy has joined #arpnetworks | [11:40] | |
| robotarmy has quit IRC (Remote host closed the connection) | [11:54] | |
| whitefang | we all want more ramz! | [11:56] |
| *** | baklava has quit IRC (Ping timeout: 255 seconds) | [11:59] |
| baklava has joined #arpnetworks
baklava has quit IRC (Read error: Connection reset by peer) baklava has joined #arpnetworks | [12:05] | |
| bitslip | [12:13] | |
| *** | robotarmy has joined #arpnetworks | [12:17] |
| mattx86 | I was just looking back at tarsnap, and it looks pretty good
would you guys recommend them? | [12:17] |
| mike-burns | Yup. | [12:18] |
| up_the_irons | mike-burns: how easy is it to do a restore? | [12:19] |
| mike-burns | It has the same syntax as tar, approximately, so it's about that easy.
So, kinda easy. | [12:20] |
| mattx86 | I've never tried with tar, but can you extract one particular file with tarsnap archives? | [12:21] |
| *** | robotarmy has quit IRC (Remote host closed the connection) | [12:21] |
| mike-burns | Yes. I think.
To be honest I've only played with it and hope to never need to do a restore. | [12:21] |
| mattx86 | nice, looks like its possible; the general usage page shows them restoring two users' home directories | [12:25] |
| toddf | someone should make something more user friendly than venti from plan9port. there's a redundant block storage shrink-o-matic backup mechanism. it's achilles heel: no data ever gets deleted that is archived. *sigh*. epitome was to do that, but it's klunky, epitome2 was never released to the public nor finished, bleh.
backing up whole lvm partitions seems rather non-guaranteed in the consistency department. if there is serious desire for backups at arpnetworks it might be best to follow the (very good and useful) model at other hosting companies: provide a server (with no bandwidth penalty) to dump backups on for the vps customers .. | [12:25] |
| mattx86 | that's an interesting concept | [12:28] |
| toddf | maybe there should be some form of quota (lvm per vps for backups) .. or maybe even an iSCSI initiator ..
s/initiator/target/ | [12:28] |
| up_the_irons | toddf: i had issues with that and access control. in order to save owner/group/perms, you need root access on the backup server. so if everyone has root, what is to keep someone from grabbing other customers' data? | [12:29] |
| toddf | up_the_irons: chroot ftp/sftp access?
and why root on the backup server? that sounds like a poorly designed backup app in the security department | [12:29] |
| up_the_irons | toddf: if no root on backup server, everything is saved as the same user
UID's can't change so a restore is then useless might be ok for /home/foo, but not for like the root fs | [12:29] |
| toddf | are you talking rsync or what? I'm talking 'vps people create archive of their own desired flavor, I'd do gzip'ed dumps, randalshwartz would do zfs send/dumps, etc ..' | [12:30] |
| up_the_irons | toddf: rsync / tar
toddf: so each customer would get a 2nd vps for backup purposes? | [12:31] |
| toddf | tar = no problem, rsync .. I'm not the type that prefers that, then again my parents systems are rsnapshot'ed to my brother's systems *shrug*
up_the_irons: disk storage is all I'm theorizing about how to access it, is the question. do you setup 'backup.cust.arpnetworks.com' or do you setup 'backup-iscsitarget.cust.arpnetworks.com' or 'backup-ftp.cust.arpnetworks.com' or something similar? | [12:32] |
| up_the_irons | toddf: ah, so rsnapshot keeps metadata about the owner/group/perms and then restores them? | [12:33] |
| toddf | aka make the concept of backups a little more abstract than 'use rsync' | [12:33] |
| up_the_irons | and obviously tar keeps that data | [12:34] |
| toddf | I'm pretty sure rsnapshot is not going to do what you want I only mentioned it because I'm not a 'rsync for backups' fan, I'm a 'rsync for moving my pics of my kid around' fan .. yet my parents get their systems backed up by my brother via rsnapshot which is essentially rsync + subdirs + hardlinks
everybody has their idea of backups of course | [12:34] |
| up_the_irons | roger | [12:36] |
| toddf | mine centers around 'system needing backed up shovels data via some protocol in some format to some method of archive server for later retrieval' .. typically tar and dump + gzip/lzma/bz2 based .. | [12:36] |
| mike-burns | I check everything into git and backup my git repos. | [12:37] |
| toddf | now, being someone who had to re-install his vps this morning, I have to wonder if it'll effect your business model if you start offering an archive server for vps customers backups .. if I had to choose between $10/mo and no backups and $12/mo and backups, I'll do my own backups .. since my vps is primarily 'regurgitate info from other servers' (dns slave, mirrored http files, etc) .. the backup in my case is in my head. | [12:38] |
| mike-burns | I'd pick a backup plan. | [12:40] |
| toddf | obviously other users have other usage cases.
mike-burns: you'd consider `backup' a thing to add to your monthly bill? (like insurance, I guess?) | [12:41] |
| up_the_irons | i check things into git and don't backup my repos ;) given that git is distributed, there's always some computer that has it. i have 2 laptops and a gitosis server, so 3 copies right there already | [12:42] |
| mike-burns | I'd pay extra for someone else to handle backups in a completely transparent way.
Ah, I delete clones of repos constantly. | [12:42] |
| up_the_irons | ah
mike-burns: the "completely transparent" way is where I have trouble. I haven't found a cost effective solution. there are expensive iscsi master/slave solutions, but they are.. expensive ;) | [12:43] |
| toddf | mike-burns: with an operator account to your vps with accessto read your disks (aka do a dump) or backup the lvm on the host system directly? | [12:44] |
| mike-burns | Yeah, the "completely transparent" thing is the real issue here, and probably why it won't happen.
I mean that I don't want to notice that my system is being backed up (until I need it). I could tolerate an operator account, but anything more than that risks cutting into disk space. | [12:44] |
| toddf | iscsi can be inexpensive if you're not searching for `hardware' and `warranties' etc ..
http://pastebin.ca/2015847 | [12:45] |
| up_the_irons | toddf: backup the lvm on the host directly is pretty taxing on the host, and if the majority of customers select backups ,then performance will degrade fast | [12:46] |
| toddf | up_the_irons: definately... | [12:46] |
| up_the_irons | toddf: wow, what are all those volumes? :) | [12:47] |
| toddf | about the only way to do lvm backups is if you had some snazzy iscsi target that did snapshots of the blocks and then permitted a 2nd host to backup the snapshots, even then filesystem consistency would be an issue. I'd expect things to be more efficient and more useful to people if the native os tools in their vps were used to create backups from consistent data states and use that to restore with in a recovery effort.
the server name gives a big hint under my company I have 2 afs cells, one internal only (fries.net) and one publically accessable (freedaemon.com) since most of the data is infrequently accessed, and the local disk io hits 6mbit/s on the iscsi volumes that's pleanty fast enough when I'm normally not accessing the fileserver locally (1.5mbit/s max outbound at the office) | [12:47] |
| up_the_irons | i c | [12:54] |
| toddf | (and yes I'm using claudio@'s iscsid under openbsd for the initiator and netbsd's iscsi-target for the server also running on OpenBSD)
he had a good laugh at me when I said 'yes, it works with native v6 over ipsec over wifi from home to the office' | [12:54] |
| up_the_irons | lol | [12:57] |
| toddf | it's not meant for production, but it works well enough to put my data on it knowing that if any number of things go bump I'm rebooting afs4 and fsck'ing for 360s at least .. openbsd source trees and other re-downloadable stuff seems ok to put there | [12:57] |
| ...... (idle for 25mn) | ||
| jpalmer | what about a SAN mounted to each VPS (for an additional cost) all backups are done by user in their preferred style (rsync, dump/restore, tar, etc) and just saved to the SAN mount. | [13:22] |
| mike-burns | TBH, the issue with all of these is that they're on-site. | [13:23] |
| jpalmer | mike-burns: IMO, if a client wants offsite, they need to appropriate those resources themselves. | [13:24] |
| mike-burns | Sure, I can understand that. | [13:25] |
| *** | baklava has quit IRC (Ping timeout: 255 seconds) | [13:27] |
| jpalmer | up_the_irons: another vps I used a couple years ago, every vps had the option of installing a bacula agent, and the VPS provider ran a centralized backup bacula server.
it sounded like a lot of overhead on the providers part.. so it may not be suitable here. providing an iscsi target to be mounted in a VPS, and letting the client handle his own backups sounds a lot more.. maintainable. | [13:28] |
| *** | baklava has joined #arpnetworks
baklava has quit IRC (Changing host) baklava has joined #arpnetworks | [13:32] |
| toddf | maybe I should do more than just .. add it to my todo list .. netbsd's iscsi-target doesn't have config reload capabilities, you restart it to reload the config, and disconnect all clients in the process .. brutal! ;-) | [13:35] |
| *** | ww has quit IRC (Read error: Connection reset by peer) | [13:42] |
| .......... (idle for 48mn) | ||
| richardquisumbin has joined #arpnetworks
MuskyHusky is now known as knot knot is now known as sheath | [14:30] | |
| G has quit IRC (Ping timeout: 264 seconds) | [14:48] | |
| G has joined #arpnetworks | [14:54] | |
| ....... (idle for 32mn) | ||
| up_the_irons | yay, I just thought, the only good thing to come about mercury dying is that i can finally get rid of the LSI MegaRAID controller; i HATE its CLI. Gonna pop in a 3ware 9650-4LPML and be back in action | [15:26] |
| .... (idle for 18mn) | ||
| *** | sentabi has quit IRC (Quit: Leaving) | [15:44] |
| ........ (idle for 38mn) | ||
| jdoe | eh
3ware's cli sucks too. and their current firmware for that controller requires a newer version of the driver than is in a lot of current distro versions. ... which sucks, since you then have to remember to update your initrd with their driver copy or leave your machine unbootable :P | [16:22] |
| *** | nesta has joined #arpnetworks
robotarmy has joined #arpnetworks | [16:24] |
| robotarmy has quit IRC (Remote host closed the connection)
whir has joined #arpnetworks nesta has quit IRC (Ping timeout: 272 seconds) whir is now known as nesta | [16:31] | |
| up_the_irons | jdoe: i haven't found this to be the case, I always put on the latest firmware and it works no problem
jdoe: and the CLI is way better than LSI's. It's *simple* | [16:48] |
| jdoe | up_the_irons: I'm talking reasonably old at this point, ie centos | [16:48] |
| up_the_irons | i c | [16:48] |
| jdoe | are we talking about tw_cli? | [16:48] |
| up_the_irons | yeah | [16:48] |
| jdoe | I dunno about "simple" exactly, I always get lost trying to figure out which sub-section I want to be in | [16:49] |
| up_the_irons | ./tw_cli /c2 show
/c2/u0 show all | [16:49] |
| jdoe | /c0/p0 /c0/u... etc
yeah | [16:49] |
| up_the_irons | /c2/u0 show alarms
easy | [16:49] |
| jdoe | the, uh, sadder thing
is that I haven't figured out how to make the auto-scrub/disk check work properly. I give it a day to run on, but what happens it just runs *continuously* all day, looping. rather than one-shot. don't suppose you know what I'm doing wrong? :P | [16:49] |
| up_the_irons | not sure, i don't run the auto-verify | [16:53] |
| .......... (idle for 46mn) | ||
| jdoe | doh. | [17:39] |
| ...... (idle for 28mn) | ||
| mattx86 | hm.. I think I'm going to use duplicity + amazon S3 for backups
seems like a pretty solid choice | [18:07] |
| *** | nakano_ is now known as nakano | [18:12] |
| wwrl has quit IRC (Quit: leaving) | [18:17] | |
| ..... (idle for 24mn) | ||
| fink has quit IRC (Ping timeout: 255 seconds)
baklava has quit IRC (Ping timeout: 255 seconds) baklava has joined #arpnetworks | [18:41] | |
| cubelogic has quit IRC (Remote host closed the connection) | [18:49] | |
| ........ (idle for 35mn) | ||
| fink has joined #arpnetworks | [19:24] | |
| .... (idle for 18mn) | ||
| richardquisumbin | isn't 3ware an LSI company? | [19:42] |
| .... (idle for 17mn) | ||
| *** | nakano is now known as nakano_ | [19:59] |
| jdoe | they are now, yeah.
he's right though, 3ware-branded gear sucks less to deal with than LSI-branded gear :P | [19:59] |
| *** | lucky has quit IRC (Remote host closed the connection) | [20:13] |
| fink has quit IRC (Quit: fink)
baklava has quit IRC (Ping timeout: 255 seconds) | [20:22] | |
| baklava has joined #arpnetworks | [20:28] | |
| ........... (idle for 54mn) | ||
| lucky has joined #arpnetworks
boogeyman has quit IRC (Ping timeout: 240 seconds) lucky has quit IRC (Remote host closed the connection) lucky has joined #arpnetworks | [21:22] | |
| .... (idle for 19mn) | ||
| DDevine has joined #arpnetworks | [21:49] | |
| ..................... (idle for 1h40mn) | ||
| alcy has joined #arpnetworks | [23:29] | |
| Ehtyar has joined #arpnetworks | [23:34] | |
| __Ehtyar has joined #arpnetworks | [23:39] | |
| _Ehtyar has quit IRC (Remote host closed the connection) | [23:48] | |
| Ehtyar has quit IRC (Remote host closed the connection) | [23:58] | |
| ↑back Search ←Prev date Next date→ Show only urls | (Click on time to select a line by its url) |