Webhostbudd_: yeah i think that is my final decision, duplicity up_the_irons: sounds pretty nice brycec: what is required on the server end for sshfs to work? i don't recall... most likely just sftp perhaps actually, just sftp which you would probably use anyway for duplicity right? i suppose, whatever is easiest yea up_the_irons: Yeah, just sftp as Webhostbudd_ said. I think it's a good idea to include it for those that are intimidated by duplicity and just want to copy files, maybe tar 'em up, etc. (And don't want to, or don't have the disk space to store and forward) they shouldn't have to store and forward with ssh though Webhostbudd_: What I meant is that if they're just tarring files up, they'd need N diskspace free, before they could scp it over. And yes, users can always just scp/sftp files over too well Some users just like to have a directory they can use i was assuming they would pipe to ssh (Side-node: I just remembered that sshfs still stores somewhere locally, temporarily) yea Webhostbudd_: You're assuming all of up_the_irons' customers know how to do these sorts of things :P yea well, it's still simple so if people don't take duplicity at least they can tar and send it over ssh brycec: Webhostbudd_ : i would imagine if you know how to set up sshfs, you would have the knowledge for duplicity too. with sshfs, i wonder what would stop someone from just serving files directly off it, instead of buying "regular" disk space. perhaps i shouldn't care.. if they buy the space, let 'em use it however i imagine the overhead of ssh would kinda suck not so much as you'd think especially with fs caching and such nfi if it keeps connections open, though, so maybe that's not an issue sshfs to a remote filestore means overhead of xfering from slower storage freedaemonconsulting.com is served off my vps at arpnetworks with afs caching from an IPv6 tunnel to hit v4 afs servers my home with caching you can make any 'remote' storage acceptable to one degree or another I use sshfs to mount my home computer from work to play mp3s. I've not tried doing anything heavier with it up_the_irons: I see the point you're making... But then again, "how do I sshfs" is answered with "sshfs user@host:/dir localdir/"... To me, still simpler than understanding duplicity. I run clonezilla images over sshfs when I'm lazy/not using the nas brycec: well, wow, i didn't realize it was even that easy ;) the last time i used sshfs, you had to recompile something, lol... heh apt-get install sshfs brycec: i'm 33 heh - meant it as a joke, re: "last time I used sshfs" but thanks for the openness lol it was probably 5 years ago or so that i used it... toddf: I remain astounded at the complexity in your v6/v4 tunneling. It's probably not "all that complicated" but still wows me truly, if you think as if the world is only v6, and that v4 is but an island between v6 hosts, its pretty simple (mostly the v4->v6->back to v4 that amazes me) no it is native v6 at arpnetworks to v6 tunneled through v4 via he.net at home TWIST: The world is really ipv4, and toddf's ipv6 is tunneled :P oh wow, you spoiled my twist so that's v4 inside v6 inside v4 I did it initially because I was afraid I'd over-ride my v4 bandwidth cap and such. given he.net is prone to random maintenance and I don't have time to provision a 2nd tunnel at home and native v6 is not happening in OKC just yet from COX I should probably revert to v4 .. Well I can see how that would be configured, logically... I just can't imagine the actualy configuration thereof. I'll just stick with v6-v6(tunneled) odd, just tried sshfs on my n900, it works, I can even set /dev/fuse to be owned by my 'todd' user, and mount stuff that way, but only root can browse the mounted filesystems $ ls -ld /mnt ls: cannot access /mnt: Permission denied $ sudo ls -ld /mnt drwxr-xr-x 1 root root 512 Sep 23 00:56 /mnt need to pass a weird mount option something? reading the man page just incase, would expect std unix perms to apply though perhaps running sshfs inside a chroot is effecting the result, but still, root seems able to do its thing just fine toddf: who mounted it? root? (i.e. who ran sshfs) I tried it as root, then I changed /dev/fuse to 'todd' and ran sshfs as 'todd', both mounts succeeded, in both cases, only root could browse toddf: uid mapping? Does your local $user map (uid) to the remote user? explain why that would matter? regardless of uid mapping, any user should be able to 'ls' a dir with '755' perms (fuse does have -o allow_other and allow_root but those don't seem to apply here) actually, adding -o allow_other seems to have fixed it interesting heh, okay great scary persistent v6 based sshfs from my phone to my servers at home will have to think about this one for a bit toddf: lol.. now you can stream music actually I'm archiving photos/videos from the phone now ;-) streaming music would be a dsitraction plus a waste of my battery life .. *grin* hah i c channel poll: someone submitted a feature request that goes like this -- within the Portal or console server, have a button to press that would initiate: 1. snapshot your VM on the host machine 2. Transfer that snapshot to your backup space who else would like something like this? i would be concerned about performance on the host, but i suppose i could always ionice it. and if two or more requests come in at the same time, just queue 'em... yea queuing seems logical in this case yeah that'd be cool :) i have a +2 hahaha, i am texting fyodor's girlfriend. that is all. =) uhoh up_the_irons: that's a neat feature. I would probably use it, if it existed. A queue would definitely be needed. Question being: Would it save to a fixed filename, overriding an existing snapshot (if you didn't move it out of the way first)? (I'm in support of this idea, probably just the machine's uuid Question 2: I wonder how restores would be handled brycec: conceivably, one would hit "restore" and the system would 1) grab .img.bz2 (or something) from the backup server, 2) uncompress on host 3) dd it over the existing volume in fact, with piping, bet that could all be done in one command ;) queue permitting would not even need space on the host yeah, so the queue would have to be in the right place one queue per VM host yes YES YES! this is starting to come together... it feels right up_the_irons: any concern about IO bottlenecking on the backup host? brycec: some. could probably be managed with proper queue and ionice. of course, many customers performing backups at any random time could be an issue it'll just have to be a fast box and the backup service grows could very easily HW RAID 10 the thing or a more complicated queue :p Oh hey, it *is* billing day afterall heh just got it me too up_the_irons any lick ueth ur js + ruby problem ? luck* *luck with your at least... I'm hoping you didn't mean "lick" Also, what js+ruby problem? According to my logs, up_the_irons last mentioned ruby in October shush i r drunk atm "shush" is for when you're hungover :p ok ok w/e it proper i guess :P brycec latest post on scie.nt.st oic http://scie.nti.st/2013/3/1/having-a-javascript-moment-with-ruby-wtf-is-going-on-here/ I was not familiar with scie.nti.st, thx np TIL up_the_irons has a blog its not new, just updated to octopress so up can blog again w/o worry (up_the_irons is going to start noticing some rss2email hits from his own subnet) nice domain I'm amused to see the various problems that have been discussed in #arpnetworks published there xD wow, quite the hiatus up_the_irons ;) 2009 to 2013 not that I have any room to talk... >.> same here, been online sine 96 but have nothing up to corroborate I blogged in highschool... it was just whiny crap I'm not proud of it... but pretty sure it's still up on LiveJournal :O LJ is old skewl now haha before that, I used OpenDiary. Don't think it's around anymore i do miss dogpile search over google, but alas google won out I don't At the time, dogpile > *, but since then Google has become clearly superior Oh no guys! Garry still has $37.45 to go http://scie.nti.st/2008/11/2/a-pledgie-for-pledgie i only likes dogpile cause it was a funny word to look as when searching thru the brower history @school HighJinx: i put in a comment, apparently float comparisons are always inexact. i will experiment with using BigDecimal instead. or hell, just comparing as strings ;) up_the_irons! aka the scientist! brycec: yes, indeed, i took a LONG break from blogging. Now that i converted it to Octopress, it is soooooo much easier to blog, and hence, will do so more often :) up_the_irons gotta remembe that JS likes !== and === instead of != and == cause in js world 1 == 0 sometimes not always but sometimes !? $# yea javascript is a fickle mistress sometimes but i still love her but that was ruby code it's ok cuz u r drunk ;) up_the_irons ur facebook thumbnail on fb for your scie.nti.st is a pledgie donate pic xD oh snap son if this is the last 5 ep of r;n it has a good start not gonna give anything u. you just have to watch it damn... its fuckinga awesome r;n? whoopsy wrong channel robitics;notes its and anime think you can find it on hulu if ur in the us lol definitely wrong channel