#arpnetworks 2011-07-30,Sat

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)
WhoWhatWhen
***HighJinx has joined #arpnetworks
GTAXL has quit IRC (Ping timeout: 264 seconds) 		[01:15]
............. (idle for 1h2mn)
tigerpaw has quit IRC (Quit: purrr) [02:18]
................ (idle for 1h16mn)
toddf has quit IRC (Ping timeout: 255 seconds) [03:34]
DDevine has joined #arpnetworks [03:40]
.......... (idle for 45mn)
hien has joined #arpnetworks [04:25]
hien has quit IRC (Quit: leaving) [04:36]
................... (idle for 1h30mn)
toddf has joined #arpnetworks
ChanServ sets mode: +o toddf 		[06:06]
................................ (idle for 2h36mn)
koan_ is now known as koan [08:42]
DDevine has quit IRC (Ping timeout: 264 seconds)
Olipro has quit IRC (Remote host closed the connection)
Guest32912 has joined #arpnetworks
Guest32912 has quit IRC (Client Quit)
Olipro_ has joined #arpnetworks
Olipro_ is now known as Olipro 		[08:54]
....................................................... (idle for 4h33mn)
tigerpaw has joined #arpnetworks [13:36]
.... (idle for 16mn)
tigerpaw- has joined #arpnetworks
tigerpaw has quit IRC (Ping timeout: 276 seconds) 		[13:52]
...... (idle for 29mn)
nomadlogic has joined #arpnetworks [14:23]
.......................... (idle for 2h9mn)
tigerpaw- has quit IRC (Quit: rawr?)
tigerpaw has joined #arpnetworks
nomadlogic has quit IRC (Ping timeout: 264 seconds) 		[16:32]
..... (idle for 20mn)
nomadlogic has joined #arpnetworks [16:55]
................................. (idle for 2h44mn)
DDevine has joined #arpnetworks [19:39]
................ (idle for 1h15mn)
nomadlogic has quit IRC (Ping timeout: 264 seconds) [20:54]
...... (idle for 26mn)
ballen has joined #arpnetworks
ChanServ sets mode: +o ballen 		[21:20]
DDevine has quit IRC (Remote host closed the connection) [21:34]
....... (idle for 31mn)
DDevine has joined #arpnetworks [22:05]
DDevinehttp://www.xtranormal.com/watch/7023615/episode-2-all-the-cool-kids-use-ruby?page=2 [22:05]
mike-burnsheh. [22:06]
RandalSchwartzheh
it's true 		[22:07]
DDevineThought it would be appropriate here.
:p
oi up_the_irons I'll get the IP addresses sorted out within a few hours. 		[22:08]
ballenAnyone know of a distributed filesystem with ZFS-like compression? [22:12]
RandalSchwartzwhy not ZFS? [22:13]
ballenRandalSchwartz: I need a filesystem that can span multiple servers
i.e. Lustre, GPFS, etc 		[22:14]
RandalSchwartzzfs can export NFS [22:15]
ballenwell aware [22:15]
RandalSchwartzand so [22:15]
ballenNFS is actually somewhat of a slow protocol, plus until 4.1 becomes prevalent theres no way to solve a single name space issue, load balancing between storage servers
and so
I'm looking for something that'll take me to 500TB or so 		[22:16]
RandalSchwartzyou need to specify why you are disqualifying it [22:16]
ballenNo single name space between multiple machines
no automatic load balancing between servers
a chatty protocol, that wastes bandwidth 		[22:16]
RandalSchwartzso you're blindly prejudiced. ok. :) [22:17]
ballenprove to me that its not then :-) [22:17]
RandalSchwartzjust as long as we know. [22:17]
ballenI use NFS extensively right now for 200 or so TB of space
my main goal is to solve the single silo effect, of having multiple NFS servers 		[22:18]
DDevineDDevine hates that silo effect. [22:19]
ballenwhere inevitably one server will be filled more than another and require massive rebalancing
and I don't have the luxury of making the application layer take care of load balancing
Also RandalSchwartz, I'm not blind in anyway on this matter, unless you feel like backing up that statement 		[22:19]
DDevineballen: I don't know much this stuff, but why can't you just use 4.1? [22:28]
ballenlack of support
mainly on the Solaris side, which is odd since its their protocol
I'm trying to find a enterprise type solution, similar to Isilon, GPFS, that allows me to use compression. As my data gets a 2-3x compression ratio at GZIP-1. Also I have a few SuperMicro 36 drive servers, that are purpose built for ZFS RAIDZ
it of course doesn't have to be commercial, OSS is fine as well
just a couple of requirements that no one seems to have figured out
checking out MooseFS: http://www.moosefs.org/
[22:28]
DDevineYeah. [22:31]
ballenwhich may run on top of ZFS
I've also tried GlusterFS which seems to be a bit more popular, but fails to run on Sol11 		[22:31]
DDevineWhat sort of data are you working with? [22:32]
ballengenomic [22:32]
DDevineOCFS? [22:32]
ballenlooked at its docs
its a Linux only FS I believe
does anyone have enough experience with Btrfs to say thats its production ready? 		[22:32]
DDevineballen: Surely NFS would be quick enough for that purpose... You don't really need super quick response times right?
ballen: I don't have enough experience with BTRFS yet, but I haven't beeb bitten. 		[22:33]
ballenlatency isn't a huge issue no [22:34]
DDevineI think SLES11 had a "technology preview" of BTRFS.
But that would be a fairly old version now. 		[22:34]
ballenbut then I fall into, if I have 10 NFS servers with 42TB each, thats 10 silos of 42TBs
pNFS is promising 		[22:34]
DDevineYeah that sucks. [22:34]
ballento solve that
there was some work in OpenSolaris with it
but can't get anything out of Oracle as when they'll implement it 		[22:34]
DDevineIs there a real need for ZFS rather than just EXT? [22:35]
ballenSo let me describe how this hardware is setup
its 36 drives in a single 4U
2 for OS in a mirror
theres 5 SAS2 controllers
each with 2 SAS iPass connectors (i.e. 4 drives)
each controller gets 8 drives, 4 on the last
RAIDZ2 is setup then in 8 drive groups
across the controllers
so that if a controller was lost that filesystem would keep going
so if I moved to EXT3 or a classic FS, I'd have that to contend with
note that hardware design guarantees each drive full SAS2 bandwidth all the way through the PCIe bus
probably overkill
what inexpensive
but* 		[22:35]
DDevineYeah that is a little tricky... I think LVM could manage that though. [22:39]
ballenpossibly [22:39]
DDevineThe performance hit from LVM is fairly minimal. [22:39]
ballenplus I don't want to give up on-the-fly compression
otherwise I might as well just buy double the hardware 		[22:39]
DDevineYeah I've never done on the fly compression so I don't know what the go with it is.
double the hardware means double the problems and upkeep. 		[22:40]
ballenwell since my data is primary very large text files, they compress quite well
yep, plus double the space and power 		[22:40]
DDevineYeah excellent compression [22:41]
ballenbasically 2.5x avg
some datasets are a bit better in at 3.2x
so I've been researching, looking how to leverage ZFS as a storage backend
for a GlusterFS like setup
Ideally, Ceph is the option, but its much much to immature 		[22:41]
DDevineYeah on Linux you would have to use BTRFS or Reiser4. [22:43]
ballenRight [22:43]
DDevineReiser4 is mature though, not sure about support these days though. [22:44]
ballenI haven't used BTRFS + compression enough to know how it effects CPU load
or rather, how it effects throughput due to extra CPU load
Nor how good BTRFS' raid5/6 implementation is. 		[22:44]
DDevineYeah but you can just do the RAID stuff outside of the FS. [22:46]
ballenthats true [22:47]
DDevineI have the feeling my ISP doesn't respect DNS TTLs.
Which is odd because overall they have a great setup. 		[22:54]
ballenthat would be odd [22:57]
DDevineEh maybe it was just a temporary thing. Today they seem to have honored the TTLs perfectly. [22:59]
......... (idle for 42mn)
***nomadlogic has joined #arpnetworks
nerdd_ has quit IRC (Ping timeout: 240 seconds)
nerdd has joined #arpnetworks 		[23:41]
↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)