"Need to share a read-only directory with several large files (5G - 40G) across 20 machines. NFS too slow; recommendations?" http://twitter.com/#!/up_the_irons/status/56111622288191489
up_the_irons: what are the large files for?
G: OS image templates (the ones I create new VPS' from)
if they don't change that often, wouldn't rsyncing them be fine?
G: that's what i do now, but doing several 40G files across 20 servers now takes a LONG time ;)
 14:56 < dwc> "too slow" ... what exactly is "too slow"
1 MB/sec = too slow ;)
whtas the bottleneck?
on a gigabit network I take it?
yeah gigabit
14:58 < dwc> I get 30MB+/s over NFS here
something else has got to be the problem
but if 20 machines are accessing the files at the same time....
up_the_irons: sshfs? ;)
silly suggestion in a way I know, but heh
milki: roger
i'll try my nfs setup again then
15:01 < dwc> get a faster network, or use multicast
oo, multicast
G: the machines wouldn't be accessing the files at the same time
up_the_irons: to rollout files efficiently, I once wrote an rsync script that would go from the 1 src nfs server to N client systems, then those systems would in turn serve via rsync --server the files to N more client systems, etc .. taking into account network layout as preference but not hardcoded ..
toddf: LOL, i was actually thinking of something like that while brushing my teeth this morning ;)
wow - took forever to log in to my box today
there's a dirty joke in there, somewhere…