I'm having some funky IO issues on my VPS, anyone else?
Update: I wasn't before, but now I am.
Took me a minute to SSH in.
Maybe something going on with the ceph cluster?
My loadavg is unusually high, seems to stem from time spent waiting on disk IO.
aka "me too"
Oct 04 08:13:47 vps3 kernel: sd 0:0:0:1: [sdb] tag#9 abort
:X
That's my disk from the spinning-rust Ceph pool...
why do I keep getting booted from the chan
Because your client isn't identifying to Nickserv before joining the channel, Guest54746 ?
but I do have it set to identify
It keeps renaming me
heh, likely because nickserv thinks your nick's in use somewhere on the network, you may have to ghost it to get it back
Anyway, IRC aside, let's get ceph back :)
Not seeing any more kernel disk errors at least, and services are slowly beginning to respond. Hooray
I'm seeing the same on my end
A failing disk was finally kicked out of the cluster
and the cluster is rebalancing...
the failed disk is in the SATA pool, so the SSD pool _shouldn't_ have been affected
(I only noticed it in the SATA pool, fwiw)
Roger that
How's things looking for others?
Cluster is almost completely rebalanced
(Rebalancing is magic)
(Also, don't let your datacenter hands/monkeys *not* label drives... I pulled 4 drives before I found the right ones. Thank goodness for rebalancing.)
Things seem to be back to normal-ish.
Of course, everything is labeled