#arpnetworks 2017-10-11,Wed

↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)
WhoWhatWhen
***hazardous has joined #arpnetworks [00:07]
...................................... (idle for 3h9mn)
MeltedLux has quit IRC (Quit: R.I.P) [03:16]
MeltedLux has joined #arpnetworks [03:21]
.......................... (idle for 2h9mn)
ziyourenxiang has joined #arpnetworks [05:30]
................... (idle for 1h30mn)
mkb has joined #arpnetworks [07:00]
....... (idle for 34mn)
qbit has quit IRC (Quit: WeeChat 1.9.1) [07:34]
...... (idle for 28mn)
qbit has joined #arpnetworks [08:02]
......................... (idle for 2h3mn)
ziyourenxiang has quit IRC (Ping timeout: 240 seconds) [10:05]
.... (idle for 19mn)
hive-mind has quit IRC (Ping timeout: 240 seconds)
hive-mind has joined #arpnetworks 		[10:24]
.... (idle for 16mn)
hive-mind has quit IRC (Ping timeout: 260 seconds)
hive-mind has joined #arpnetworks 		[10:43]
................................................................................................. (idle for 8h3mn)
mkb has quit IRC (Quit: leaving)
mkb has joined #arpnetworks 		[18:48]
............................ (idle for 2h16mn)
dj_goku has joined #arpnetworks
dj_goku has quit IRC (Changing host)
dj_goku has joined #arpnetworks 		[21:08]
...... (idle for 26mn)
hive-mind has quit IRC (Ping timeout: 248 seconds) [21:34]
.... (idle for 19mn)
hive-mind has joined #arpnetworks [21:53]
.... (idle for 15mn)
incin has quit IRC (Read error: Connection reset by peer)
incin has joined #arpnetworks 		[22:08]
milki has quit IRC (Ping timeout: 240 seconds) [22:19]
milki has joined #arpnetworks [22:27]
milki has quit IRC (Ping timeout: 255 seconds) [22:33]
.... (idle for 15mn)
IM_AWESOME1 has quit IRC (Remote host closed the connection)
CoBryceMatrixBo4 has quit IRC (Remote host closed the connection)
milki has joined #arpnetworks 		[22:48]
KILLALLHUMANS01sct04 / ceph cluster have a little bump? Oct 11 22:08:24 vps3 kernel: [12522051.816013] sd 0:0:0:0: [sda] abort
(And my Thunder instance has been tumbling downhill since then, having remounted to read-only, Postgres is unhappy, etc etc etc 		[22:59]
***brycec has quit IRC (Ping timeout: 246 seconds)
BryceBot has quit IRC (Ping timeout: 246 seconds)
BryceBot has joined #arpnetworks 		[23:13]
up_the_ironsKILLALLHUMANS01: had a couple reports of disk timeouts, so i'm looking into it [23:15]
KILLALLHUMANS01Thanks up_the_irons
I ended up hard-rebooting things
and am gradually getting back to normal, you should see brycec join shortly
btw this was the SSD-backed pool specifically
[23:15]
up_the_ironsKILLALLHUMANS01: but are you still seeing disk issues? [23:17]
KILLALLHUMANS01Not currently
KILLALLHUMANS01 is dealing with some rather unhappy database tables 		[23:18]
up_the_ironsOK [23:20]
KILLALLHUMANS01According to logs, the issue started at 22:10 and continued for a few minutes at least (when the system dropped to read-only mode and logging was useless) -- And anything logged after read-only is muddy at best since there was a lot of stuff just flapping [23:20]
up_the_ironsPST ? [23:21]
KILLALLHUMANS01"ARP Standard Time" :P yeah [23:22]
up_the_ironsLOL
OK 		[23:22]
***brycec has joined #arpnetworks [23:26]
brycecworks [23:26]
up_the_ironswhat works
brycec: ^ 		[23:28]
KILLALLHUMANS01my connection (except actually I was in the middle of typing "/join #arpnetworks" when Weechat rejoined the room on its own, so you just got the last 5 letters :P [23:30]
up_the_ironsI kicked out a particularly noisy and dying drive from our Ceph cluster a few moments ago. Not sure why it wasn't kicked out on its own, but I suspect those who had some blocks on that particular one may have got some timeouts too. [23:30]
brycecinteresting [23:30]
up_the_ironsI think so too [23:33]
↑back Search ←Prev date Next date→ Show only urls(Click on time to select a line by its url)