| ↑back Search ←Prev date Next date→ Show only urls | (Click on time to select a line by its url) |
| Who | What | When |
|---|---|---|
| *** | hazardous has joined #arpnetworks | [00:07] |
| ...................................... (idle for 3h9mn) | ||
| MeltedLux has quit IRC (Quit: R.I.P) | [03:16] | |
| MeltedLux has joined #arpnetworks | [03:21] | |
| .......................... (idle for 2h9mn) | ||
| ziyourenxiang has joined #arpnetworks | [05:30] | |
| ................... (idle for 1h30mn) | ||
| mkb has joined #arpnetworks | [07:00] | |
| ....... (idle for 34mn) | ||
| qbit has quit IRC (Quit: WeeChat 1.9.1) | [07:34] | |
| ...... (idle for 28mn) | ||
| qbit has joined #arpnetworks | [08:02] | |
| ......................... (idle for 2h3mn) | ||
| ziyourenxiang has quit IRC (Ping timeout: 240 seconds) | [10:05] | |
| .... (idle for 19mn) | ||
| hive-mind has quit IRC (Ping timeout: 240 seconds)
hive-mind has joined #arpnetworks | [10:24] | |
| .... (idle for 16mn) | ||
| hive-mind has quit IRC (Ping timeout: 260 seconds)
hive-mind has joined #arpnetworks | [10:43] | |
| ................................................................................................. (idle for 8h3mn) | ||
| mkb has quit IRC (Quit: leaving)
mkb has joined #arpnetworks | [18:48] | |
| ............................ (idle for 2h16mn) | ||
| dj_goku has joined #arpnetworks
dj_goku has quit IRC (Changing host) dj_goku has joined #arpnetworks | [21:08] | |
| ...... (idle for 26mn) | ||
| hive-mind has quit IRC (Ping timeout: 248 seconds) | [21:34] | |
| .... (idle for 19mn) | ||
| hive-mind has joined #arpnetworks | [21:53] | |
| .... (idle for 15mn) | ||
| incin has quit IRC (Read error: Connection reset by peer)
incin has joined #arpnetworks | [22:08] | |
| milki has quit IRC (Ping timeout: 240 seconds) | [22:19] | |
| milki has joined #arpnetworks | [22:27] | |
| milki has quit IRC (Ping timeout: 255 seconds) | [22:33] | |
| .... (idle for 15mn) | ||
| IM_AWESOME1 has quit IRC (Remote host closed the connection)
CoBryceMatrixBo4 has quit IRC (Remote host closed the connection) milki has joined #arpnetworks | [22:48] | |
| KILLALLHUMANS01 | sct04 / ceph cluster have a little bump? Oct 11 22:08:24 vps3 kernel: [12522051.816013] sd 0:0:0:0: [sda] abort
(And my Thunder instance has been tumbling downhill since then, having remounted to read-only, Postgres is unhappy, etc etc etc | [22:59] |
| *** | brycec has quit IRC (Ping timeout: 246 seconds)
BryceBot has quit IRC (Ping timeout: 246 seconds) BryceBot has joined #arpnetworks | [23:13] |
| up_the_irons | KILLALLHUMANS01: had a couple reports of disk timeouts, so i'm looking into it | [23:15] |
| KILLALLHUMANS01 | Thanks up_the_irons
I ended up hard-rebooting things and am gradually getting back to normal, you should see brycec join shortly btw this was the SSD-backed pool specifically | [23:15] |
| up_the_irons | KILLALLHUMANS01: but are you still seeing disk issues? | [23:17] |
| KILLALLHUMANS01 | Not currently
KILLALLHUMANS01 is dealing with some rather unhappy database tables | [23:18] |
| up_the_irons | OK | [23:20] |
| KILLALLHUMANS01 | According to logs, the issue started at 22:10 and continued for a few minutes at least (when the system dropped to read-only mode and logging was useless) -- And anything logged after read-only is muddy at best since there was a lot of stuff just flapping | [23:20] |
| up_the_irons | PST ? | [23:21] |
| KILLALLHUMANS01 | "ARP Standard Time" :P yeah | [23:22] |
| up_the_irons | LOL
OK | [23:22] |
| *** | brycec has joined #arpnetworks | [23:26] |
| brycec | works | [23:26] |
| up_the_irons | what works
brycec: ^ | [23:28] |
| KILLALLHUMANS01 | my connection (except actually I was in the middle of typing "/join #arpnetworks" when Weechat rejoined the room on its own, so you just got the last 5 letters :P | [23:30] |
| up_the_irons | I kicked out a particularly noisy and dying drive from our Ceph cluster a few moments ago. Not sure why it wasn't kicked out on its own, but I suspect those who had some blocks on that particular one may have got some timeouts too. | [23:30] |
| brycec | interesting | [23:30] |
| up_the_irons | I think so too | [23:33] |
| ↑back Search ←Prev date Next date→ Show only urls | (Click on time to select a line by its url) |