m0unds: staticsafe: https://www.youtube.com/playlist?list=PLc-oq-24r6LFedoVG429DQmARBMeshp6f
staticsafe: ooh
***: LT has quit IRC (Quit: Leaving)
m0unds__ has quit IRC (Ping timeout: 245 seconds)
m0unds_ has joined #arpnetworks
gizmoguy_: this will be timeline'd hopefully... http://seclists.org/oss-sec/2014/q3/649
***: gizmoguy_ is now known as gizmoguy
awyeah: I seem to be getting extremely inconsistent disk read speeds on my VPS... is that just the nature of shared environments? 65MB/sec one minute and then 300+ the next
up_the_irons: shouldn't be like that
brycec: awyeah: Which host machine?
up_the_irons: there can be bottleneck times, but mostly the I/O should be consistent
brycec: up_the_irons: rebuilding and raids?
(I assume not, or you probably would've mentioned it already)
awyeah: let me check my panel
kvr07
brycec: Aww good old kvr07
awyeah: I've been around for a little while ;)
brycec: I used to be on kvr07
Also being on a low-numbered kvr doesn't necessarily equate to age
just where there was capacity at the time
awyeah: yep
-: brycec moved up to kvr21 due to some Linux bugs
brycec: specifically, high UDP load would panic my kvm proc
awyeah: hah, lame
brycec: It was very lame with my UDP OpenVPN
And old bug, fixed in newer kvm so hence my move
up_the_irons: yeah it had to do with UDP fragments
brycec: which reminds me, I need to re-up
up_the_irons: documented virtio bug
brycec: ^
up_the_irons: if your NIC never saw fragments, it would be OK, otherwise not
mercutio: bryce: under heavy write load hard-disk raid can be like that
brycec: mercutio: eh?
mercutio: 65mb/sec one minute, then 300k/sec the next.
brycec: mercutio: 301 Redirect to awyeah
mercutio: it was probably ages ago
oh 16 minutes, not that ages ago :)
brycec: lol
mercutio: oh it was awyeah that said it
for some reason awyeah is so dark i can hardly read it, weechat and it's damn colours.
RandalSchwartz: I think I'm on kvr07 too.
Nope. 05(!)
brycec: mercutio: same. I keep meaning to change my colours
RandalSchwartz: I think my machine uses vacuum tubes
mercutio: i dunno if there's a way to make everyone the same colour easily, but that may be quickest path.
i don't think it's even doing the 256+ colour thing.
m0unds: yea, everyone but ops is green on mine
brycec: mercutio: /set weechat.color.chat_nick_colors 1
m0unds: ops are blue
text is all white
BryceBot: That's what she said!!
brycec: BryceBot: no
BryceBot: Oh, okay... I'm sorry. 'text is all white'
m0unds: silly bot
RandalSchwartz: roses are red!
awyeah: It's not a huge impact I don't think. I'm trying to troubleshoot some performance issues on apache+php+mysql
brycec: your bot is silly! oh wait, you don't have one
RandalSchwartz: that's what she said!
mercutio: hmm
whoever sadi that's what she said i can't read now
m0unds: haha, my bot is on another net. he wouldn't do well here
awyeah: Google PageSpeed claims my server takes 19 seconds to respond.... I can't reproduce that.
RandalSchwartz: roses on a piano are nice, but tulips on an organ are better.
mercutio: i set 0 oops
oh now it's red for everyone's nicks.
brycec: whee, everybody are green and red now
mercutio: i just need an op to talk :)
m0unds: merry xmas
brycec: /op brycec
>.>
<.<
mercutio: maybe i need to join something like #debian :)
brycec: btw wechatters, if you haven't set /set weechat.look.prefix_same_nick "⤷" you don't know what you're missing
m0unds: ..speaking of which, miracle on 34th street is on one of the HBOs
brycec: *weechatters
mercutio: no-one's talking in there
awyeah: oh
hey
that's sweet
I'm going to set it to "--" I think
mercutio: brycec: what's that do?
brycec: Really helps when there are multiple same-colour nicks
awyeah: yeah, that's the stuff
brycec: mercutio: instead of your nick appearing under itself several times, it's that character
awyeah: hey. someone do me a favor
mercutio: "under itself?"
awyeah: load http://new.ohioares10.org/ in your web browser.
brycec: mercutio: https://dl.dropboxusercontent.com/u/3167967/screenshot_2014-09-24_14-38-19.png
awyeah: Tell me if it's slow.
m0unds: it was slow to resolve
mercutio: oh mine does inverse already
BryceBot: That's what she said!!
m0unds: took close to 6 seconds before first byte
mercutio: with as bad colours as you
brycec: ditto what m0unds said
RandalSchwartz: slow to load
awyeah: gah.
mercutio: it says waiting for ages
it's still waiting
once it starts it's fine
awyeah: well, f*ck.
Good thing I'm not a professional sysadmin.
twobithacker: do you play one on TV?
brycec: And refreshing, it loads right up pretty much
m0unds: haha
RandalSchwartz: me neither
awyeah: Really need to learn more about optimizing this stuff.
RandalSchwartz: I just poke around until Neil is happy
m0unds: yeah, same here
loaded instantly after it loaded once
awyeah: hmm.
RandalSchwartz: "Yes... your page caches well!"
weird. not just cache. I emptied cache, and it still loaded relatively fast
must be some bad DNS lookups
brycec: awyeah: You can semi-weed out the Apache-side if you just run "php $script.php" and see how long that takes to run
awyeah: hmmmmmm
brycec: RandalSchwartz: more likely the connection keep-alive
RandalSchwartz: No - I closed the window
mercutio: awyeah: i think dns resolution being slow is partially because it has to lookup awyeah.net etc as well
brycec: I wouldn't trust your browser to close the connection
awyeah: oh hey good call. running it on the command line takes quite some time.
brycec: I'm just using curl, so only one lookup
btw http://en.wikipedia.org/wiki/HTTP_persistent_connection)
BryceBot: HTTP persistent connection :: HTTP persistent connection, also called HTTP keep-alive, or HTTP connection reuse, is the idea of using a single TCP connection to send and receive multiple HTTP requests/responses, as opposed to opening a new connection for every single request/response pair. The newer SPDY protocol uses the same idea and takes it further to allow multiple concurrent requests/responses to be multiplexed over a single connection.
RandalSchwartz: woo hoo. ugly calendar!
mercutio: oh it's beign slow again
brycec: awyeah: Is this your own code? or something like wordpress, joomla, etc?
mercutio: tests with curl
awyeah: joomla.
brycec: Also, static resources should load (http) pretty quick
obligatory: ewww Joomla
mercutio: curl -v > /dev/null 0.00s user 0.00s system 0% cpu 23.300 total
m0unds: hahaha
mercutio: not sure why it removed the url
23.3 seconds is pretty damn slow, that is to the public service link
brycec: lol
Yeah, pulling up static resources like CSS is instantaneous
so your Joomla is slow
awyeah: yeah
brycec: perhaps your database is slow
RandalSchwartz: that's what she said
mercutio: 8.5 seconds the second time
it was going faster before
awyeah: yeah I've been looking at DB stuff
that's where I'm the least knowledgeable, TBH
brycec: @google slow joomla :P
awyeah: but hooray, my mysql slow-query log is filling up
brycec: You're probably looking at some mysql tuning
RandalSchwartz: or upgrade to an actual database
brycec: mysql isn't know for being a lightweight, and in a constrained VPS you're going to have some fine tuning to do
Also, Apache tends to be a resource (esp. memory) hog so see if you can ditch that
mercutio: joomla is crap
BryceBot: That's what she said!!
mercutio: joomla can also leak
are you swapping?
BryceBot: That's what she said!!
RandalSchwartz: heh
brycec: (I really, really dislike Joomla. But I was trying to remain constructive :P)
mercutio: it says you're using apache
awyeah: freebsd is always swapping.
mercutio: if you're not using mod cgi type php... then you probably want to reduce max number of requests per process
to keep the memory consumption down.
you're always swapping?
BryceBot: That's what she said!!
mercutio: reduce minspare and maxspare too
it's much cheaper to create a new process than to swap
awyeah: my php is an apache module
brycec: freebsd doesn't normally swap... And this is coming from a guy who runs a storage ZFS server
mercutio: bryce: it's not uncommon for joomla to use 250 mb of memory :)
awyeah: You sure? I thought FreeBSD is always putting idle pages into swap.
mercutio: per process..
awyeah: nah that's linux
brycec: mercutio: I'm sure
mercutio: freebsd is pretty slack about swapping
brycec: I used to admin a few Joomla sites
well not the sites, other sites..., but there were joomla sites on the same server
awyeah: I have 673/1500MB in use, and 419MB of swap in use. weird.
m0unds: wait, you're using mod_php?
mercutio: awyeah: you may have had a burst of processes before. did you restart apache?
awyeah: yeah not doing fastcgi or anything.
yeah restarted it like 10 mins ago for a quick config change
m0unds: you might wanna consider trying it; mod php is expensive
mercutio: mod_php does suck yes.
awyeah: well hold on here though, I get a ton of slowness when I run "php index.php" - huge delay.
mercutio: esp when dealing with joomla etc.
awyeah: i use strace to debug those things :)
awyeah: moving to fpm or whatever is on my list, but it sounds like maybe that's not the big issue right now.
brycec: ^ correct
mercutio: it makes it reasonably easy to see if it's doing something like db connect or such
ktrace on freebsd i think
awyeah: hmmmmm
mercutio: i think it's ktrace/kdump on freebsd.
awyeah: Is there a "get started with ktrace in 10 minutes" type tutorial I could look at?
m0unds: brycec: i like your prefix_same_nick char better than my ghetto arrow. thx for that.
mercutio: well ti's annoying compared to strace for "spotting"
as you don't see the delay so easily
but it might mark seconds
brycec: awyeah: for shits and giggles, reboot (fresh memory slate), stop apache (or it will eat up ram), and then run your php
m0unds: don't thank me, thank http://benoliver999.com/2014/02/18/weechatconf.html
mercutio: you basically just run it and look at output briefly
and if something pops out at you it pops out
m0unds: i was using -->
awyeah: okay. I'll reboot. brb.
m0unds: that one is fancier
mercutio: it's a good exercise in not reading every line
brycec: m0unds: I liked the idea of putting my buffers on top too :D
And I'm also doing the auto-hide quiet buffers
***: awyeah has quit IRC (Quit: ZNC - http://znc.in)
m0unds: huh, i'm gonna have to check this out
i just made weechat as much like irssi as possible, but i'm down to try new stuff
haha
brycec: m0unds: Mine looks like this now https://dl.dropboxusercontent.com/u/3167967/screenshot_2014-09-23_10-02-39.png
m0unds: snazzy
brycec: Actually it's a bit narrower than that screenshot
because it can me now :D
*can be
***: awyeah has joined #arpnetworks
brycec: wb awyeah
awyeah: so now you're on a clean slate. The first query/run will be slow since it has to all come from disk, subsequent runs should be a bit faster
awyeah: alrighty
stand by please.
-: brycec sits anyways
brycec is a rebel
awyeah: yep both pretty slow still
first and second
brycec: Okay, so you've got a good idea where to tweak then
btw awyeah what are the vps specs?
awyeah: 1.5GB RAM, 2x20GB disks
brycec: Well that's not bad then
With that much ram, you should have no trouble fitting mysql in ram (caching, etc)
And frankly I'm surprised you're having as much trouble as you are
awyeah: I wouldn't put it past myself to really screw things up ;)
brycec: I'm blaming Joomla for now, both itself and whatever plugins etc have been configured
awyeah: wordpress is relatively slow as well
check out http://www.ccskywarn.org
same server, same db server, but wordpress.
actually it's definitely faster on the command line for that site.
See, I evaluated joomla and drupal for this new site.
And ended up liking joomla... so... crap
brycec: Oh so the CMS was your pick?
awyeah: yep
brycec: Might I recommend Concrete5 for a relatively lightweight gooey CMS?
awyeah: concrete5, eh
brycec: I've messed with it a bit in the past
Not doing any CMS nowadays
Or I do 100% static
awyeah: Yeah, I need WYSIWYG editors, access control, etc
brycec: Been burned by CMS vulnerabilities/hacks too many times
awyeah: this site is going to have several people, each can only edit certain parts of the site
brycec: c5 should fit the bill
awyeah: one requirement is this
I need a nice calendar plugin.
And that calendar plugin needs to be able to automatically sync external ical feeds.
And it needs to provide its own ical feeds.
brycec: awyeah: http://www.concrete5.org/marketplace/addons/-/view/?submit_search=1&search_keywords=calendar&sort=recommended&endorsed=endorsed
several of those do just that
Some are even free :p
awyeah: Interesting.
brycec: I like that the addons site even showcases sites using a given plugin
eg http://www.myactivechild.com/calendar/
awyeah: hmm
wow, Joomla has a lot of crap in it by default.
extensions and stuff
brycec: Joomla is a lot of crap :P
awyeah: I mean, I can't believe that something as popular as Joomla can be so crappy.
It's got to be somethign on my side here.
m0unds: popular doesn't necessarily mean "good" :)
awyeah: oh wow holy crap
BryceBot: That's what she said!!
awyeah: I changed to the default template
WAY faster
brycec: sweet
Oh yeah that is fast
m0unds: yeah, that loaded much faster
all the pages load right away
-: brycec mashes the Bigger button
brycec: twss
BryceBot: Okay! twss! 'ACTION mashes the Bigger button'
awyeah: lol now I can't change it back, bleh
wow, I can't believe what a difference that makes, holy cripes.
brycec: I was impressed as well
mercutio: so how did joomla tuning go?
i suppose i should say awyeah because it's been a while
brycec: mercutio: The resource hog turned out to be the theme he was using
switched to the default and it came up in <2s
m0unds: yeah, weird how much faster it was
mercutio: maybe it's going over some cache value or something
query cache size, or memcached limit or some other cache thingy
m0unds: i've been messing w/ghost a bit. it's pretty nice for a blogging platform. don't really know what to think of node though
brycec: m0unds: Link? (because googling "ghost node" was next to useless)
m0unds: http://ghost.org
brycec: So it's hoted?
m0unds: https://ghost.org/download/
brycec: *hosted
Ah
m0unds: i'm running node behind nginx
and just keep the app running w/forever (npm install forever -g)
-: staticsafe just uses wordpress :)
brycec just doesn't blog
m0unds: i just like playing with stuff
ran wp for years, ran octopress for a bit but updating it was a pita, so i never updated
staticsafe: yeah i actually switched to octopress, then killed it and started brand new with WP
up_the_irons: i like octopress
m0unds: yeah, it's nice, but i'm lazy and having to write in vim then regen then deploy was just too much effort ;)
i did like having the blog's code and stuff living in a mercurial repo though, just clone it locally and commit new posts or whatever
up_the_irons: yeah, for me, i like writing in vim, so that was a big plus
***: forgotten has quit IRC (Quit: leaving)
forgotten has joined #arpnetworks