error_log() calls until I figured out what was gumming up the works.It turned out to be an
mcrypt_create_iv() call. Sometimes that call would run in a fraction of a second, and sometimes it would take over a minute, with no discernible pattern. I had pretty much done a copy-and-paste from the mcrypt_module_open() manual page, which shows using the MCRYPT_DEV_RANDOM constant as the second argument to mcrypt_create_iv(). It finally occurred to me to try using the MCRYPT_DEV_URANDOM constant (note the "U"), instead, and the encryptions immediately became consistently fast.This was happening on a VMWare ESX guest running RHEL4. A Web search or two found a good comparison of
/dev/random v. /dev/urandom, and my problem turned out to be a good illustration of /dev/random blocking the caller until sufficient entropy is attained.
You, sir, are my hero. I had been banging my head against the wall with a similar problem in a MediaWiki/AuthDrupal situation. The change from MCRYPT_DEV_RANDOM to MCRYPT_DEV_URANDOM made a world of difference. Thanks!
ReplyDeleteGlad that was helpful.
ReplyDeletec
Excellent! I had tracked down the slow point myself but I found this post I had no idea *why* it was slow... And I happen to be one of those curious types that can't stand not understanding why some function is running arbitrarily slooooooowwwwww. :D Thanks!
ReplyDeleteYou Sir, have saved me hours of work. Thanks!
ReplyDeleteYou sir are a gentleman and a scholar
ReplyDeleteYou've helped me a lots! Thanks! mcrypt with MCRYPT_DEV_RANDOM is unusable slow, they should disable it by default!
ReplyDeleteSome of my friends say PHP is obsolete and they have their reasons. If I only had time I'd switch to Python ASAP.
If I could return the favor a little, maybe you'll find useful my optimisations: when working with unicode strings - use regex (preg_match, preg_replace and such) instead of mb_strings functions. They are way faster! PHP manual says just oposite, but I tested a lots of code with and without regexes - perl regex in PHP is very fast. Then - unset is much slower than $x = null. Never use unset inside any loop. "===" is a little faster than "==".
Oh, and never use '\b' inside unicode regex. It's broken in PHP, all versions. It took me hours to figure it out. There is no good workaround, you could try matching whitespace and non-word (listed) characters instead - but it won't be very fast.
Adam,
ReplyDeleteI'm glad that the mcrypt hint was useful.
I guess all the PHP stuff I've done has been in English with fairly uncomplicated character sets, so I don't know anything about the Unicode features.
You saved my day sir, i've been banging my head on the wall the whole morning :)
ReplyDeletethanks!
Andrea
Actually the slowness is due to /dev/random than caused by PHP. If you read some docs on openssl or Apache, you'll see using urandom is recommended, meaning affecting not just PHP but everything that uses /dev/random will be slow.
ReplyDeleteperfect! thanks.
ReplyDeleteThanks! The login time to our intranet just went from 60 seconds to 0 seconds :)
ReplyDeleteSUPERB. Thank you. I would never have figured this out. I was rebooting the server, spinning in circles. Instant fix as per your instructions.
ReplyDeleteThank you. It was very helpful.
ReplyDeleteAfter taking 2 hours to track down some slowness in my application to mcrypt_iv_slow, your suggestion fixed my problem in seconds... Wonderful information!!
ReplyDeleteThank you very much for posting this, it was very helpful!
ReplyDeleteThat what I call a very big help !
ReplyDeleteAs many others, I was struggling with the somehow ramdomly slow encryption on a VMware ubuntu.
After some logging, I too found out that mcrypt_create_iv was the slow point.
I'm very glag I found your post ! Thanx a lot ! You're my saviour !
Great! Fixed it for me :) Thanks!
ReplyDeleteAfter 3 days of work, I finally isolated this issue and your suggestion saved me another 3 days. You're my hero!
ReplyDeleteThanks, man. Can't believe that worked.
ReplyDeleteAdd me to the list of thankful.
ReplyDeleteThanks!! You saved me a bunch of time!
ReplyDeleteThank you! :D
ReplyDeleteMCRYPT_DEV_URANDOM has been the default since 5.6.0 according to the manual pages of mcrypt-create-iv. So there is no need to jump through hoops anymore, at least if you are using the 5.6 branch.
ReplyDelete