• Late Late Show: Mumford & Sons – The Cave http://youtu.be/mllqig6frfw #fb #

A cronjob shall run a script and write it’s output to a new logfile every day. Easy, right?

0 2 * * * echo test > test.`date +%Y-%m-%d`

This will create a file called “test.“, that will be overwritten every day …and here is why (from man crontab):

“Percent-signs (%) in the command, unless escaped with backslash (\), will be changed into newline characters, and all data after the first % will be sent to the command as standard input.”

This works…

0 2 * * * echo test > test.`date +\%Y-\%m-\%d`

At work we have a script, that rsyncs a bunch of files from one server to the other, nothing special. The script works perfectly when run manually from a shell, but does not when run via crontab. The error message does not really point to anything:

no: command not found

What is the “no” command and why and who tries to call it!?

Well, what happened was: I though I was being clever and used RSYNC=$(which rsync) to find the rsync command to execute. Unfortunately rsync actually is located in /usr/local/bin on this system and /usr/local/bin is not in the PATH, so which could not find it. Running the script from a shell worked, because that user just happened to have /usr/local/bin appended to it’s PATH environment variable. The “no” comes from the message which returns when it cannot find the command:

no rsync in /usr/bin /sbin /usr/sbin /bin /usr/bin

• http://twitpic.com/14k5sv – Awesome weather today. Winter: your days are coming to am end! #fb #
• "Gamer" http://www.imdb.com/title/tt1034032 … "Death Race" meets "Dollhouse" #fb #
• RT @rands Sitting in the middle of a jungle in Nowheresville-ohini Hawaii and my 3g signal is 5x better than San Francisco. #
• http://twitter.com/DalaiLama. yep, that is all I wanted to say. #
• The Frame: Space shuttle Endeavour's mission to the space station http://shar.es/mm7ZC via @sharethis #fb #
• Bisamberg Sendemastensprengung – Großer Sender http://youtu.be/NN5RCuVVZDA … mit super Kommentar "bist du deppat." #fb #
• RT @StephenColbert I am awesome. #
• RT @ubergizmo LG GD910 (Price) – LG GD910 Priced At 15 Benjamins http://ow.ly/1oZm0Z #

Last week I discovered Listen, yet another music player/database written in Python for the Gnome desktop. I tweeted it and I think it looks quite nice; has issues though, so I decided to jump in and fix some stuff. For example the cover fetch from Amazon. Amazon decided to require a signature for each REST request.

I am not sure how this is supposed to work though. From Amazon you get a private and public key after signing up for an AWS account. You use the public key in plain text as a parameter in your request. In addition you now (since August 2009 as it seems) have to add a timestamp and compute a signature key using the whole request string (including that timestamp and your public key) and the private key. Now append that signature as another parameter to the request and send it.

Of course every request will have a different signature because (a) you want to query for different stuff and (b) time changes and the timestamp must be recent or Amazon will consider the request as “old” and not worthy of an answer.

So what do you do now? Include your private key in your Python source, that you put out in a public repository? You probably shouldn’t, but that means the customer (user?) must have it’s own public/private key pair from Amazon. What a major inconvenience for the customer, to be required to have a AWS account just to get some covers.

Anyway, back to Listen. I created a branch of the 0.6 series on Launchpad  (a first for me, still getting used to bzr) and committed the necessary changes to amazon.py in revision 1126. Today I merged changes from the parent 0.6 and therefore that file now contains both public and private key — of someone else, not mine.

By the way, he original amazon.py is from of PyAWS. Unfortunately a later release of PyAWS 0.3 was not uploaded to SourceForge and further changes by others for the signature stuff also never found their way back to the repository. Isn’t open source great? </sarcasm>

• want to work with bazaar or launchpad? read this http://wiki.bazaar.canonical.com and this https://help.launchpad.net/Code/UploadingABranch #
• RT @CraigyFerg http://tweetphoto.com/11622968 the throw pillow in my office. #
• RT @CraigyFerg http://tweetphoto.com/11720962 Helena Bonham Carter during a commercial break. Girl is batshit crazy. I loved her #
• RT @NathanFillion I like falling asleep in the make up chair because I wake up better looking. #
• Civilization V Announced For This Fall: http://bit.ly/9taa1e #fb #
• "road to recovery" obama administration again using twitter for hype: http://www.barackobama.com/twitter/recovery/ #
• Chuck & Beans: Life before Google http://www.shoeboxblog.com/?p=15314 #
• Vancouver 2010 live http://www.eurovisionsports.tv/olympics/ #fb #
• RT @CraigyFerg Instead of sexy dance will have middleaged Scottish dude in a suit do the robot & moonwalk. #

• RT @HannoSettele strom wieder da. aber no tv or net. 1 down, 2 to go. #snow #
• what the… http://hiphopwired.com/2010/02/08/sarah-palin-caught-with-notes-on-hand-during-speech-video-included #palin #fb #
• "pinta" open source paint.net clone based on mono/gtk+ http://www.reddit.com/tb/azumc #fb #
• RT @mike_elgan: Polish newspaper claims 'Pedobear' is a 2010 Vancouver Olympic mascot. http://bit.ly/dzbhKo #
• RT @IMDb Tom Cruise has signed on for Mission Impossible IV! http://bit.ly/cg4tff #imdb #
• RT @Gravycheeks Craig Ferguson has joined the twitterverse. Better follow him, just in case. @Craigyferg #
• RT @CraigyFerg Twitter has better lighting than my show. #
• Best Super Bowl Pic – http://www.forgetfoo.com/?blogid=11170 via @forgetfoo #
• sold out! ;) http://tweetphoto.com/10899459 #
• aah, good times! http://bit.ly/bktzT3 #fb #meme #
• another one… http://bit.ly/apMiwA haha :P #fb #meme #
• HEY, HEY! http://tweetphoto.com/10999538 #
• http://twitpic.com/12lclw – More snow #fb #
• http://twitpic.com/12lk3v – Eisb #
• Listen, just listen. https://www.listen-project.org … on first look a pretty amazing music manager/player for linux #
• RT @NASA Shuttle crew awoke at 4:14pET to theme song from "Firefly" via @JewelStaite #

• RT @Danny_DeVito http://twitpic.com/1159g9 – "Ich weiss auch nicht was es ist meine Dame, aber es isst mein Popcorn #
• RT @THEsaragilbert Someone on American idol just said they were born in 1993. What? #
• RT @HannoSettele Die orchesterierte Toyota-Vernichtung geht weiter. [.] nie gesehen, das ist neu. 7 Jahre in USA, [.] eine neue Qualität. #

• RT @tweetmeme RainyMood.com http://bit.ly/1pEoI #
• RT @Serienjunkies Lost: Der Absturz von Oceanic 815 in Realtime http://tinyurl.com/ydjas4j #
• RT @HannoSettele 3 Jahre alt, aber gut, sehr gut: http://bit.ly/FSAu6 — really good, so sad. #

Found another issue with Net::MySQL (after this one). Why are we using that again? Ah yes, it’s pure Perl and we hate compiling modules. Well, you get what you pay for.

When inserting a lot of data it is better to create one huge insert statement then thousands of small ones. When you do that you have to make sure that your server accepts huge amounts of data by setting an appropriate value for max_allowed_packet.

Furthermore the MySQL protocol defines a “MySQL packet” to have a header of three bytes for the length followed by a one byte counter. The packet body starts with one byte command followed by data (a SQL query or response). With three bytes you can count up to around 16 million or in other words a MySQL packet can only be 16MB long (plus four header bytes), because that is the maximum value for the length field.

What Net::MySQL does in this case is: nothing. It sets a length value that is too big for three bytes, ignores the need for a counter and just keeps pouring data into the socket like there is no tomorrow without splitting into packets. The server reacts with a connection reset and “packets out of order” error. At least that is what we have observed.

I’ve sent a bug report and patch to Net::MySQL’s bug tracker.