and sore. my neck's been giving me a lot of trouble these past few days. my sinuses are okay right as i type this, but my nose has been mostly stuffed or running the past few days. it's all exhausting.
yesterday:
i left the script running after posting yesterday morning, dragged myself out of bed three or four hours later feeling groggy and borderline hallucinating. i woke up to find that it had crashed just as soon as i'd locked the screen (intentionally leaving the machine open and running), and it would take hours of running the script and keeping an eye on it before i finally had the data we needed.
it was a sad, busy morning.
the data was ready by the time we needed to pick mr smear up from school, and my plan was to get him home, deliver the emails, then head out for lunch with the mongoose and fam.
my chain of command had other plans.
we met up with the mongoose and co, and almost immediately i had to abandon them to find a bench to work on. it took almost two and a half hours before we were sure we were doing the right thing, and my batteries (my laptop, my phone, and my body) were almost drained by the time i pushed the button. the first run was going swimmingly right until the credentials expired - the production single-sign-on settings are for a very limited amount of time and the number of emails that needed to go out have multiplied significantly since the original script. the second run seemed to be good, but my bosses identified at least one mistake.
there was nothing i could do but wait until i got home to investigate. i rejoined everyone, picked up a cup of coffee, and enjoyed a pleasant walk home with my family, even stopping for an ice-cream along the way.
i figured out a way to investigate the errors, and was mortified to discover that i'd sent out about 1500 emails that shouldn't have been delivered. then i began debugging the script, and by the time i was done i'd realized two important things: first, that out of 3500+ emails, only less than 20 had been sent incorrectly.
i cannot overstate what a huge relief this is.
second, that it was an absolute miracle that it was such a small number of errors. in order to determine what *should* have gone out i ended up doing a significant refactor of the script, and i can now quite confidently say that the following dangerous mistakes were made:
- i was really tired and we're all under time pressure
- the scripts that were built with a simple requirement have become increasingly sophisticated / complicated on the fly, each time at the last minute
- no reviews
No comments:
Post a Comment
Note: Only a member of this blog may post a comment.