See Apache Log Parsing for the background.

Here's a generator function which expands a simple Access to be a more detailed named tuple.

Access_Details= namedtuple( 'Access_Details',
    ['access', 'time', 'method', 'url', 'protocol'] )

def details_iter( iterable ):
    def parse_time_linux( ts ):
        return datetime.datetime.strptime( ts, "%d/%b/%Y:%H:%M:%S %z" )

    def …

How much do I love Python? Consider this little snippet that parses Apache logs.

import re
from collections import defaultdict, named tuple

format_pat= re.compile(
   r"(?P<host>[\d\.]+)\s"
   r"(?P<identity>\S*)\s"
   r"(?P<user>\S*)\s"
   r"\[(?P<time>.*?)\]\s"
   r'"(?P<request>.*?)"\s'
   r"(?P …

I've revised (and streamlined) my Building Skills in Programming book. The 2.6.2. edition will simply replace the 2.6.1. edition, leading to the possibility of broken bookmarks because of the changes.

Currently, the non-programmer book accounts for under 10% hits on the http://www.itmaybeaback.com/book …

The csv module in Python 2.7 is more-or-less hard-wired to work with ASCII and only ASCII.

Sadly, we're often confronted with CSV files that include Unicode characters. There are numerous Stack Overflow questions on this topic. http://stackoverflow.com/search?q=python+csv+unicode

What to do? Since csv …

Read this: Shared Counter with Python Multiprocessing.

Brilliant. Thank you for this.

Too many of the questions on StackOverflow that include multi-threading are better approached as multi-processing. In Linux, there are times when all threads of a single process are stopped while the process (as a whole) waits for system …

A common (and small) task is reformatting a file that's in some variant of CSV. It could be a SQL database extract, or an export from an application that works well with CSV files.

In Python 2.x, a CSV file with Unicode was a bit of a problem. The …

Read this in Forbes: "Innovation's Return on Failure: ROF".

Also, this: "The Necessity of Failure in Innovation (+ more on CDOs)".

This, too: "Why innovation efforts fail".

While we're at it: "Accepting Failure is Key to Good Overall Returns on High-Risk Development Programs".

I can't say enough about the value of …

Watch this: http://www.youtube.com/watch?v=u6XAPnuFjJc Brilliant summary of what really motivates people. The most important advice: provide a sense of purpose and get out of people's way so that they can do the right thing. Micromanagement, incentives, annual performance reviews and the like aren't as useful …

Saw this recently.

Why do most gov websites look like they were created by someone's 10 year old nephew yet cost millions to make? — Steve Dekorte (@stevedekorte) December 29, 2011

I think this aptly summarizes the results of a waterfall methodology.

1. You wrote a lot of requirements, not fully understanding …

Wow. Just wow. See "LANGSEC explained in a few slogans". Short, easy-to-grasp explanation of why complex protocols create new problems. I'm happy with REST and the stack of stuff under it (HTTP, TCP/IP, etc.) Once upon a time (2001), I invented by own version of a RESTful protocol outside …