Here's an interesting question:
more ...I came across your blog post "Introduction to using Python to process CSV files" as I'm looking to do something I'd think is easy in Python but I don't know how to do it.
I simply want to examine a column then create a new column …
I've written a lot about CSV processing. Here are some examples {tag}csv.
It crops up in my books. A lot.
In all cases, though, I make the implicit assumption that my readers already know a lot of Python. This is a disservice to anyone who's getting started.
First, and most important, Omni Outliner is a super-flexible tool. Crazy levels of flexibility. It's very much a generic-all-singing-all-dancing information management tool.
It has a broad spectrum of file export alternative formats. Most of which are fine for import into some kind of word processor.
But what if the data …
more ...It may be helpful to look back at 'How Managers Say "No"' which is about breaking the RDBMS Hegemony.
I got an email in which the simple concepts of "data manipulation" and "persistence" had become entangled with SQL DML to a degree that the conversation failed to make sense to …
more ...The csv module in Python 2.7 is more-or-less hard-wired to work with ASCII and only ASCII.
Sadly, we're often confronted with CSV files that include Unicode characters. There are numerous Stack Overflow questions on this topic. http://stackoverflow.com/search?q=python+csv+unicode
What to do? Since csv …
more ...A common (and small) task is reformatting a file that's in some variant of CSV. It could be a SQL database extract, or an export from an application that works well with CSV files.
In Python 2.x, a CSV file with Unicode was a bit of a problem. The …
more ...We process a fair amount of externally-prepared datasets. 40,000 rows of econometric data that we purchased from a third-party. Mostly, the data is in a usable format: .CSV or .XSLX.
Once in a while, we get CSV with |. A few times, we got fixed-format COBOL-style records.
Recently, we got …
more ...We have a design, we have code and we have tests that all pass.
Tuesday, we got some new input data that just wouldn't work.
What -- if anything -- went wrong?
Agile is as Agile Does
We're following an Agile approach for several reasons.