Starting back in 2011 I was working on a way to manage a variety of spreadsheets in a variety of layouts with a common schema. Over the last 13 years, I've been updating and maintaining this little project. It's not widely used, but it interests me.

Fundamentally, the use of …

In the process of writing Unlearning SQL, I had a need to extract SQL blocks from Python programs. Of course, I tried grep. It wasn't ideal.

Modern Python Cookbook — with lots and lots of recipes — is something you might need. Find the results of checking all these recipes here: https://www.amazon.com/Modern-Python-Cookbook-updated-techniques/dp/1835466389

I (reluctantly) switched from using mypy to using pyright to check all of these recipes carefully. The type alias (PEP …

Big Announcement: the 2024.8 version of Unlearning SQL, and the 2024.9 version of Pivot to Python are available from booksellers online. Both are revised and all the code tested with Python 3.12.

Let's say you want to self-publish an ebook and a print-on-demand paperback book.

This isn't impossible, nor is it particularly easy. Here's what I've learned.

Book (pre) Announcement:

• KDP - See https://www.amazon.com/stores/Steven-Lott/author/B00HNRSLEK for my author's page.

  https://www.amazon.com/Unlearning-SQL-hammer-every-problem-ebook/dp/B0DDMFMXNW is the book.

• Google Play - See https://play.google.com/store/books/details?id=23WAEAAAQBAJ. Be sure to get the 2024.08 edition; there's a previous …

Book Announcement:

https://www.packtpub.com/en-us/product/modern-python-cookbook-9781835466384

There are about 130 recipes in here. Some new. Some revised. All examined (and tested) for Python 3.12.

For the Python folks who are just starting as well as those looking to pick up some more skills, this is for …

See Synthetic Data.

I've updated the repository with a "Noisy Data" feature.

This will generate bulk data with invalid field values.

It helps with testing ETL pipelines to be sure they will scale to the expected volumes.

Clone https://github.com/slott56/DataSynthTool

Read https://slott56.github.io/DataSynthTool/_build …

I've published a framework for doing SQL-like programming in Pure Python -- no database required.

Here: https://github.com/slott56/functional-SQL. See the functional-SQL documentation.

This allows us to transform SQL:

SELECT n.name, v.c2
FROM names_table n, values_table v
WHERE n.code = v.c1

To pure Python:

Select(name …

I've published a framework for making tools to leverage formal schema definitions to synthesize bulk data for performance tuning.

Here: https://github.com/slott56/DataSynthTool.

See the original talk.

See the documentation