Two approaches to scale your processing: Task Queues and Workflows

I was very fortunate to present to the main track at PyCon Ireland 2017 on the topic of scaling your processing.

The talk was entitled “Two approaches to scale your processing: Task Queues and Workflows” and was aimed at an intermediate Python audience to introduce them to the Celery and Airflow tools for queues and for workflows respectively. It was more mainstream talk than the data science track I’d prevoiusly presented at and I was able to talk about many of my own learnings building tooling with MongoDB.

Pycon 2017 Talk PDF version