Import Python: Import Python Weekly Issue 109 - Pycon US 2017 selected talks, Python garbage collection and more

The acceptance and rejection letters for pycon arrived this week and so did the final list of selected talks for Pycon US 2017.

pycon

9 DBs to choose from, 5 min setup, auto-scaling, Cloud hosted. Free for 30 Days.

In this 90-minute video series, I walk through a book chapter about asynchronous I/O in Python called A Web Crawler With asyncio Coroutines, which was co-authored by the creator of Python.

video

,

asyncio

By dismissing the Python garbage collection (GC) mechanism, which reclaims memory by collecting and freeing unused data, Instagram can run 10% more efficiently. Yes, you heard it right! By disabling GC, we can reduce the memory footprint and improve the CPU LLC cache hit ratio. If you’re interested in knowing why, buckle up!

memory management

,

garbage collection

I want to focus exclusively on the process of reshaping data, i.e. converting or transforming data from one format to another.

data manipulation

Complexity science is one of my favourite topics, ever. Studying complexity is how I ended up in the computer science bandwagon in the first place, and I constantly find myself thinking about how individual agents’ decisions affect the overall state of systems. Self-organization and emergence are fundamental aspects of how the pieces of the complexity puzzle fit together, and Wolfram’s elementary cellular automata are a great way to understand them.

This blog post gives an introduction to some techniques for benchmarking, profiling and optimising Python code.

performance

,

benchmarking

Users finding bugs? Searching logs for errors? Find + fix broken code fast!

Writing consistent, well-formed code is important. Of course the functionality of the code is paramount, yet in addition the styling and structure should follow a commonly accepted standards. Not only will it make the code more approachable to others, but also to yourself, when you return to an old piece of software, which you have not looked at for months or even years. You might even squash some bugs early on, by writing code in consistent manner. The process of styling and checking of these code qualities, is often referred as linting.

How to use assertions to help automatically detect errors in your Python programs in order to make them more reliable and easier to debug.

core-python

I've chosen to start with Harvard's Data Science course. I'm currently on week 3 and one of the suggested readings for this week is Jake VanderPlas' talk from PyCon 2016 titled "Statistics for Hackers". As I was watching the video and following along with the slides, I wanted to try out some of the examples and create a set of notes that I could refer to later, so I figured why not create a Jupyter notebook.

In this article I am going to look at Spark Streaming. This is one of several libraries that the Spark platform provides (others include Spark SQL, Spark MLlib, and Spark GraphX). Spark Streaming provides a way of processing "unbounded" data - commonly referred to as "streaming" data. It does this by breaking it up into microbatches, and supporting windowing capabilities for processing across multiple batches. You can read more in the excellent Streaming Programming Guide.

kafka

,

spark

Sheila Miguez and William Kahn-Greene for their monumental work in creating and supporting PyVideo over the years.

pyvideos

Do you know the difference between the following syntax? [x for x in range(5)] , (x for x in range(5)), tuple(range(5)) Let’s check it.

core-python

In this article we’ll go over how to handle webhooks using Django, create a webhook in GitHub, and test the webhook on your local machine using ngrok. But first a brief primer on webhooks.

Comprehensive Python quiz and questions from basic to advanced level that help you to review your Python knowledge and become the master of Python.

quiz

If you're familiar with financial trading and know Python, you can get started with basic algorithmic trading in no time.

algorithmic trading

Let’s say we have a contact form and we want to add placeholders to this form inputs so our rendered form has these cool input labels. How do we do that?

django

Sacred Marriage of Pipfile, Pip, & Virtualenv.

A tool for automating the installation of the Microsoft Windows operating system on various device platforms.

A library adding some anti-pythonic syntatic sugar to Python

Text UI colors for Python.

Break Python programs with a simple import.