Python Optimization: How it Can Make You a Better Programmer
Python expert and Stack Overflow legend Martijn Pieters joined us for an Office Hour session to give us a quick tutorial about Python optimization.
5
Martijn Pieters
Mentor
(62 reviews)
US$50.00
For every 15 mins
89
Sessions/Jobs
ABOUT ME
Long time Python wizard, with ~20 years of experience in full-stack web deployments, dev infrastructure and OSS. Python #1 on StackOverflow.
Long time Python wizard, with ~20 years of experience in full-stack web deployments, dev infrastructure and OSS. Python #1 on StackOverflow.
I breathe, eat and live software development. I've built software solutions ranging from digital camera movement synchronisation for a TV series production to web applications serving the top tiers of web traffic. Let me find the solution to your problems too.
I am also a mentor, I love teaching programming, especially programming with Python. I am ranked #1 on Stack Overflow for answering Python, #9 overall. I love figuring out how someone sees their world, their problems, and then help fill in the gaps. Through mentoring, I accelerate my own constant learning, because there is always something that you want to do better when teaching that knowledge to others!
I see programming as art. Code is expression. It needs to have clarity, purpose, elegance and efficiency to communicate well, to execute well. As a result, I produce software of the highest quality, not only functional and tested, but highly readable for future maintainers.
Dutch, English
London (+00:00)
Joined December 2013
EXPERTISE
10 years experience | 39 endorsements
I've worked with Python for 18 years now, since version 1.4, focusing mostly on web platforms. I worked with the Python Labs team at Zope...
I've worked with Python for 18 years now, since version 1.4, focusing mostly on web platforms. I worked with the Python Labs team at Zope Corporation (including Guido van Rossum and Tim Peters), where we worked on the revolutionary Zope platform. More recently I was a developer infrastructure engineer at Facebook, using Python and Mercurial.
I am the #1 answerer of Python questions on Stack Overflow, and I am ranked #9 overall. There is little I don't know about the language. I'm also a recipient of the PSF Community Service award.
I've created or contributed to a large number of Open Source projects, including Python itself, Flask, Mercurial and others.
10 years experience | 1 endorsement
I've built several Flask sites for large-scale clients (including sites in the US top 10.000), deploying to Google App Engine, Heroku and...
I've built several Flask sites for large-scale clients (including sites in the US top 10.000), deploying to Google App Engine, Heroku and self-hosted systems, where they serve millions of unique visitors each month.
I also regularly contribute to the Flask stack of projects, and I am ranked #1 for Flask answers on Stack Overflow.
22 years experience
I've been writing JavaScript and "Dynamic HTML" since the formative years in the late 90s.
I've been writing JavaScript and "Dynamic HTML" since the formative years in the late 90s.
23 years experience | 4 endorsements
From the embedded SQLite to enterprise-level Oracle deployments, I've worked with them all, integrated into software solutions, designed ...
From the embedded SQLite to enterprise-level Oracle deployments, I've worked with them all, integrated into software solutions, designed schemas for and tuned existing queries. The latter sometimes by re-writing queries dynamically in SQLAlchemy syntax trees to work around bugs in the target database query optimiser (I'm looking at you, Oracle!).
I can work with any of the modern popular databases. If you have older products, I probably can work with them too, I've worked with Informix, Sybase, mSQL and many more.
10 years experience
8 years experience
2 years experience
REVIEWS FROM CLIENTS
(62 reviews)
Edison Jimenez
August 2020
Martijn is a GODSEND. Insanely knowledgeable about really complex processes. Highly recommended!
Waqas Younas
August 2020
Martijn is an amazing engineer and architect. Will keep learning from him.
Dave Karetnyk
June 2020
Very good session: excellent knowledge in the areas I was looking for; and very easy to chat with.
Tyler Scott
June 2020
Martijn is super knowledgeable and great at explaining concepts in an easy way. He helped me review my software architecture, navigate the innards of Flask and SQLAlchemy, discuss how to implement testing, and pointed me in the right direction for how to improve/extend my code. Highly recommended!
Michael Rogers
May 2020
Martijn is a great teacher. Really helped me get to grips with Python under the hood.
Michael Rogers
May 2020
Martijn is a great teacher, he really encourages you to gain an understanding rather than simply learning the answer.
Thor Whalen
January 2020
Knows his python in and out!
Sven Paesschierssens
November 2019
Excellent session, I highly recommend Martijn
David Wynter
October 2019
Useful having someone with deep knowledge of numpy to guide me
Thor Whalen
September 2019
A true expert. The kind of guy you'd like your code to be exposed to.
SOCIAL PRESENCE
collective.transmogrifier
A configurable pipeline, aimed at transforming content for import and export
Python
12
13
rtfunicode
Encoder for unicode to RTF 1.5 command sequences
Python
6
1
654985 Reputation
111
2180
2079
6 Useful Python Libraries Recommended by #1 Stack Overflow Answerer
The article shared some of the less=well known libraries that #1 Stack Overflow answerer likes to user for web development or daily tasks.
7
1
Python 2.7 vs Python 3.4 ─ What should Python Beginners choose?
Read our write-up on our Live webinar with Codementor Python expert and Stack Overflow legend— Martijn Pieters. In this post, you'll learn the difference between Python 2.7 and Python 3.4, and what should Python beginners choose.
7
4
How to load & parse JSON file in python
You need to parse your file line by line:import json
data = []
with open('file') as f:
for line in f:
...
How to decode UTF-8 url in Python
The data is UTF-8 encoded bytes escaped with URL quoting, so you want to decode:url=urllib.unquote(url).decode('utf8') Demo:>>> import urllib...
How to use jQuery to select all children except a select element
You can simply omit the wildcard as it is optional in this case, but keep the space:$('#container :not(select)');Alternatively, use the .not() method to...
EMPLOYMENTS
Open Source Consultant
Zopatista
2005-08-01-Present
Independent consultant, training and development. I assist clients with the thorny issues; solve their performance problems, their de...
Independent consultant, training and development. I assist clients with the thorny issues; solve their performance problems, their deep Python, Flask, Plone or Zope technical issues, assist teams getting best development practices in place. I offer Python mentoring, 1-on-1 consulting and code reviews. Some sample projects:
- Chief Software Architect for a bespoke CDN implementation, leading the team building the core API, configuration delivery, cache configuration & monitoring architecture, collaboration with DevOps engineers, and was responsible for delivering training. Keywords: RESTFul API, Flask, Python, Go, Varnish, NGINX, Grafana, Loki.
- Architected a scalable machine learning production pipeline, moving the customer from a hand-crafted one-job-at-a-time setup to an auto-scaling clustered solution. Keywords: Apache Airflow, Python, Tensorflow, Pytorch, NVIDIA CUDA.
- Built a high-performance real-time data gathering platform for a data-driven SaaS site in the music business. Keywords: Python, AsyncIO, ShoutCast, PostgreSQL, monitoring, Time-series database, scalability.
- Built an API-driven publishing site with Flask, SQLAlchemy, and Memcached on top of Google App Engine and CloudSQL, serving 17 million pageviews per month with 94% cache efficiency, to millions of unique visitors. Keywords: Python, Databases, Scalability, Flask.
- Created a pipeline to connect DV cameras to a real-time virtual 3D environment in Maya for a TV production company.
- Cleared several performance bottlenecks in Mercurial for large-scale deployments.
Python
Flask
Google App Engine
View more
Python
Flask
Google App Engine
Version control
SQLAlchemy
Memcache
Mentoring
Maya
Hg
View more
Principal Software Engineer
Swvl
2022-02-01-2022-12-01
I led efforts to bring engineering standards to higher levels, mentoring engineers and directors alike, drove changes in source cont...
I led efforts to bring engineering standards to higher levels, mentoring engineers and directors alike, drove changes in source control and code review practices, and worked to address various technical debt and cost management challenges. The latter included work to help test new microservices against production data with read-only proxies for backend databases.
Python
Scalability
JavaScript
View more
Python
Scalability
JavaScript
Rust
Apache Kafka
Go
Open Source Software
Software architecture
View more
Senior Software Engineer
Facebook
2015-10-01-2018-07-01
As part of the Source Control team, I helped keep Facebook engineers productive, against the odds. The Source Control is responsible for ...
As part of the Source Control team, I helped keep Facebook engineers productive, against the odds. The Source Control is responsible for making Mercurial scale (see https://code.facebook.com/posts/218678814984400/scaling-mercurial-at-facebook/) and maintain the repositories (ranging into 6-digit file counts) that back Facebook's website and mobile apps.
I was also part of the cross-company Python Foundation team, supporting the Python language throughout the company, and helped set up the Facebook Open Source Mentorship programme, where I mentored several students to become Open Source contributors.
Some examples of projects I worked on:
* Build out the source control query service. Rather than have other services each create a clone of a repository in order to query this locally, I built a service that lets you query information on repositories, in a scalable and efficient manner.
* Extend the Buck build system to integrate with the mercurial "sparse" feature, automatically expanding a limited view on the working copy to all source files for whatever is currently being built. This helps cut down on performance issues with overly large repositories.
* Rebuild the mercurial sparse subsystem to move it from an implementation detail to a end-user-friendly tool.
Python
Java
Git
View more
Python
Java
Git
Version control
Mentoring
Hg
Open Source Software
Buck
View more