OK, here’s another psutil release. Main highlights of this release are sensors-related APIs. Temperatures It is now possible to retrieve hardware temperatures. The relevant commit is here. Unfortunately this is Linux only. I couldn’t manage to implement this on other platforms mainly for two reasons: On Windows it is hard to do this in a […]
Category: Uncategorized
Patches Welcome
For the last 18 months I have been a full-time Open Source Software maintainer. Since starting that role I have taken over the major maintenance work for upwards of 10 software projects, with a cumulative monthly download count somewhere near the millions. In calendar year 2016 I received 15,000 emails from GitHub, despite religiously unsubscribing […]
Be Careful with Python’s New-Style String Format
This should have been obvious to me for a longer time, but until earlier today I did not really realize the severity of the issues caused by str.format on untrusted user input. It came up as a way to bypass the Jinja2 Sandbox in a way that would permit retrieving information that you should not […]
CF Object Storage
A Cloud Foundry CLI Plugin for Working With Object Storage A new plugin, CF Object Storage, is now available. This plugin provides users with the ability to work with Object Storage directly from the Cloud Foundry CLI. Users can take a look at the containers and objects currently in object storage and access, create and modify them. […]
Data Analytics post Demonetization in India
The demonetisation of ₹500 and ₹1000 banknotes was a policy enacted by the Government of India on 8 November 2016. The announcement was made by the Prime Minister Narendra Modi .PM Modi declared that use of all ₹500 and ₹1000 banknotes would be invalid from midnight and announced the issuance of new ₹500 and ₹2000 […]
Getting the ‘next’ row of data in a pandas dataframe
I’m currently working with stock market trade data that is output from a backtesting engine (I’m working with backtrader currently) in a pandas dataframe. The format of the ‘transcations’ data that is provided out of the backtesting engine is shown below. amount price value date 2016-01-07 00:00:00+00:00 79.017119 195.33 -15434.413883 2016-09-07 00:00:00+00:00 -79.017119 218.84 17292.106354 […]
Getting started with pytest
Pytest is my preferred Python testing library. It makes simple tests incredibly easy to write, and is full of advanced features (and tons of plugins) that help with more advanced testing scenarios. To demonstrate the basics, I’m going to walk through how I’d solve the first couple cryptopals challenges in a test-driven style, using py.test. Spoiler alert: I’m […]
Getting started with pytest
Pytest is my preferred Python testing library. It makes simple tests incredibly easy to write, and is full of advanced features (and tons of plugins) that help with more advanced testing scenarios. To demonstrate the basics, I’m going to walk through how I’d solve the first couple cryptopals challenges in a test-driven style, using py.test. […]
AsyncIO – O futuro do Python mudou completamente!
Tradução do artigo original escrito por Yeray Diaz para o hackernoon: AsyncIO for the working Python developer Eu me lembro do exato momento em que eu pensei, “Uau, isso está lento, aposto que se eu pudesse paralelizar essas chamadas isso voaria!” e então, 3 dias após, eu olhei para o meu código e não pude […]
Dask – A better way to work with large CSV files in Python
In a recent post titled Working with Large CSV files in Python, I shared an approach I use when I have very large CSV files (and other file types) that are too large to load into memory. While the approach I previously highlighted works well, it can be tedious to first load data into sqllite […]
Working with large CSV files in Python
I’m currently working on a project that has multiple very large CSV files (6 gigabytes+). Normally when working with CSV data, I read the data in using pandas and then start munging and analyzing the data. With files this large, reading the data into pandas directly can be difficult (or impossible) due to memory constrictions, […]
Installing Python on OSX (and the necessary modules)
If you need help installing python on OSX, read on. For the last three years, I’ve used a mac for all my development. I love the fact that everything ‘just works’ on the platform. That said, when you get into scientific computing and data analytics, especially with python, you can run into some issues. Just […]
We’ll Miss You, Harry Weller, Our Partner, Mentor, & Friend
Harry Weller, General Partner leading NEA’s east coast venture practice, passed away unexpectedly on November 19, 2016. Please see NEA’s words for Harry. J. R. R. Tolkien, one of Harry’s favorites, said, “A safe fairyland is untrue to all worlds.” Harry never counted on life or decisions or business being safe. He looked into this […]
Yes, You Should Start Your First Programming Project
Imagine for a moment that learning programming is like climbing a mountain. The start of the climb is very steep, and most people end up falling back down. But a fair number of individuals get past this initial slope. They finish an online course or get half-way through an ebook or just generally mess around […]
Piping within pipes
Reproduced with the kind permission of Nathan Eastwood and was first published on his personal blog https://nathaneastwood.github.io/ The magrittr pipe (%>%) has revolutionised the way many people now write R code. I’ve been using R for over 7 years and the pipe has become a staple of my programming conventions. However it was recently brought […]