This tutorial details how AWS Lambda and API Gateway can be used to develop a simple code evaluation API, where an end user submits code, via an AJAX form submission, which is then executed securely by a Lambda function. Check out the live demo of what you’ll be building in action here. WARNING: The code […]
Category: Data Analytics
Code Evaluation with AWS Lambda and API Gateway
This tutorial details how AWS Lambda and API Gateway can be used to develop a simple code evaluation API, where an end user submits code, via an AJAX form submission, which is then executed securely by a Lambda function. Check out the live demo of what you’ll be building in action here. WARNING: The code […]
Data Science Things Roudup #11
Once again time for the data science things roundup, a few links of articles or projects I’ve stumbled across and found interesting. This is the 11th one in the extremely irregular series, so if you think it’s cool, check out some of the others: This time we’ve got quite a diverse set of links, so […]
Python and AWS Lambda – A match made in heaven
In recent months, I’ve begun moving some of my analytics functions to the cloud. Specifically, I’ve been moving them many of my python scripts and API’s to AWS’ Lambda platform using the Zappa framework. In this post, I’ll share some basic information about Python and AWS Lambda…hopefully it will get everyone out there thinking about new ways […]
Stock market forecasting with prophet
In a previous post, I used stock market data to show how prophet detects changepoints in a signal (http://pythondata.com/forecasting-time-series-data-prophet-trend-changepoints/). After publishing that article, I’ve received a few questions asking how well (or poorly) prophet can forecast the stock market so I wanted to provide a quick write-up to look at stock market forecasting with prophet. This […]
Loading Data into Postgres using Python and CSVs
An introduction to Postgres with Python Data storage is one of (if not) the most integral parts of a data system. You will find hundreds of articles online detailing how to write insane SQL analysis queries, how to run complex machine learning algorithms on petabytes of training data, and how to build statistical models on […]
How to Generate FiveThirtyEight Graphs in Python
If you read data science articles, you may have already stumbled upon FiveThirtyEight’s content. Naturally, you were impressed by their awesome visualizations. You wanted to make your own awesome visualizations and so asked Quora and Reddit how to do it. You received some answers, but they were rather vague. You still can’t get the graphs […]
psutil 5.3.0 with full Unicode support is out
psutil 5.3.0 is finally out. This release is a major one, as it includes tons of improvements and bugfixes, probably like no other previous release. It is interesting to notice how huge the diff between 5.2.2 and 5.3.0 is. This is due to the fact that I’ve been travelling quite a lot this year, so I kept […]
Spawning subprocesses smartly and securely
As part of your code, you may be inclined to call a command to do something. But is it always a good idea? How to do it safely? What happens behind the scenes? This article is written from a general perspective, with a Unix/C bias and a very slight Python bias. The problems mentioned apply […]
Forecasting Time Series data with Prophet – Trend Changepoints
In these posts, I’ve been looking at using Prophet to forecast time series data at a monthly level using sales revenue data. In this post, I want to look at a very interesting aspect of Prophet (and time series analysis) that most people overlook – that of trend changepoints. This is the fourth in a […]
Importing data from csv file using PySpark
There are two ways to import the csv file, one as a RDD and the other as Spark Dataframe(preferred) !pip install pyspark from pyspark import SparkContext, SparkConf sc =SparkContext() A SparkContext represents the connection to a Spark cluster, and can be used to create RDD and broadcast variables on that cluster. https://spark.apache.org/docs/latest/rdd-programming-guide.html#overview To create a […]
Machine Learning Fundamentals: Predicting Airbnb Prices
Machine learning is easily one of the biggest buzzwords in tech right now. Over the past three years Google searches for “machine learning” have increased by over 350%. But understanding machine learning can be difficult — you either use pre-built packages that act like ‘black boxes’ where you pass in data and magic comes out […]
User Authentication with Angular 4 and Flask
In this tutorial, we’ll demonstrate how to set up token-based authentication (via JSON Web Tokens) with Angular 4 and Flask. Main Dependencies: Angular v4.2.4 (via Angular CLI v1.3.2) Flask v0.12 Python v3.6.2 Auth Workflow Here’s the full user auth process: Client logs in and the credentials are sent to the server If the credentials are […]
User Authentication With Angular 4 and Flask
In this tutorial, we’ll demonstrate how to set up token-based authentication (via JSON Web Tokens) with Angular 4 and Flask. Main Dependencies: Angular v4.2.4 (via Angular CLI v1.3.2) Flask v0.12 Python v3.6.2 Free Bonus: Click here to get access to a free Flask + Python video tutorial that shows you how to build Flask web […]
Python Cheat Sheet for Data Science: Intermediate
The printable version of this cheat sheet The tough thing about learning data is remembering all the syntax. While at Dataquest we advocate getting used to consulting the Python documentation, sometimes it’s nice to have a handy reference, so we’ve put together this cheat sheet to help you out! This cheat sheet is the companion […]