Speed Up Python

Profiling Python Code

Profiling Python Code

 

Codon

Codon is an open-source, high-performance Python compiler.   It compiles your python code to machine code.   The speed improvement is typically on the order of 50%.  

 

numba

numba can optimize Python code to run faster by using a just-in-time compiler to vectorize the operation.  

Tutorial by Jason Brownlee PhD

 

PySpark

Apache Spark is an engine for executing data science and machine learning.   The open source data processing framework uses distributed and parallel computing to process truly Big Data.   The API hides most of complexity of a distributed processing engine behind simple method calls.   Python is supported via a PySpark library.  

How to Speed Up Your Python Code through PySpark

 

DASK

Dask natively scales Python via parallelism for analytics.