bi_exercise

The code for fetching data from S3 bucket, upload data to remote postgresql db and visualize data.

Prerequisites

• AWS CLI configuration
• installing code dependencies:

virtualenv env
pip install -r requirements.txt

• Change database connection params in config/database.ini

Data loading

python main.py

SQL function code

The function code for Cumulative Distribution calculation could be found in plpgsql/cdf.sql

Data visualisation

python plot_cdf.py

Results

Cumulative Dist for all records

Cumulative Dist for [2019-12-18, 2020-01-03] window

Clumulative Dist for [2020-01-29, 2020-01-30] window