From 9d5d73f89afda6ec1a3f7a97b2b864c3be99c5bc Mon Sep 17 00:00:00 2001 From: Eisuke Date: Thu, 2 Apr 2026 19:37:18 -0400 Subject: [PATCH] Update dataloading.md update electricity price part --- dataloading.md | 1 + 1 file changed, 1 insertion(+) diff --git a/dataloading.md b/dataloading.md index 4b31c5b..2ff92c9 100644 --- a/dataloading.md +++ b/dataloading.md @@ -2,6 +2,7 @@ * For each month from 2017/01 to the latest available month, fetch the zipfile data from the source site via API, extract all csv files inside the zipfile, and concatenate them. * Create the table in Big Query from the first month(2017/01) only. * Append data to the table from 2017/02 up to the latest available month. +* Using a separate python script, append data from the most recent timestamp in the dataset up to the current date.(This is under constrcution) # Henry Hub Natural Gas Data * Use a truncate-and-load (full refresh) strategy.