Skip to content

Commit 8465e2f

Browse files
committed
reassign df with dropped nulls
1 parent ccb15d1 commit 8465e2f

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

scripts/cloud/etl/transactions_cleaning.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -245,7 +245,7 @@ def perform_etl(network_prefix: str, start_date: str, end_date: str) -> None:
245245

246246
transactions = spark.read.parquet(*filtered_files)
247247
result_df = network.transform(transactions)
248-
result_df.na.drop()
248+
result_df = result_df.na.drop()
249249

250250
result_df.createOrReplaceTempView("new_transactions")
251251

0 commit comments

Comments
 (0)