search

darshilparmar / uber-etl-pipeline-data-engineering-project

194 stars 130 forks source link

The Kernel is crashing in the jupyter notebook. #8

Open divyatgottipati opened 2 months ago

divyatgottipati commented 2 months ago

The kernel is crashing when executing the merge code to create the fact table. Darshil, could you please help me troubleshoot this issue?

divakaivan commented 2 weeks ago

For anyone else facing this issue, this is my easy fix: 

return datetime_dim, passenger_count_dim, trip_distance_dim, rate_code_dim, pickup_location_dim, dropoff_location_dim, payment_type_dim, fact_table

Or any variation like that where we do not return them all as .to_dict. In the video case, seems now mage wants to print every dictionary which is a lot of data, so the kernel stops. Make sure to edit the code in the data_extractor block to BigQuery as well.