airbytehq / PyAirbyte

PyAirbyte brings the power of Airbyte to every Python developer.
https://docs.airbyte.com/pyairbyte
Other
178 stars 20 forks source link

Fix: Improve progress updates, including list of streams finalized #147

Closed aaronsteers closed 3 months ago

aaronsteers commented 3 months ago

A small update. This brings back the print of processed stream names.

For example:

                                                                             Read Progress                                                                              

Started reading at 23:31:01.                                                                                                                                            

Read 20,100 records over 2 seconds (10,050.0 records / second).                                                                                                         

Wrote 20,100 records over 3 batches.                                                                                                                                    

Finished reading at 23:31:03.                                                                                                                                           

Started finalizing streams at 23:31:03.                                                                                                                                 

Finalized 3 batches over 8 seconds.                                                                                                                                     

Completed 3 out of 3 streams:                                                                                                                                           

 • purchases                                                                                                                                                            
 • products                                                                                                                                                             
 • users                                                                                                                                                                

Completed writing at 23:31:12. Total time elapsed: 11 seconds 

Previously was missing this block:

Completed 3 out of 3 streams:                                                                                                                                           

 • purchases                                                                                                                                                            
 • products                                                                                                                                                             
 • users