Data pipelines in Rails and Postgres

rubyaustralia / melbourne-ruby

Organisers notes and processes

53 stars 5 forks source link

Data pipelines in Rails and Postgres #176

Closed saramic closed 3 years ago

saramic commented 3 years ago

the nuts and bolts of how to insert and upsert data quickly in Rails and Postgresql using both the gem activerecord-import and Rails 6 new insert_all and upsert_all command. Also some thoughts on how to do data processing in Ruby using the chaining then to compose data transformations.

follow my progress on the talk here -> https://github.com/failure-driven/data-pipelines-in-ruby

should be good to go for July meetup

optimistic-updt commented 3 years ago

Awesome @saramic, looking forward to hear about it. I guess I'll ask you later on long you think this one will be :)

optimistic-updt commented 3 years ago

Hey @saramic, Confirming you are all still good to present at this wednesday RORO ? :) See you then

saramic commented 3 years ago

yeah all good - probably be ~30min but will try to cut it shorter if I can

optimistic-updt commented 3 years ago

no stress. I'm still looking for a lighting talk contender !