search

dimitri / pgloader

Migrate to PostgreSQL in a single command!
http://pgloader.io
Other
5.45k stars 548 forks source link

complain about heavy dependencies #1588

Closed saaspeter closed 5 months ago

saaspeter commented 5 months ago

Pgloader is a great project, but I felt a bit unhappy when installing and using it. First, I want to apologize because this issue is not a bug or a feature request; it’s just a complaint about the installation process.

My system is macOS, and I only have about 10 tables that need to be imported from MySQL to PostgreSQL. I was initially planning to write some code myself to read data from MySQL and then insert it into PostgreSQL. Then I discovered pgloader, which seemed like a fantastic project, so I proceeded to run: brew install sbcl. I wasn’t sure what SBCL was for, and to my surprise, the installation on my Mac took several dozen minutes, downloading and installing dozens if not hundreds of packages. I later understood that it was installing Common Lisp and its dependencies. My task is quite simple, and if I had known that this project had such extensive dependencies, I wouldn’t have installed it. I didn’t see any warning about this in the documentation. For me, the cost of using this great tool was very high because of the large and numerous dependencies.

I would suggest clearly stating the project’s dependencies in the documentation, especially the need to install Common Lisp.

Again, I apologize as this is just my personal complaint.

saaspeter commented 5 months ago

It is a good tool, but I met below issues and finally resolved.

  1. pip command install too many dependencies, and upgrade python version automatically.
  2. no privilege on schema of postgresql
  3. heap memory run out
  4. other error message in the log, mainly: duplicate pk(I think it was caused by multi-worker) or foreign key issue (understand it, FK issue is reasonable)