umpirsky / Extraload

Powerful ETL library.
MIT License
34 stars 5 forks source link

Adding Doctrine examples #17

Closed programarivm closed 6 years ago

programarivm commented 6 years ago
  1. Extraload\Extractor\Doctrine\QueryExtractor is added
  2. examples/05_default_doctrine_statement_console.php is created
  3. README update
programarivm commented 6 years ago
programarivm commented 6 years ago

Thanks for the review! QueryExtractor and PreparedQueryExtractor are merged now into AbstractExtractor if this makes more sense.

programarivm commented 6 years ago

Just added one more Doctrine example using a MapFieldsTransformer -- btw I won't push any more examples to this PR until the MapFieldsTransformer example is reviewed.

programarivm commented 6 years ago
programarivm commented 6 years ago

Yeah, it makes sense. $this->data can always be bigger and bigger. Perhaps that is a problem that may be addressed by splitting huge queries into smaller chunks to multiprocess them in parallel.