singer-io / tap-typeform

Singer.io tap for extracting TypeForm data
GNU Affero General Public License v3.0
11 stars 20 forks source link

Incomplete data #6

Open Magicbeanbuyer opened 5 years ago

Magicbeanbuyer commented 5 years ago

Hello Typeform Tap maintainers,

I recently tried to use Stitch to import Typeform survey to our database, however, for all the forms imported, the data are incomplete in questions , landings and answers tables.

I tried to run the tap on my machine, and for questions , landings and answers tables, zero rows are loaded.

Could you help me to find out the reason behind this? Thank you very much!

All the best, Vanessa

KAllan357 commented 5 years ago

@Magicbeanbuyer When you say incomplete - do you mean that there are rows, but certain columns are missing? Can you clarify?

As for running the tap locally, I think this indicates that maybe your Catalog was not configured with any selections. A recent contribution from the community is a handy tool for editing the catalog.json that might help: https://github.com/chrisgoddard/singer-discover

mplovepop commented 5 years ago

If she's experiencing the same issue I am, it's that sub-questions are stored as properties on the question. The question stream only includes id, title, and ref, and does not include properties. Thus, sub-fields (sub-question responses) still come through on the answers stream, but there is no question_id in the questions stream to tie them to.

I would also like to +1 this issue. If I have time to dig into this I'll open a pull request.