Closed beherap closed 1 year ago
@beherap I will reach out to the internal team that deals with information_schema to see what they say. I was under the impression that these two work the same way.
Please feel free to ping me again if it looks like I forgot about this ticket!
@sfc-gh-mkeller Thank you for looking into this one. I refactored the code a bit to use the show columns
statement. I am going to create a PR for this shortly.
@sfc-gh-mkeller Is it possible for you to add me as a contributor to the repo?
I’m sorry, I cannot!
On Dec 22, 2020, at 23:55, Pb notifications@github.com wrote:
@sfc-gh-mkeller Is it possible for you to add me as a contributor to the repo?
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.
I’m sorry, I cannot! … On Dec 22, 2020, at 23:55, Pb @.***> wrote: @sfc-gh-mkeller Is it possible for you to add me as a contributor to the repo? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.
@sfc-gh-mkeller Alright! Did you have a chance to connect with the internal team yet? Thanks!
See this How to article posted November 2020. It states show queries use a special cache for better performance, but with a limitation of 10k records. You already have some try catch logic in the snowdialect for the information catalog. If snowflake throws some sort indication that 10k threshold has been exceeded, could probably adapt it to first try with show and if it exceeds 10k then retry with the information catalog. Another advantage is "show" does not require a running warehouse to execute.
Hi @datGnomeLife! Thank you for the update.
Sounds like the preference of using information_schema.columns
over show columns
is due to the 10k threshold limitation. Is that somewhat correct?
I would also be interested in knowing why that is the case as I have a similar question to this one here: https://github.com/snowflakedb/snowflake-sqlalchemy/issues/221
To clean up and re-prioritize bugs and feature requests we are closing all issues older than 6 months as of Apr 1, 2023. If there are any issues or feature requests that you would like us to address, please re-create them. For urgent issues, opening a support case with this link Snowflake Community is the fastest way to get a response
Please answer these questions before submitting your issue. Thanks!
python --version
)?Python 3.7.6
python -c 'import platform; print(platform.platform())'
)?Darwin-19.4.0-x86_64-i386-64bit
pip list
)?