Add missing connection types and documentation for community providers

Body

Some of Hooks provide connection ability, however quite a few of them do not provide any documentation and/or connection type (missing in the UI). It would be nice if we add missing parts which might help Airflow users.

Hooks Class Attributes reference:

conn_type: Unique connection type, should be also listed in providers.yaml
conn_name_attr: Name of connection attribute, mainly uses for test connections
default_conn_name: Name of default connection, it doesn't do anything if you do not set it directly to conn_name_attr, see as reference SlackHook
hook_name, connection name in dropdown list in the UI

List of Providers and missing/inconsistent hooks class attributes or/and documentation:

[!NOTE]
If someone would like to work on one (or many) just let us know in comments or create PR with reference to this Issue.

alibaba Mixin connections documentation in the single page

[ ] AnalyticDBSparkHook (conn_type = "adb_spark", conn_name_attr = "alibabacloud_conn_id" this one Inconsistent with actual hook attribute "oss_conn_id", hook_name = "AnalyticDB Spark")
[ ] OSSHook (conn_type = "oss", conn_name_attr = "alibabacloud_conn_id" this one Inconsistent with actual hook attribute "oss_conn_id", hook_name = "OSS")

apache.druid

[ ] DruidHook (Missing conn_type, conn_name_attr = "druid_ingest_conn_id").
- [ ] Missing Conn Type/Names: https://github.com/apache/airflow/pull/33796 https://github.com/apache/airflow/pull/35244
- [ ] Documentation
[ ] DruidDbApiHook (conn_type = "druid_broker", conn_name_attr = "druid_broker_conn_id", hook_name = "Druid Broker").
- [ ] Documentation

apache.hdfs ~Mixin connections documentation in the single page~

[x] ~HDFSHook (conn_type = "hdfs", conn_name_attr = "hdfs_conn_id", hook_name = "HDFS")~ Removed in 4.0.0
[x] WebHDFSHook (Missing conn_type, conn_name_attr = "webhdfs_conn_id") #36145

apache.kylin

[x] KylinHook (Missing conn_type, conn_name_attr = "kylin_conn_id") #36413

apache.livy

[x] LivyHook (conn_type = "livy", conn_name_attr = "livy_conn_id", hook_name = "Apache Livy") #36412

apache.pig

[ ] PigCliHook (conn_type = "pig_cli", conn_name_attr = "pig_cli_conn_id", hook_name = "Pig Client Wrapper")

apache.pinot

[ ] PinotAdminHook (conn_type = "pinot_admin", conn_name_attr = "conn_id", hook_name = "Pinot Admin").
- [x] Missing Conn Type/Names: https://github.com/apache/airflow/pull/33601 (thanks @alexbegg)
- [ ] Documentation
[ ] PinotDbApiHook (conn_type = "pinot", conn_name_attr = "pinot_broker_conn_id", hook_name = "Pinot")
- [x] Missing Conn Type/Names: https://github.com/apache/airflow/pull/33601 (thanks @alexbegg)
- [ ] Documentation

apache.spark Mixin connections documentation in the single page.

[x] SparkSubmitHook (conn_type = "spark", conn_name_attr = "conn_id", hook_name = "Spark") #36419
[x] SparkJDBCHook (conn_type = "spark_jdbc", conn_name_attr = "spark_conn_id", hook_name = "Spark JDBC") #36419
[x] SparkSqlHook (conn_type = "spark_sql", conn_name_attr = "conn_id", hook_name = "Spark SQL") #36419

apache.sqoop

[x] ~SqoopHook (conn_type = "sqoop", conn_name_attr = "conn_id", hook_name = "Sqoop")~ Removed in https://github.com/apache/airflow/pull/36460

datadog

[x] DatadogHook (Missing conn_type, conn_name_attr = "datadog_conn_id") https://github.com/apache/airflow/pull/30059

dingding

[ ] DingdingHook (conn_type = "dingding", conn_name_attr = "dingding_conn_id", hook_name = "Dingding")

discord Discord built in top of HTTP Connection with specific settings, which only described in docstring

[x] DiscordWebhookHook (conn_type = "discord", conn_name_attr = "http_conn_id", hook_name = "Discord") https://github.com/apache/airflow/pull/36720

exasol

[ ] ExasolHook (conn_type = "exasol", conn_name_attr = "exasol_conn_id", hook_name = "Exasol")

facebook

[ ] FacebookAdsReportingHook (conn_type = "facebook_social", conn_name_attr = "facebook_conn_id", hook_name = "Facebook Ads"), https://github.com/apache/airflow/issues/25495

google

[ ] GoogleAdsHook (Missing conn_type, conn_name_attr = "google_ads_conn_id")
[ ] LookerHook (Missing conn_type, conn_name_attr = "looker_conn_id", Note: Connection Type has documentation)
[ ] LevelDBHook (conn_type = "leveldb", conn_name_attr = "leveldb_conn_id", hook_name = "LevelDB")
[x] BigQueryHook (conn_type = "gcpbigquery", conn_name_attr = "gcp_conn_id", hook_name = "Google Bigquery"), https://github.com/apache/airflow/issues/29286#issuecomment-1412672082 https://github.com/apache/airflow/pull/38430

hashicorp

[x] VaultHook (conn_type = "vault", conn_name_attr = "vault_conn_id", hook_name = "Hashicorp Vault") https://github.com/apache/airflow/pull/30057

cloudant

[ ] CloudantHook (conn_type = "cloudant", conn_name_attr = "cloudant_conn_id", hook_name = "Cloudant")

atlassian.jira

[x] JiraHook (conn_type = "jira", conn_name_attr = "jira_conn_id", hook_name = "JIRA") https://github.com/apache/airflow/pull/36458

microsoft.azure

[ ] AzureContainerInstanceHook (conn_type = "azure_container_instance", conn_name_attr = "azure_conn_id", hook_name = "Azure Container Instance")

microsoft.psrp

[x] PsrpHook (Missing conn_type, conn_name_attr = "psrp_conn_id") https://github.com/apache/airflow/pull/34766

microsoft.winrm I'm not familiar with WinRM Protocol, but seems like it actually doesn't use SSH Connection, however connection attribute is ssh_conn_id which might confuse end users.

[ ] WinRMHook (Missing conn_type, conn_name_attr = "ssh_conn_id")

openfaas

[ ] OpenFaasHook (Missing conn_type, conn_name_attr = "conn_id")

opsgenie

[x] OpsgenieAlertHook (conn_type = "opsgenie", conn_name_attr = "opsgenie_conn_id", hook_name = "Opsgenie") https://github.com/apache/airflow/pull/36519

pagerduty

[x] PagerdutyHook (conn_type = "pagerduty", conn_name_attr = "pagerduty_conn_id", hook_name = "Pagerduty")
[x] PagerdutyEventsHook (conn_type = "pagerduty_events", conn_name_attr = "pagerduty_events_conn_id", hook_name = "Pagerduty Events")

presto

[x] PrestoHook (conn_type = "presto", conn_name_attr = "presto_conn_id", hook_name = "Presto") https://github.com/apache/airflow/pull/37536

~qubole~

~[ ] QuboleHook (conn_type = "qubole", conn_name_attr = "qubole_conn_id", hook_name = "Qubole")~ suspended provider

redis

[x] RedisHook (conn_type = "redis", conn_name_attr = "redis_conn_id", hook_name = "Redis") https://github.com/apache/airflow/pull/36581

samba

[x] SambaHook (conn_type = "samba", conn_name_attr = "samba_conn_id", hook_name = "Samba") https://github.com/apache/airflow/pull/36543

segment

[ ] SegmentHook (conn_type = "segment", conn_name_attr = "segment_conn_id", hook_name = "Segment")

telegram

[x] TelegramHook (Missing conn_type, conn_name_attr = "telegram_conn_id") https://github.com/apache/airflow/pull/37515

vertica

[ ] VerticaHook (conn_type = "vertica", conn_name_attr = "vertica_conn_id", hook_name = "Vertica")

zendesk

[x] Zendesk (conn_type = "zendesk", conn_name_attr = "zendesk_conn_id", hook_name = "Zendesk") #36423

Committer

[X] I acknowledge that I am a maintainer/committer of the Apache Airflow project.

apache / airflow

Add missing connection types and documentation for community providers #28790

Body

Committer