apache / airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
https://airflow.apache.org/
Apache License 2.0
37.08k stars 14.29k forks source link

Add missing logos for integrations #13110

Closed mik-laj closed 3 years ago

mik-laj commented 3 years ago

Hello,

@ecerulm added a logo field for integration object defined in provider.yaml https://github.com/apache/airflow/blob/ccaca0af3933306c7ca0aa3d78fa2237ff3bfb19/airflow/provider.yaml.schema.json#L45-L48

We then use these logos to promote the integrations on our website.

Screenshot 2020-12-16 at 14 59 59

It would be fantastic if we could add the missing logos to make each integration equally fantastic.

Here is an integration list that does not have a logo. If you are interested, you can integrate only to a few integrations and we will still be happy.

$ find . -name provider.yaml | xargs -n 1 yq r --tojson | jq '.integrations | map(select(.logo == null))[] | .["integration-name"]' -r | sort
jq: error (at <stdin>:11): Cannot iterate over null (null)
AWS DataSync
AWS Step Functions
Amazon CloudFormation
Amazon DataSync
Amazon ECS
Amazon ElastiCache
Amazon Glacier
Amazon SecretsManager
Amazon Simple Email Service (SES)
Amazon Web Services
Apache Kylin
Apache Livy
Atlassian Jira
Celery
Databricks
Datadog
Dingding
Discord
Docker
Docker Swarm
Elasticsearch
Exasol
Facebook Ads
File Transfer Protocol (FTP)
Google
Google API Python Client
Google Ads
Google Analytics360
Google BigQuery Data Transfer Service
Google Campaign Manager
Google Cloud
Google Cloud Data Loss Prevention (DLP)
Google Cloud Firestore
Google Cloud Life Sciences
Google Cloud OS Login
Google Cloud Secret Manager
Google Cloud Stackdriver
Google Data Catalog
Google Data Fusion
Google Data Proc
Google Dataprep
Google Deployment Manager
Google Discovery API
Google Display&Video 360
Google Drive
Google Search Ads 360
Google Spreadsheet
Hashicorp Vault
Hypertext Transfer Protocol (HTTP)
IBM Cloudant
Internet Message Access Protocol (IMAP)
Java Database Connectivity (JDBC)
Jenkins
Kubernetes
Microsoft Azure
Microsoft Azure Batch
Microsoft Azure Data Explorer
Microsoft Azure FileShare
Microsoft SQL Server (MSSQL)
MongoDB
MySQL
ODBC
OpenFaaS
Opsgenie
Oracle
Pagerduty
Papermill
Plexus
PostgreSQL
Presto
Qubole
Redis
SQLite
SSH File Transfer Protocol (SFTP)
Salesforce
Samba
Secure Shell (SSH)
Segment
Singularity
Slack
Snowflake
Spark on Kubernetes
Telegram
Vertica
Windows Remote Management (WinRM)
Yandex.Cloud
Yandex.Cloud Dataproc
Zendesk
gRPC

CC: @ecerulm

griffincosgrove commented 3 years ago

newbie here, looking to get my env set up and take this as my first issue.

mik-laj commented 3 years ago

@griffincosgrove I assigned you to this ticket. :-)

griffincosgrove commented 3 years ago

Beginner question: How do I view the home page of the docs with the integrations? I used breeze to build the docs and I can launch other pages, but I cannot find which HTML doc is the home page with the integrations, which file would be airflow.apache.org? Any guidance is appreciated

potiuk commented 3 years ago

http://airflow.apache.org/docs/

griffincosgrove commented 3 years ago

I am saying like the version i built through breeze, does that make sense? Like the page with the integration pictures is the airflow.apache.org

mik-laj commented 3 years ago

@griffincosgrove The website is developed in a separate repository. https://github.com/apache/airflow-site If you want to see what these logos will look like on the site, you should take a few steps:

  1. First update provider.yaml files and add new logos in this repository.
  2. Copy files to airflow-site repository. Thescripts/tools/generate-integrations-json.py script helps with this task.
  3. Build a website using site.sh script - site.sh build-site. See: https://github.com/apache/airflow-site#getting-started
  4. Launch preview - site.sh preview-landing-pages
griffincosgrove commented 3 years ago

@mik-laj ahh that's why I couldn't find it! thanks for pointing this out to me. I appreciate the knowledge. Want to make sure the logos look good!