search

ukwa / ukwa-services

Deployment configuration for all UKWA services stacks.
Apache License 2.0
4 stars 5 forks source link

DAG to fix up Twitter URLs #107

Open anjackson opened 1 year ago

anjackson commented 1 year ago

Add a DAG to Airflow to fix up Twitter URLs in W3ACT. This works:

UPDATE field_url SET url = url || '/' WHERE url SIMILAR TO 'http(s|)://(www.|)twitter.com/[a-zA-Z0-9_]+';

...but need wrapping up as a DAG task.