cal-itp / data-infra

Cal-ITP data infrastructure
https://docs.calitp.org/data-infra
GNU Affero General Public License v3.0
48 stars 12 forks source link

Hubspot integration with Data Warehouse #1961

Open AnthonyRollins opened 1 year ago

AnthonyRollins commented 1 year ago

Is your feature request related to a problem? Please describe. Currently, we have 16 new GTFS Feature properties added to the Company object in Hubspot, which will be updated using data manually entered in from Airtable. The 16 new properties are divided into two main categories, GTFS Schedule and GTFS-rt. Each GTFS Feature has its stage, for example, GTFS Schedule: Compliance with the same status across all 16 properties (for example, Assessment Pending, Not Applicable, etc.). Here's the list of all properties and the list of all statutes applied to them:

Properties

Statuses

Describe the solution you'd like We want to set up an integration from the Data Warehouse to Hubspot using Hubspot’s API. As the data warehouse pulls in data from Airtable, we would like it to push the status to the above 16 properties. In addition, we would like it so that when someone manually updates these statuses in Airtable, that info is pushed into Hubspot on a weekly basis.

Describe alternatives you've considered We tried to set up an integration with Airtable. Still, through a few meetings, our best option is to set up an integration with the warehouse, where the warehouse would ingest the data from Airtable and then push it to Hubspot.

Additional context Use Case: Why the Customer Success, GTFS features and others need this integration The integration would make it easier for the team to find all GTFS feature information in Hubspot rather than going to Airtable or other future platforms. This is especially important for future Caltrans staff members taking over, who may have less knowledge of navigating Airtable and will reduce the friction in needing to open another application.

Over the next few months, we expect an increase in Inbound comms to Cal-ITP, with new marketing pushes/content coming on MobiMart in December and 2023. This increase in comms will require the Customer Success team to continue using Airtable rather than using Hubspot as the one-stop shop for agency information. The lighter-weight solution (instead of an integration) would be to manually input information into two platforms; Airtable and Hubspot. Airtable is currently the place where this info will be manually added, and from there, status changes would need to be copied over for all 16 properties on every agency profile. Additionally, other Cal-ITP team members would need easy access to this information because of ongoing data assessments, responding to customer support needs, and for those wanting a quick view into the status of an agency.

Outside of the GTFS properties, we will also need the integration between Hubspot and the Data warehouse to start pushing reporting data through the database to Metabase so that all reporting information can be held in one place for Cal-ITP.

All GTFS Feature properties are set up as dropdown fields, where the user can choose only one status.

The Hubspot CRM API documentation is where developers can find information on how to update Company objects and their fields:

https://developers.hubspot.com/docs/api/crm/understanding-the-crm https://developers.hubspot.com/docs/api/crm/companies

holly-g commented 1 year ago

Hi @AnthonyRollins, from what I understand, you'll be updating this ticket with more information. Thanks!

AnthonyRollins commented 1 year ago

@holly-g

I added additional context to the issue above and included the language below.

Additional context Use Case: Why the Customer Success, GTFS features and others need this integration The integration would make it easier for the team to find all GTFS feature information in Hubspot rather than going to Airtable or other future platforms. This is especially important for future Caltrans staff members taking over, who may have less knowledge of navigating Airtable and will reduce the friction in needing to open another application.

Over the next few months, we expect an increase in Inbound comms to Cal-ITP, with new marketing pushes/content coming on MobiMart in December and 2023. This increase in comms will require the Customer Success team to continue using Airtable rather than using Hubspot as the one-stop shop for agency information. The lighter-weight solution (instead of an integration) would be to manually input information into two platforms; Airtable and Hubspot. Airtable is currently the place where this info will be manually added, and from there, status changes would need to be copied over for all 16 properties on every agency profile. Additionally, other Cal-ITP team members would need easy access to this information because of ongoing data assessments, responding to customer support needs, and for those wanting a quick view into the status of an agency.

Outside of the GTFS properties, we will also need the integration between Hubspot and the Data warehouse to start pushing reporting data through the database to Metabase so that all reporting information can be held in one place for Cal-ITP.