Implement IRCPA.org select content to PB

[johnsisland]

(old ticket system notes)

HEADS UP Issue #7009 has been updated by Robyn Flick. Can we keep this ticket item open? Or is this going to become a new ticket once we are ready to proceed? What is the estimated cost to us for this task and how does this work now that we are paying a monthly retainer fee?

Chore #7009: JIRE database - Info from IRCPA.org Author: Robyn Flick Status: Closed Priority: Normal Assignee: Robyn Flick Category: Target version: Environment: production Can you provide us with an estimate associated with extracting the data from the following fields via http://www.ircpa.org to be added to our new database?

IRCPA.org website content to map to PB:

Base Tab:

• Parcel number
• Legal description (paragraph of text that varies based on property type, etc)
• Official record book & page:

(if applicable) Improvement Tab:

• Exterior Wall info
• Roof Data
• Year Built

We would integrate this into the new PropertyBase database by matching the above info to our record's address field - How do we match records?

You can isolate the IRCPA data by "neighborhood"...assuming that "090040.00-Johns Island" would capture all of our data needed for JI.

Possible issue will be how the new data is matched to our records.

Thoughts?

Robyn Flick Marketing Director

[johnsisland]

Cody, Can you provide an estimate for implementing the above IRCPA data to PB on a regular basis? Also how much time will you need? This week PB is going to migrate our csv TeleMagic files into PB...so we can start testing. How much will this feature cost and how long will you need?

[CodySwannGT]

OK. So - you want me to add these data points to Refinery:

Parcel number Legal description (paragraph of text that varies based on property type, etc) Official record book & page Exterior Wall info Roof Data Year Built

In order to do that, I need you to give me an example for each datapoint.

For example, obviously Year Built is a year like "2007"

But what do all the other data points look like?

Second - where would I be getting this data from? Are you going to manually input all this data? Or am I pulling it from somewhere automatically?

Third - Am I sending this data anywhere (other than PropertyBase when I sync the records)?

[johnsisland]

Hi Cody, I'm not sure how to answer these questions b/c it's incorrect. Look at the original request, is best. We would like to automatically update PropertyBase (not refinery) with www.IRCPA.org data. Is this something you can help us with, if so, what would it cost and time needed? We would add these fields to PropertyBase's PROPERTY/LISTING objects. thanks!

[CodySwannGT]

Correct. But it's actually MORE difficult to go directly from IRCPA -> PropertyBase.

It makes much more sense to go IRCPA -> Refinery -> PropertyBase because we already have that connection.

Now, to your point, we don't have to display this information in refinery. It can just be hidden.

That leaves my original question - how do I get the data from IRCPA?

[johnsisland]

The first time we asked you about this, you made it appear as if you could do this via PropertyBase. I don't know who is able to do what we're asking, but the MLS does pull from IRCPA.org. We need to find someone who can figure it out for us. Are you the one? Do we need to start asking PB? We need to know how to solve this request.

[CodySwannGT]

The implementation doesn't really matter here. Only the results, which can be obtained.

The only thing that's in question is How do I get the data from IRCPA.org? Do they have a contact person? Or a documented API?

On Thu, Jul 23, 2015 at 1:45 PM, johnsisland notifications@github.com wrote:

The first time we asked you about this, you made it appear as if you could do this via PropertyBase. I don't know who is able to do what we're asking, but the MLS does pull from IRCPA.org. We need to find someone who can figure it out for us. Are you the one? Do we need to start asking PB? We need to know how to solve this request.

— Reply to this email directly or view it on GitHub https://github.com/gunnertech/jire2/issues/147#issuecomment-124178498.

Cody Swann - CEO, Gunner Technology T: 213.915.4083 | cody@gunnertech.com | www.gunnertech.com http://www.gunnertech.com/Skype: cody.swann

CONFIDENTIALITY NOTICE: This email message, together with any documents, files and/or email messages attached to it, is intended for the sole use of the individual or entity to whom it is addressed, and may contain information that is legally privileged, confidential and restricted from disclosure. If you are not the intended recipient, or responsible for delivery to that person, you are hereby notified that any dissemination or copying of this communication is STRICTLY PROHIBITED. In such case please notify the sender by reply email and delete this message without reading, printing or saving.

[johnsisland]

I called their IT department and spoke to Dean (IT) 772-226-1555. Twice a month their data goes straight into the local MLS (paid service). The other option is to go to the download site that is updated every night: Public-IRCPA.org (Access database). He will answer any questions you have. Is this something you need to do for us, or in your opinion, something that PropertyBase can help us with?

[CodySwannGT]

No way. I wouldn't have them do anything with this.

And I was under the assumption someone already told you how to access the data, so I apologize.

But what you've told me from Dean is certainly enough to get me going.

How long it will take is tough to say because I don't know what they're access rights and data formats are.

But I can say that, as soon as I figure all that out, it's like a 1-2 week thing. Not a big deal at all.

On Thu, Jul 23, 2015 at 2:09 PM, johnsisland notifications@github.com wrote:

I called their IT department and spoke to Dean (IT) 772-226-1555. Twice a month their data goes straight into the local MLS (paid service). The other option is to go to the download site that is updated every night: Public-IRCPA.org (Access database). He will answer any questions you have. Is this something you need to do for us, or in your opinion, something that PropertyBase can help us with?

— Reply to this email directly or view it on GitHub https://github.com/gunnertech/jire2/issues/147#issuecomment-124190453.

Cody Swann - CEO, Gunner Technology T: 213.915.4083 | cody@gunnertech.com | www.gunnertech.com http://www.gunnertech.com/Skype: cody.swann

CONFIDENTIALITY NOTICE: This email message, together with any documents, files and/or email messages attached to it, is intended for the sole use of the individual or entity to whom it is addressed, and may contain information that is legally privileged, confidential and restricted from disclosure. If you are not the intended recipient, or responsible for delivery to that person, you are hereby notified that any dissemination or copying of this communication is STRICTLY PROHIBITED. In such case please notify the sender by reply email and delete this message without reading, printing or saving.

[johnsisland]

I don't think we need to do anything right now, because we're waiting to hear from PropertyBase when the "test" data migration is complete. Once they are done, we need you to retest your web to PB stuff. Once we confirm everything appears to be working, we can then add the IRCPA data and test.

[CodySwannGT]

Sounds good to me. And I can begin researching if they take long.

On Thursday, July 23, 2015, johnsisland notifications@github.com wrote:

I don't think we need to do anything right now, because we're waiting to hear from PropertyBase when the "test" data migration is complete. Once they are done, we need you to retest your web to PB stuff. Once we confirm everything appears to be working, we can then add the IRCPA data and test.

— Reply to this email directly or view it on GitHub https://github.com/gunnertech/jire2/issues/147#issuecomment-124214347.

Cody Swann - CEO, Gunner Technology T: 213.915.4083 | cody@gunnertech.com | www.gunnertech.com http://www.gunnertech.com/Skype: cody.swann

CONFIDENTIALITY NOTICE: This email message, together with any documents, files and/or email messages attached to it, is intended for the sole use of the individual or entity to whom it is addressed, and may contain information that is legally privileged, confidential and restricted from disclosure. If you are not the intended recipient, or responsible for delivery to that person, you are hereby notified that any dissemination or copying of this communication is STRICTLY PROHIBITED. In such case please notify the sender by reply email and delete this message without reading, printing or saving.

[johnsisland]

We're ready to move this along. Hope to have it done by end of June? I've asked our staff to review the IRCPA fields they desire and where they would map to in PB.

[CodySwannGT]

You know.... I'm just never going to say "It shouldn't be that difficult" ever again. Because this is what happens.

So, bottomline is, IRCPA makes this as difficult as it possibly could be.

What they provide is a snapshot every night of their database, which you can download and insert into your own database.

That's fine and dandy if you want to run queries against on local machine, but nearly worthless for a web app to access them.

Here's what we'd have to do to make this work:

1) Create a separate app on a new server environment (instead of JIRE, call it JIRE-IRCPA or JIRE API or something like that) 2) Create a new database on a new database server 3) Write code for the new app to go each night and grab the data from IRCPA's website 4) Write code that will insert all the new data into the new database 5) Write an api for the main app (JIRE) to consume (i.e. Give me data for "153 Llywn's Lane") 6) Parse the API for the data we want and insert it into refinery 7) Add those fields to the PB mapping

I thought that IRCPA would provide the API for us (which they don't)

I'd say we're looking at a 75 hour project here. Again. Completely doable but not at all as straightforward as I was thinking.