search

itsrobli / data-transfer-project-real-estate-industry

The goal of this project is to make it really easy and quick to transfer data between participants in the real estate investment management industry.
Apache License 2.0
3 stars 0 forks source link

Design #1

Open itsrobli opened 4 years ago

itsrobli commented 4 years ago

Per @amdk8800

• We should have a look at some of the existing data standards / reference models available. OSCRE and MSCI comes to mind. Private company data submission templates can also be adopted if their use is common enough, an example being URBIS for retail sales; • We may have to collate a fuller set of use cases before deciding on what the generic looks like. This will help us manage the standards – what’s core, what’s a side module, which part will satisfy Retail requirements vs Office, Residential and Industrial. • It is vital to plan for the different systems interoperability requirements from companies of different data maturity level – from small JVs wanting to use CSV/VBA interfaces to larger REIT’s that are wanting API driven workflows; • We may have to do a bit of thinking structuring the various data transform layers and try to decouple them as much as possible. E.g. Client Business Definition, Data Cleansing, Incoming Data Validation.

itsrobli commented 4 years ago

Some links re OSCRE:

https://www.oscre.org/Functions-in-the-OSCRE-Data-Model

OSCRE Conceptual Data Model.pdf Original: https://www.oscre.org/Portals/18/Whitepapers/OSCRE%20Conceptual%20Data%20Model.pdf?ver=2018-06-27-190847-267

mendietaczfls commented 4 years ago

I agree with @amdk8800 and @itsrobli. We need more use cases to formulise the data exchange structure. We need vision, planning and efforts into defining the format, and I reckon it would be no easy.

From the perspective of technology implementation, I suggest we can have a look at Protocol Buffer. It is a strongly typed interface description language that provides strong validated data format. Paired with gRPC or even REST, strongly typed data format can deliver much faster client-server communication performance than JSON + REST. As a reference, here is how Google Implement FHIR standards using Protocol Buffers. https://github.com/google/fhir

itsrobli commented 3 years ago

I'm very inspired by this: https://github.com/google/data-transfer-project

mendietaczfls commented 3 years ago

Just had another read of the updated README, @itsrobli great job of converting complex concepts into easy read! The host platform reminds me of blockchain node :)

itsrobli commented 3 years ago

The host platform reminds me of blockchain node :)

Aha! Now there's an idea to get some attention! 😃