modelsconf2018 / artifact-evaluation

2 stars 6 forks source link

[bucchiarone] Smart Mobility Planning #12

Open grammarware opened 6 years ago

grammarware commented 6 years ago

Submitted by @antbucc to https://github.com/modelsconf2018/artifact-evaluation/tree/master/bucchiarone

Paper: https://github.com/modelsconf2018/artifact-evaluation/blob/master/bucchiarone/Bucchiarone_Cicchetti.pdf

AEReview commented 6 years ago

Dear @antbucc and Antonio, Would it be possible to get a link to your accepted paper? Thanks in advance.

grammarware commented 6 years ago

2 @antbucc: if you don't want to expose it to the internets, email me and I'll forward it to @AEReview. This is just for the purpose of reviewing. Thanks in advance!

antbucc commented 6 years ago

I did it. What is missing yet?

moji1 commented 6 years ago

Hi @antbucc I have tried the SmartJP and related modeling applications. The smartJP works properly, and related documentation is OK, but the documentation related to the modeling parts requires improvements mainly:

Thanks Moji

antbucc commented 6 years ago

Hi, what we can do is to realize a small video showing the step by step execution of what you are asking. The only problem I see is the schedule. We could it starting from next week. Is it ok?

Regards Antonio

On Mon, Jul 16, 2018 at 9:02 PM, moji1 notifications@github.com wrote:

Hi @antbucc https://github.com/antbucc I have tried the SmartJP and related modeling applications. The smartJP works properly, and related documentation is OK, but the documentation related to the modeling parts requires improvements mainly:

-

To define an instance of the models, users need to run the EMF project as an eclipse application and then define a new instance, etc. Please improve the documentation to include detail steps for defining models. It may be hard for a beginner user to figure out these steps.

No instruction is provided for generating the code from defined models, and how to use the prototype to address a specific use case. I suggest you select a simple use case and provide a step by step instruction to show the prototype can be used to address the chosen use case. With current instruction, users can run each part, but it is not clear how different parts are integrated to solve a problem.

Thanks Moji

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/modelsconf2018/artifact-evaluation/issues/12#issuecomment-405346121, or mute the thread https://github.com/notifications/unsubscribe-auth/ACiRmS7Zy7qGpFASUjbbnhrzQ0Ion1AGks5uHONLgaJpZM4VOIPd .

--

Le informazioni contenute nella presente comunicazione sono di natura  privata e come tali sono da considerarsi riservate ed indirizzate  esclusivamente ai destinatari indicati e per le finalità strettamente  legate al relativo contenuto. Se avete ricevuto questo messaggio per  errore, vi preghiamo di eliminarlo e di inviare una comunicazione  all’indirizzo e-mail del mittente.

-- The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. If you received this in error, please contact the sender and delete the material.

grammarware commented 6 years ago

Dear @antbucc,

The decision about the artefact will have to be taken on Wednesday this week so that you will have until Saturday this week to integrate the badge into the camera ready version of the paper. Whatever happens next week, as useful as it might be, will have no impact on this evaluation.

Yours, Vadim.

zolotas4 commented 6 years ago

Hi,

Although the SmartJP interface starts in localhost, I am not able to create plans with all the transit means (e.g., Bus) in Trento. I receive a message saying that there are no transit times available. Is this because I need to create the models that include the transit times? I wasn't able to find the example mobility resources and map notes models which you demo in the Youtube video. Could you please provide those (or if they are already available, could you please point me to those in the repository)? These models would be very useful for me to test the transformations as well.

Regards, Thanos

antbucc commented 6 years ago

Dear Thanos to receive results you need to define the depart/arrive dates before 07 June 2018. This is related to the GTFS file, of the Trento Public transports, that is included in the current version of the planner you are executing.

Please try to set the current date and let me know if everything is ok.

Regards Antonio

On Tue, Jul 17, 2018 at 9:11 AM, Thanos Zolotas notifications@github.com wrote:

Hi,

Although the SmartJP interface starts in localhost, I am not able to create plans with all the transit means (e.g., Bus) in Trento. I receive a message saying that there are no transit times available. Is this because I need to create the models that include the transit times? I wasn't able to find the example mobility resources and map notes models which you demo in the Youtube video. Could you please provide those (or if they are already available, could you please point me to those in the repository)? These models would be very useful for me to test the transformations as well.

Regards, Thanos

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/modelsconf2018/artifact-evaluation/issues/12#issuecomment-405482846, or mute the thread https://github.com/notifications/unsubscribe-auth/ACiRmQPvLahRWb_esD7LD8CYQ31CXAUaks5uHY4hgaJpZM4VOIPd .

--

Le informazioni contenute nella presente comunicazione sono di natura  privata e come tali sono da considerarsi riservate ed indirizzate  esclusivamente ai destinatari indicati e per le finalità strettamente  legate al relativo contenuto. Se avete ricevuto questo messaggio per  errore, vi preghiamo di eliminarlo e di inviare una comunicazione  all’indirizzo e-mail del mittente.

-- The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. If you received this in error, please contact the sender and delete the material.

antbucc commented 6 years ago

Ok, we decided to extend our text (in the README file) explaining better what you are asking. We do it by Wednesday at 12.

Regards Antonio

On Mon, Jul 16, 2018 at 11:44 PM, Vadim Zaytsev notifications@github.com wrote:

Dear @antbucc https://github.com/antbucc,

The decision about the artefact will have to be taken on Wednesday this week so that you will have until Saturday this week to integrate the badge into the camera ready version of the paper. Whatever happens next week, as useful as it might be, will have no impact on this evaluation.

Yours, Vadim.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/modelsconf2018/artifact-evaluation/issues/12#issuecomment-405391410, or mute the thread https://github.com/notifications/unsubscribe-auth/ACiRmXrfcmbXsKvYXGplRGbH4gRr0tL9ks5uHQkygaJpZM4VOIPd .

--

Le informazioni contenute nella presente comunicazione sono di natura  privata e come tali sono da considerarsi riservate ed indirizzate  esclusivamente ai destinatari indicati e per le finalità strettamente  legate al relativo contenuto. Se avete ricevuto questo messaggio per  errore, vi preghiamo di eliminarlo e di inviare una comunicazione  all’indirizzo e-mail del mittente.

-- The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. If you received this in error, please contact the sender and delete the material.

zolotas4 commented 6 years ago

Hi Antonio,

Yes, I set the date before 07/06/18 and it now works. Thanks.

What about the example models you have in the Youtube video?

Regards, Thanos

antbucc commented 6 years ago

Dear Thanks, if the date is before 07 June it should work. Pay attention also to the source and destination you select. Probably you have selected places where there is no bus service that serves the specific zone.

Let me know Antonio

On Tue, Jul 17, 2018 at 9:33 AM, Thanos Zolotas notifications@github.com wrote:

Hi Antonio,

Yes, I set the date before 07/06/18 and it now works. Thanks.

What about the example models you have in the Youtube video?

Regards, Thanos

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/modelsconf2018/artifact-evaluation/issues/12#issuecomment-405488249, or mute the thread https://github.com/notifications/unsubscribe-auth/ACiRmVND3gl2mZqpqH54aCWJMs8Jt6m4ks5uHZNdgaJpZM4VOIPd .

--

Le informazioni contenute nella presente comunicazione sono di natura  privata e come tali sono da considerarsi riservate ed indirizzate  esclusivamente ai destinatari indicati e per le finalità strettamente  legate al relativo contenuto. Se avete ricevuto questo messaggio per  errore, vi preghiamo di eliminarlo e di inviare una comunicazione  all’indirizzo e-mail del mittente.

-- The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. If you received this in error, please contact the sender and delete the material.

zolotas4 commented 6 years ago

Hi Antonio,

I was able to make it work when I set the date before 07 June. That's fine. My question is if we can have mobility resources and map notes example models (possibly those small ones used in the Youtube video) as creating our owns would be time consuming.

Thanos

AEReview commented 6 years ago

** Summary The paper presents a MDE-based solution for smart journey planning, more particularly, planner that are able to take into account various concerns from various stakeholders as well as contextual information, such as weather conditions, urban environment modifications, availabilities of dynamic ressources, etc. The paper presents how MDE can be leveraged to express heterogeneous concerns through the use of DSLs, and how these concerns/preferences can be translated and consumed by actual planners.

** Consistent with the paper The available metamodels are consistent with the excerpt proposed in the paper, though it is not straightforward to find them in the different plugins.

** As complete as possible After the demo on the web app, I am currently missing pre-developed models from the various MobilityView plugins. Currently, I am a bit lost in between the Eclipse projects and what is shown in the artifact page and little ways to easily progress. I would recommend that the authors also provide the models that were used, and a bit of guidance, in order to follow the flow of the artifact page.

** Well-documented The authors took cautious steps to describe the overall process of the web app demo.

Unfortunately, the modeling part is far less documented, and I am missing a clear view of what is required from the reader, what is provided by the authors, what steps a reader needs to take in order to run an example. For instance, the information about the need of Eclipse Modeling and Acceleo is scattered in the text. Though it is explicitly documented, I felt like I had a bad surprise when I figured out I was missing Acceleo on the configuration I was setting up (my bad). Remediation actions were not hard to take, but a complete list of system requirements would be appreciated to avoid « bad surprises ».

More importantly, I’m currently missing some description and walkthrough to the different plugins. Both plugins have no particular instruction or guidance. A step-by-step walkthrough would be much appreciated on a given use case so that a reader can have a global comprehension of the artifact. Currently, I am able to run individual tasks, but I’m lacking an integrated view.

** Easy to (re)use One can play quite easily with the web application. However, looking at the details of the developments is more demanding since the use of the different plugins is not described. In particular, There are no already available examples and walkthrough that a user could leverage without having to create instances.

antbucc commented 6 years ago

We are finalizing it by this night to answer all your points. I will update you soon.

Regards

Antonio

On Tue, Jul 17, 2018 at 6:16 PM, AEReview notifications@github.com wrote:

** Summary The paper presents a MDE-based solution for smart journey planning, more particularly, planner that are able to take into account various concerns from various stakeholders as well as contextual information, such as weather conditions, urban environment modifications, availabilities of dynamic ressources, etc. The paper presents how MDE can be leveraged to express heterogeneous concerns through the use of DSLs, and how these concerns/preferences can be translated and consumed by actual planners.

** Consistent with the paper The available metamodels are consistent with the excerpt proposed in the paper, though it is not straightforward to find them in the different plugins.

** As complete as possible After the demo on the web app, I am currently missing pre-developed models from the various MobilityView plugins. Currently, I am a bit lost in between the Eclipse projects and what is shown in the artifact page and little ways to easily progress. I would recommend that the authors also provide the models that were used, and a bit of guidance, in order to follow the flow of the artifact page.

** Well-documented The authors took cautious steps to describe the overall process of the web app demo.

Unfortunately, the modeling part is far less documented, and I am missing a clear view of what is required from the reader, what is provided by the authors, what steps a reader needs to take in order to run an example. For instance, the information about the need of Eclipse Modeling and Acceleo is scattered in the text. Though it is explicitly documented, I felt like I had a bad surprise when I figured out I was missing Acceleo on the configuration I was setting up (my bad). Remediation actions were not hard to take, but a complete list of system requirements would be appreciated to avoid « bad surprises ».

More importantly, I’m currently missing some description and walkthrough to the different plugins. Both plugins have no particular instruction or guidance. A step-by-step walkthrough would be much appreciated on a given use case so that a reader can have a global comprehension of the artifact. Currently, I am able to run individual tasks, but I’m lacking an integrated view.

** Easy to (re)use One can play quite easily with the web application. However, looking at the details of the developments is more demanding since the use of the different plugins is not described. In particular, There are no already available examples and walkthrough that a user could leverage without having to create instances.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/modelsconf2018/artifact-evaluation/issues/12#issuecomment-405640387, or mute the thread https://github.com/notifications/unsubscribe-auth/ACiRmZFbXGrYZO6cG4bhGPMTTrhM5j-Jks5uHg3RgaJpZM4VOIPd .

--

Le informazioni contenute nella presente comunicazione sono di natura  privata e come tali sono da considerarsi riservate ed indirizzate  esclusivamente ai destinatari indicati e per le finalità strettamente  legate al relativo contenuto. Se avete ricevuto questo messaggio per  errore, vi preghiamo di eliminarlo e di inviare una comunicazione  all’indirizzo e-mail del mittente.

-- The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. If you received this in error, please contact the sender and delete the material.

antbucc commented 6 years ago

Dear Thanos

we have extended again our readme file with missing information. In particular we have added a zip file (SampleModels.zip) that contains the models we show also in our video. We have added also a summary: "A short step-by-step summary on how to use the different contributions" to explain with details all the steps to executer to replicate the same examples defined in the paper and in the video.

Thanks for your patience and let us know if something is missing yet.

Regards Antonio

On Tue, Jul 17, 2018 at 9:11 AM, Thanos Zolotas notifications@github.com wrote:

Hi,

Although the SmartJP interface starts in localhost, I am not able to create plans with all the transit means (e.g., Bus) in Trento. I receive a message saying that there are no transit times available. Is this because I need to create the models that include the transit times? I wasn't able to find the example mobility resources and map notes models which you demo in the Youtube video. Could you please provide those (or if they are already available, could you please point me to those in the repository)? These models would be very useful for me to test the transformations as well.

Regards, Thanos

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/modelsconf2018/artifact-evaluation/issues/12#issuecomment-405482846, or mute the thread https://github.com/notifications/unsubscribe-auth/ACiRmQPvLahRWb_esD7LD8CYQ31CXAUaks5uHY4hgaJpZM4VOIPd .

--

Le informazioni contenute nella presente comunicazione sono di natura  privata e come tali sono da considerarsi riservate ed indirizzate  esclusivamente ai destinatari indicati e per le finalità strettamente  legate al relativo contenuto. Se avete ricevuto questo messaggio per  errore, vi preghiamo di eliminarlo e di inviare una comunicazione  all’indirizzo e-mail del mittente.

-- The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. If you received this in error, please contact the sender and delete the material.

zolotas4 commented 6 years ago

Summary The authors provide artefacts for the derivation of a smart journey planner that takes into account information about available resources, remarks and challenges generated using a model based approach.

Is the artefact consistent with the paper? The artefacts are consistent with the paper. The authors provide the infrastructure needed to construct a smart journey planner for Trento that is updated by travelling information hosted in models. The examples described in the paper for constructing resources, remarks and challenges were also provided (note that the example models were not provided initially).

Is the artefact as complete as possible? In terms of the provided tangible artefacts I believe that the submission is complete. However, it is difficult to understand the general picture of the submitted artefacts and what is the purpose of each plugin and model. In addition, the provided artefacts are not packed in one solution but are provided in separate zip files which the users have to deploy themselves (the authors justify this decision based on the fact that it is still under development and a release is not done yet).

Is the artefact well-documented? I understand that the authors put effort in documenting a fairly complicated system which is still under development. In general I can tell that I got a high level understanding of how the artefacts work by reading the documentation. In addition, running the existing smart journey planner with the example remarks is quite straight forward and well-documented.

However, this is not the case for other aspects of the proposed solution. For example, the authors don't give instructions on how to run the acceleo transformations (they instead prompt users to search themselves online for a how to). In addition, some information included in the video are not complete. For example, is not mentioned which model should be used as input for each transformation. I had to experiment myself only to find out after I finished, that this information are provided in the text. Finally, I cannot tell that I am able to create a smart journey planner for my city after reading the instructions (although I am not sure if this inside the scope of the work presented in this paper).

I would suggest the authors to update the documentation by providing a clear explanation of the several plugins used in the approach and how they contribute to the whole picture. Also provide a step-by-step guide on how one can start from scratch and create a journey planner using their approach, by referring to the examples used in the paper.

Is the artefact easy to (re)use? I would say that it is quite easy to run the existing solution with the examples described in the paper. However, I am afraid I can't tell what one has to do to make the approach work in other scenarios as it is not clear to me what is already provided by the application and what the users have to on their own.

moji1 commented 6 years ago

Authors added a new section "A short step-by-step summary on how to use the different contributions" that addresses my main concern with the documentation. The current documentation is clear and detail. It explains each component separately and then presents how different components can be used to address a specific use case.

The artifact is consistent with the paper, and it is easy to re-use. SmartJP is a standalone application and can be run smoothly. Also, the modeling parts are eclipse projects which are easy to import and run.

The artifact would be a helpful addition to the paper and I suggest its acceptance.

grammarware commented 6 years ago

Dear @antbucc,

Based on all the comments and the reviews provided by the members of the Artifact Evaluation Committee of MoDELS 2018, we have reached the conclusion that this artifact conforms to the expectations and is hereby approved. Please use the badge instructions page to add the badge of approval to your article, and add the link to the artifact to the camera ready version of the paper.

Thank you very much for putting extra effort into the preparation and finalising of the artifact. If any of the comments above are still not addressed, please try to accommodate them before the conference.

Please also consider packaging your artifact (i.e., the documentation that has improved significantly during the evaluation process; plus the zip file with SmartJP), and saving it at ReMoDD, FigShare or Zenodo, for archival purposes (also for better URI without the commit hash).