Weather information API

[nipunbatra]

@milan1267 Please see if you can inform which one to use amongst the ones you used or we use the one which i talked about (update every 3 hrs). This is impt.. Like yesterday there was rain and weather was cool, parents didn't use AC. Do a quick comparison and inform the results.

[milan1267]

This is the script I am running on the data collected overnight. This is the plot I am getting

[milan1267]

Plots has been corrected. OpenWeather API is sending a timestamp with it, which updates after every half and hour. A bit of strange data has also been received in it. It is having a limit of 10 minuter before previous update. WorldWeather API is sending the time when query was made. We can make 3 calls every second and 500 calls per hour.

[nipunbatra]

@milan1267 : Is the code stable now?

@amarjeet-iiitd : What machine should we use to record temp. info. Needs internet connectivity always. Pervasive server very often logs one out of cyberoam, so cannot directly be used.

[milan1267]

@nipunreddevil : I am almost done with it. Just doing some testing. I will upload it by the evening.

[milan1267]

I have tested the Script and added all the exceptions also. Here is the script https://github.com/milan1267/AC-Data-Collection/blob/master/get_temperature_em.py

[nipunbatra]

Created an issue https://github.com/milan1267/AC-Data-Collection/issues/2 ! Not critical, maybe when you get time, might want to look at these things.

On Fri, Jun 21, 2013 at 3:59 PM, Milan Jain notifications@github.comwrote:

I have tested the Script and added all the exceptions also. Here is the script https://github.com/milan1267/AC-Data-Collection/blob/master/get_temperature_em.py

— Reply to this email directly or view it on GitHubhttps://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19808627 .

[amarjeet-iiitd]

This has been pending with me.

I dont know the way out - it is ideally not good to have firewall bypass but we can do that for one of the VMs on which this script can be run if really required. Let me know and I will then send the request.

On Fri, Jun 21, 2013 at 10:25 AM, Nipun Batra notifications@github.comwrote:

@milan1267 https://github.com/milan1267 : Is the code stable now?

@amarjeet-iiitd https://github.com/amarjeet-iiitd : What machine should we use to record temp. info. Needs internet connectivity always. Pervasive server very often logs one out of cyberoam, so cannot directly be used.

— Reply to this email directly or view it on GitHubhttps://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19798178 .

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

[nipunbatra]

There is also a simpler route, with loss of information.

We can collect this 10 min temperature information on say Main server at my home. We also use another web service which gives info at 3 hrs and give past few days archive.

I am not too keen to involve networking deptt. and since many people use the server, i don't want to take the responsibility for all of them. Would the above solution be fine?

On Sun, Jun 23, 2013 at 11:34 AM, amarjeet-iiitd notifications@github.comwrote:

This has been pending with me.

I dont know the way out - it is ideally not good to have firewall bypass but we can do that for one of the VMs on which this script can be run if really required. Let me know and I will then send the request.

On Fri, Jun 21, 2013 at 10:25 AM, Nipun Batra notifications@github.comwrote:

@milan1267 https://github.com/milan1267 : Is the code stable now?

@amarjeet-iiitd https://github.com/amarjeet-iiitd : What machine should we use to record temp. info. Needs internet connectivity always. Pervasive server very often logs one out of cyberoam, so cannot directly be used.

— Reply to this email directly or view it on GitHub< https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19798178>

.

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

— Reply to this email directly or view it on GitHubhttps://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19869626 .

[shailja-thakur]

I installed cyberoam client there and logged in from there , now it should not log out I think.

On Sun, Jun 23, 2013 at 11:43 AM, Nipun Batra notifications@github.comwrote:

There is also a simpler route, with loss of information.

We can collect this 10 min temperature information on say Main server at my home. We also use another web service which gives info at 3 hrs and give past few days archive.

I am not too keen to involve networking deptt. and since many people use the server, i don't want to take the responsibility for all of them. Would the above solution be fine?

On Sun, Jun 23, 2013 at 11:34 AM, amarjeet-iiitd notifications@github.comwrote:

This has been pending with me.

I dont know the way out - it is ideally not good to have firewall bypass but we can do that for one of the VMs on which this script can be run if really required. Let me know and I will then send the request.

On Fri, Jun 21, 2013 at 10:25 AM, Nipun Batra notifications@github.comwrote:

@milan1267 https://github.com/milan1267 : Is the code stable now?

@amarjeet-iiitd https://github.com/amarjeet-iiitd : What machine should we use to record temp. info. Needs internet connectivity always. Pervasive server very often logs one out of cyberoam, so cannot directly be used.

— Reply to this email directly or view it on GitHub<

https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19798178>

.

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

— Reply to this email directly or view it on GitHub< https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19869626>

.

— Reply to this email directly or view it on GitHubhttps://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19869696 .

[nipunbatra]

Milan can you try running your script on Pervasive server now?

On Sun, Jun 23, 2013 at 1:10 PM, shailja1275 notifications@github.comwrote:

I installed cyberoam client there and logged in from there , now it should not log out I think.

On Sun, Jun 23, 2013 at 11:43 AM, Nipun Batra notifications@github.comwrote:

There is also a simpler route, with loss of information.

We can collect this 10 min temperature information on say Main server at my home. We also use another web service which gives info at 3 hrs and give past few days archive.

I am not too keen to involve networking deptt. and since many people use the server, i don't want to take the responsibility for all of them. Would the above solution be fine?

On Sun, Jun 23, 2013 at 11:34 AM, amarjeet-iiitd notifications@github.comwrote:

This has been pending with me.

I dont know the way out - it is ideally not good to have firewall bypass but we can do that for one of the VMs on which this script can be run if really required. Let me know and I will then send the request.

On Fri, Jun 21, 2013 at 10:25 AM, Nipun Batra < notifications@github.com>wrote:

@milan1267 https://github.com/milan1267 : Is the code stable now?

@amarjeet-iiitd https://github.com/amarjeet-iiitd : What machine should we use to record temp. info. Needs internet connectivity always. Pervasive server very often logs one out of cyberoam, so cannot directly be used.

— Reply to this email directly or view it on GitHub<

https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19798178>

.

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

— Reply to this email directly or view it on GitHub<

https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19869626>

.

— Reply to this email directly or view it on GitHub< https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19869696>

.

— Reply to this email directly or view it on GitHubhttps://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19870360 .

[milan1267]

Ya sure I will do that after lunch around 2:30

[amarjeet-iiitd]

Sure - that works.

On Sun, Jun 23, 2013 at 11:43 AM, Nipun Batra notifications@github.comwrote:

There is also a simpler route, with loss of information.

We can collect this 10 min temperature information on say Main server at my home. We also use another web service which gives info at 3 hrs and give past few days archive.

I am not too keen to involve networking deptt. and since many people use the server, i don't want to take the responsibility for all of them. Would the above solution be fine?

On Sun, Jun 23, 2013 at 11:34 AM, amarjeet-iiitd notifications@github.comwrote:

This has been pending with me.

I dont know the way out - it is ideally not good to have firewall bypass but we can do that for one of the VMs on which this script can be run if really required. Let me know and I will then send the request.

On Fri, Jun 21, 2013 at 10:25 AM, Nipun Batra notifications@github.comwrote:

@milan1267 https://github.com/milan1267 : Is the code stable now?

@amarjeet-iiitd https://github.com/amarjeet-iiitd : What machine should we use to record temp. info. Needs internet connectivity always. Pervasive server very often logs one out of cyberoam, so cannot directly be used.

— Reply to this email directly or view it on GitHub<

https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19798178>

.

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

— Reply to this email directly or view it on GitHub< https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19869626>

.

— Reply to this email directly or view it on GitHubhttps://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19869696 .

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

[shailja-thakur]

The problem of consistent internet over VM is still there , although the client has it running always .Just to check I tried running weather script on nms server , and it was collecting weather info , and there as well I am logged in via cyberoam client. And why is the connection over bridged and not NAT on pervasive ?

On Sun, Jun 23, 2013 at 1:50 PM, amarjeet-iiitd notifications@github.comwrote:

Sure - that works.

On Sun, Jun 23, 2013 at 11:43 AM, Nipun Batra notifications@github.comwrote:

There is also a simpler route, with loss of information.

We can collect this 10 min temperature information on say Main server at my home. We also use another web service which gives info at 3 hrs and give past few days archive.

I am not too keen to involve networking deptt. and since many people use the server, i don't want to take the responsibility for all of them. Would the above solution be fine?

On Sun, Jun 23, 2013 at 11:34 AM, amarjeet-iiitd notifications@github.comwrote:

This has been pending with me.

I dont know the way out - it is ideally not good to have firewall bypass but we can do that for one of the VMs on which this script can be run if really required. Let me know and I will then send the request.

On Fri, Jun 21, 2013 at 10:25 AM, Nipun Batra < notifications@github.com>wrote:

@milan1267 https://github.com/milan1267 : Is the code stable now?

@amarjeet-iiitd https://github.com/amarjeet-iiitd : What machine should we use to record temp. info. Needs internet connectivity always. Pervasive server very often logs one out of cyberoam, so cannot directly be used.

— Reply to this email directly or view it on GitHub<

https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19798178>

.

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

— Reply to this email directly or view it on GitHub<

https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19869626>

.

— Reply to this email directly or view it on GitHub< https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19869696>

.

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

—

Reply to this email directly or view it on GitHubhttps://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19870682 .

[milan1267]

If internet connection persists then it would be difficult to collect weather data on pervasive VM.

[nipunbatra]

@amarjeet-iiitd : Can you please ask if some faculty is using Amazon EC2. They do provide educational plans also. The free trial also should be fine, but they require to register via a credit card.

I think that we are far better off utilizing cloud based stuff than to spend time to debug our system. Or if that is time consuming, just logging at 2-3 places in different parts of Delhi even on laptops is fine, or i can ask Samy to put this thing up in some m/c in UCLA where net isnt an issue.

But its surprising that even such trivial things are so complicated here. I thus rely only on local networks and on cloud much more.

@shailja1275 : I think the n/w settings have something to do with SensorAct and bridging and all. Its best left untouched.

[nipunbatra]

@milan1267 : You may want to write in 5-6 lines why you chose which API and their tradeoffs. Tomorrow if you are on leave, someone else can refer to that page. Maybe when you have time, create a wiki page here.

[amarjeet-iiitd]

I would suggest that ask IT people to correct this problem. If they can not keep it on cyberroam all the time then we have a case to get it out of firewall and I can do that.

On Mon, Jun 24, 2013 at 1:36 PM, Nipun Batra notifications@github.comwrote:

@milan1267 https://github.com/milan1267 : You may want to write in 5-6 lines why you chose which API and their tradeoffs. Tomorrow if you are on leave, someone else can refer to that page. Maybe when you have time, create a wiki page here.

— Reply to this email directly or view it on GitHubhttps://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19893869 .

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

[nipunbatra]

Any progress on this front. If not, should i ask Samy to do this on some machine in UCLA.

@milan1267: Is the World Weather API working now?

On Mon, Jun 24, 2013 at 3:36 PM, amarjeet-iiitd notifications@github.comwrote:

I would suggest that ask IT people to correct this problem. If they can not keep it on cyberroam all the time then we have a case to get it out of firewall and I can do that.

On Mon, Jun 24, 2013 at 1:36 PM, Nipun Batra notifications@github.comwrote:

@milan1267 https://github.com/milan1267 : You may want to write in 5-6 lines why you chose which API and their tradeoffs. Tomorrow if you are on leave, someone else can refer to that page. Maybe when you have time, create a wiki page here.

— Reply to this email directly or view it on GitHub< https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19893869>

.

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

—

Reply to this email directly or view it on GitHubhttps://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19898484 .

[amarjeet-iiitd]

One of the student was saying that if we keep cyberroam logged in one of the browser windows then it works fine. The client is not very good in terms of connectivity.

On Wed, Jun 26, 2013 at 3:13 PM, Nipun Batra notifications@github.comwrote:

Any progress on this front. If not, should i ask Samy to do this on some machine in UCLA.

@milan1267: Is the World Weather API working now?

On Mon, Jun 24, 2013 at 3:36 PM, amarjeet-iiitd notifications@github.comwrote:

I would suggest that ask IT people to correct this problem. If they can not keep it on cyberroam all the time then we have a case to get it out of firewall and I can do that.

On Mon, Jun 24, 2013 at 1:36 PM, Nipun Batra notifications@github.comwrote:

@milan1267 https://github.com/milan1267 : You may want to write in 5-6 lines why you chose which API and their tradeoffs. Tomorrow if you are on leave, someone else can refer to that page. Maybe when you have time, create a wiki page here.

— Reply to this email directly or view it on GitHub<

https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19893869>

.

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

—

Reply to this email directly or view it on GitHub< https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19898484>

.

— Reply to this email directly or view it on GitHubhttps://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-20036427 .

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

[nipunbatra]

I had tried this before, but didn't work. In fact we never log out of cyberoam on browser and never closed the tab but net would not work. IT deptt. receommends cyberoam client.

On Wed, Jun 26, 2013 at 3:27 PM, amarjeet-iiitd notifications@github.comwrote:

One of the student was saying that if we keep cyberroam logged in one of the browser windows then it works fine. The client is not very good in terms of connectivity.

On Wed, Jun 26, 2013 at 3:13 PM, Nipun Batra notifications@github.comwrote:

Any progress on this front. If not, should i ask Samy to do this on some machine in UCLA.

@milan1267: Is the World Weather API working now?

On Mon, Jun 24, 2013 at 3:36 PM, amarjeet-iiitd < notifications@github.com>wrote:

I would suggest that ask IT people to correct this problem. If they can not keep it on cyberroam all the time then we have a case to get it out of firewall and I can do that.

On Mon, Jun 24, 2013 at 1:36 PM, Nipun Batra notifications@github.comwrote:

@milan1267 https://github.com/milan1267 : You may want to write in 5-6 lines why you chose which API and their tradeoffs. Tomorrow if you are on leave, someone else can refer to that page. Maybe when you have time, create a wiki page here.

— Reply to this email directly or view it on GitHub<

https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19893869>

.

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

—

Reply to this email directly or view it on GitHub<

https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19898484>

.

— Reply to this email directly or view it on GitHub< https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-20036427>

.

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

— Reply to this email directly or view it on GitHubhttps://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-20037037 .

[amarjeet-iiitd]

Then if it can not be resolved by IT department, we just log the data on the US side.

On Wed, Jun 26, 2013 at 3:29 PM, Nipun Batra notifications@github.comwrote:

I had tried this before, but didn't work. In fact we never log out of cyberoam on browser and never closed the tab but net would not work. IT deptt. receommends cyberoam client.

On Wed, Jun 26, 2013 at 3:27 PM, amarjeet-iiitd notifications@github.comwrote:

One of the student was saying that if we keep cyberroam logged in one of the browser windows then it works fine. The client is not very good in terms of connectivity.

On Wed, Jun 26, 2013 at 3:13 PM, Nipun Batra notifications@github.comwrote:

Any progress on this front. If not, should i ask Samy to do this on some machine in UCLA.

@milan1267: Is the World Weather API working now?

On Mon, Jun 24, 2013 at 3:36 PM, amarjeet-iiitd < notifications@github.com>wrote:

I would suggest that ask IT people to correct this problem. If they can not keep it on cyberroam all the time then we have a case to get it out of firewall and I can do that.

On Mon, Jun 24, 2013 at 1:36 PM, Nipun Batra < notifications@github.com>wrote:

@milan1267 https://github.com/milan1267 : You may want to write in 5-6 lines why you chose which API and their tradeoffs. Tomorrow if you are on leave, someone else can refer to that page. Maybe when you have time, create a wiki page here.

— Reply to this email directly or view it on GitHub<

https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19893869>

.

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

—

Reply to this email directly or view it on GitHub<

https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19898484>

.

— Reply to this email directly or view it on GitHub<

https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-20036427>

.

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

— Reply to this email directly or view it on GitHub< https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-20037037>

.

— Reply to this email directly or view it on GitHubhttps://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-20037133 .

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

[nipunbatra]

Yes. Seems like the simplest solution. I will ask Samy to run the script on some server.

@milan1267: Please let me know what all to run and how.

On Wed, Jun 26, 2013 at 3:38 PM, amarjeet-iiitd notifications@github.comwrote:

Then if it can not be resolved by IT department, we just log the data on the US side.

On Wed, Jun 26, 2013 at 3:29 PM, Nipun Batra notifications@github.comwrote:

I had tried this before, but didn't work. In fact we never log out of cyberoam on browser and never closed the tab but net would not work. IT deptt. receommends cyberoam client.

On Wed, Jun 26, 2013 at 3:27 PM, amarjeet-iiitd < notifications@github.com>wrote:

One of the student was saying that if we keep cyberroam logged in one of the browser windows then it works fine. The client is not very good in terms of connectivity.

On Wed, Jun 26, 2013 at 3:13 PM, Nipun Batra notifications@github.comwrote:

Any progress on this front. If not, should i ask Samy to do this on some machine in UCLA.

@milan1267: Is the World Weather API working now?

On Mon, Jun 24, 2013 at 3:36 PM, amarjeet-iiitd < notifications@github.com>wrote:

I would suggest that ask IT people to correct this problem. If they can not keep it on cyberroam all the time then we have a case to get it out of firewall and I can do that.

On Mon, Jun 24, 2013 at 1:36 PM, Nipun Batra < notifications@github.com>wrote:

@milan1267 https://github.com/milan1267 : You may want to write in 5-6 lines why you chose which API and their tradeoffs. Tomorrow if you are on leave, someone else can refer to that page. Maybe when you have time, create a wiki page here.

— Reply to this email directly or view it on GitHub<

https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19893869>

.

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

—

Reply to this email directly or view it on GitHub<

https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-19898484>

.

— Reply to this email directly or view it on GitHub<

https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-20036427>

.

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

— Reply to this email directly or view it on GitHub<

https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-20037037>

.

— Reply to this email directly or view it on GitHub< https://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-20037133>

.

Best Regards

Amarjeet Singh, Asst. Professor, IIIT Delhi http://www.iiitd.edu.in/~amarjeet/

— Reply to this email directly or view it on GitHubhttps://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-20037510 .

[milan1267]

@nipunreddevil : World Weather API is up again. You have to run get_weather*.py scripts. One is for World Weather and other for Open Weather. Address of the folder where we want to save data must be modified. While using World Weather Script we have to keep one more python file, for it to take password from it. File should be WORLD_WEATHER_APPKEY.py

[milan1267]

Hey Nipun, I tried this API, it is really good API to collect weather data. I have made a script for this also. Can you please check it once? There is some problem, it is not getting response from the server. When I am using python interpreter, it is working fine, but script is not getting response. I am mailing you the configuration file.

[nipunbatra]

Working for me

On Mon, Jul 22, 2013 at 1:32 PM, Milan Jain notifications@github.comwrote:

Hey Nipun, I tried this API, it is really good API to collect weather data. I have made a script for this also. Can you please check it once? There is some problem, it is not getting response from the server. When I am using python interpreter, it is working fine, but script is not getting response. I am mailing you the configuration file.

— Reply to this email directly or view it on GitHubhttps://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-21329697 .

[milan1267]

Oh great. May be I am doing some folder mistakes while executing.

[nipunbatra]

The log file must be created before usage. You may have missed that.

On Mon, Jul 22, 2013 at 4:12 PM, Milan Jain notifications@github.comwrote:

Oh great. May be I am doing some folder mistakes while executing.

— Reply to this email directly or view it on GitHubhttps://github.com/nipunreddevil/Home_Deployment/issues/42#issuecomment-21336469 .