search

nishusingh11 / machine-learning-engineering-bda696

0 stars 0 forks source link

Implementation of Homework 3 #5

Closed nishusingh11 closed 2 years ago

nishusingh11 commented 2 years ago

Hey Vince,

Kindly review my assignment 3. I'm using custom transformation " batting_avg_transform" to calculate rolling average. I saved output of all rows in output_rolling_average file. Output: Assignment3_output

vdayes7 commented 2 years ago

Hey I am having a problem running your code. Am getting "Command not found" when doing the pip-compile commands. Have emailed Will for an answer, and hope to meet with him today.

nishusingh11 commented 2 years ago

I was getting detect secrets failed due to jutyperlab version, then I have updated my requirement.dev.txt file. I think that could be the reason. Can you please share screenshot of error here?

nishusingh11 commented 2 years ago

Thanks Vince. \ Now output is right aligned. final_output

nishusingh11 commented 2 years ago

Hello Professor,

Kindly review my code. I have created custom transformation "batting_avg_transform.py" to calculate average for rolling over 100 days. I saved my output on output_rolling_average.csv. Output :

image

vdayes7 commented 2 years ago

Hey Nishu,

Am curious - what was causing that "Command not found" error message on the pip-compile statement?

And how did you fix it?

Thanks, Vince

PS hope you have a great weekend.

On Fri, Oct 8, 2021 at 7:58 PM Nishu Singh @.***> wrote:

Hello Professor,

Kindly review my code.

— You are receiving this because your review was requested. Reply to this email directly, view it on GitHub https://github.com/nishusingh11/bda696/pull/5#issuecomment-939212188, or unsubscribe https://github.com/notifications/unsubscribe-auth/AR5JQ2TBWBXEOI5I62P6YRDUF6VVRANCNFSM5FSLXXPQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

nishusingh11 commented 2 years ago

Hey Nishu, Am curious - what was causing that "Command not found" error message on the pip-compile statement? And how did you fix it? Thanks, Vince PS hope you have a great weekend. … On Fri, Oct 8, 2021 at 7:58 PM Nishu Singh @.***> wrote: Hello Professor, Kindly review my code. — You are receiving this because your review was requested. Reply to this email directly, view it on GitHub <#5 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AR5JQ2TBWBXEOI5I62P6YRDUF6VVRANCNFSM5FSLXXPQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You were getting this error because pip compile was not installed on your current working environment and you were trying to executing code from different env.

vdayes7 commented 2 years ago

Hi there - hope you are doing well.

So FYI, I will be on campus today for an event from 4 to 5 pm so I can meet 2 to 4 or after 5 if you want to meet. Tomorrow, I will be on campus for a 5 to 6 pm event. Can meet before or after.

It seems to me that if we meet in person, it is much easier to get you squared away. We can solve whatever problems come up, I can give you feedback, etc. and we can repeat until you submit the assignment to Julien. Otherwise, it is much harder and less likely to get done.

Also, I may be submitting this homework, and will probably be working on it late tomorrow. How is your schedule tomorrow night?

Vince

vdayes7 commented 2 years ago

Hi there, you probably know all this already.

Looks like that dataset I mentioned won't be ready.

Vince

---------- Forwarded message --------- From: Vince Dayes @.> Date: Sat, Oct 23, 2021 at 2:18 PM Subject: Re: Midterm To: Julien Pierret @.>

Thanks!

On Sat, Oct 23, 2021 at 11:57 AM Julien Pierret @.***> wrote:

Hey Vince,

After figuring out what's what, we build a table of correlation metrics between all predictor pairs, but just to themselves, not relative to response?

   Cat/Cont   -  Correlation Ratio, Point Biserial Correlation -

Don't worry about ordinal categoricals Cont/Cat - Correlation Ratio, Point Biserial Correlation - Duplicate of the above Cat/Cat - Cramer's V, Tschuprow 's T (Goodman's & Kruskel's Lambda?) - Only worry about the ones I gave you code on Cont/Cont - Pearson's R

Then make plots: - These are from the last homework. but yes, I wanted you to put links to these in the summary table you generate

   Cat/Cont - Violin, Distribution
   Cont/Cat - Violin, Distribution
   Cat/Cat   -  Heat
   Cont/Cont - Scatter

Brute Force: All pairs with respect to Response - Difference with Mean of Response - weighted and unweighted ranked from high to low

For this section, try getting this plot: https://teaching.mrsharky.com/sdsu_fall_2020_lecture07.html#/13/11 and you could maybe do the 3d one.

Histogram - This would be for one of the features not both (and it's

from the last homework) Heat (3-D) Line Plot - This is only really relevant for one of the features by themselves and we combine it with the Histogram one above (this is from the last homework too) 10x10 Table of values

These are the plots, but also make sure to make tables with the rankings so we can see which features are good.

On Sat, Oct 23, 2021 at 11:22 AM Vince Dayes @.***> wrote:

Hey Julien, So I want to dive into this midterm. Just to be clear, to make sure I understand what is required here:

After figuring out what's what, we build a table of correlation metrics between all predictor pairs, but just to themselves, not relative to response?

   Cat/Cont   -  Correlation Ratio, Point Biserial Correlation
   Cont/Cat   -  Correlation Ratio, Point Biserial Correlation
   Cat/Cat     -  Cramer's V, Tschuprow 's T   (Goodman's & Kruskel's

Lambda?) Cont/Cont - Pearson's R

Then make plots:

   Cat/Cont - Violin, Distribution
   Cont/Cat - Violin, Distribution
   Cat/Cat   -  Heat
   Cont/Cont - Scatter

Brute Force: All pairs with respect to Response - Difference with Mean of Response - weighted and unweighted ranked from high to low

Histogram
Heat (3-D)
Line Plot
10x10 Table of values

Put links to plots in tables

Is this correct?

Thanks, Vince

vdayes7 commented 2 years ago

Hi Nishu, hope you are doing well.

Am wondering if you are still interested in this one month project? Basically it is the same as the 696 Final, only with my data. (Futures Commodities Historical data)

Financial compensation of course. So let me know if you want to discuss further. I can meet you on campus any day if you want. This is an exciting project with great future possibilities. "The Future is in Futures".

Your Code Buddy, Vince🙋

nishusingh11 commented 2 years ago

Hi Vince,

I'm doing well and hoping you are doing well too.

Sorry for the late reply.

We can meet in person to discuss in detail. I want to discuss your dataset and Is my machine configuration sufficient to work with your dataset? If it is okay with you we can meet on wednesday or thursday on campus whenever you are available.

Kindly let me know.

Kind regards Nishu Singh

On Sun, Dec 12, 2021 at 4:38 PM Vince Dayes @.***> wrote:

Hi Nishu, hope you are doing well.

Am wondering if you are still interested in this one month project? Basically it is the same as the 696 Final, only with my data. (Futures Commodities Historical data)

Financial compensation of course. So let me know if you want to discuss further. I can meet you on campus any day if you want. This is an exciting project with great future possibilities. "The Future is in Futures".

Your Code Buddy, Vince🙋

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/nishusingh11/bda696/pull/5#issuecomment-992007656, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFJUEO2NF77SLIJE5HITUDLUQU6BTANCNFSM5FSLXXPQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

vdayes7 commented 2 years ago

Hi Nishu,

Yes, let's meet and discuss the data. (Am pretty sure your computer configuration is fine)

How about if we meet tomorrow,Wednesday at 11 am or whatever time works best for you. Actually my schedule is wide open. I can also meet Thursday at almost any time.

In BDA 594 we made a website that describes the project I would like to do as well as the data in detail. The raw data (Stage 1) is just 7 fields in CSV .txt files. I can help explain how the data is processed from Stage 1 to Stage 2.

Check it out:

https://viktorthepredictor.com/

Hope to see you soon. Vince

On Mon, Dec 13, 2021 at 9:34 PM Nishu Singh @.***> wrote:

Hi Vince,

I'm doing well and hoping you are doing well too.

Sorry for the late reply.

We can meet in person to discuss in detail. I want to discuss your dataset and Is my machine configuration sufficient to work with your dataset? If it is okay with you we can meet on wednesday or thursday on campus whenever you are available.

Kindly let me know.

Kind regards Nishu Singh

On Sun, Dec 12, 2021 at 4:38 PM Vince Dayes @.***> wrote:

Hi Nishu, hope you are doing well.

Am wondering if you are still interested in this one month project? Basically it is the same as the 696 Final, only with my data. (Futures Commodities Historical data)

Financial compensation of course. So let me know if you want to discuss further. I can meet you on campus any day if you want. This is an exciting project with great future possibilities. "The Future is in Futures".

Your Code Buddy, Vince🙋

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/nishusingh11/bda696/pull/5#issuecomment-992007656, or unsubscribe < https://github.com/notifications/unsubscribe-auth/AFJUEO2NF77SLIJE5HITUDLUQU6BTANCNFSM5FSLXXPQ

. Triage notifications on the go with GitHub Mobile for iOS < https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675

or Android < https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub .

— You are receiving this because your review was requested. Reply to this email directly, view it on GitHub https://github.com/nishusingh11/bda696/pull/5#issuecomment-993174550, or unsubscribe https://github.com/notifications/unsubscribe-auth/AR5JQ2U5JZLYAUTBRL33XJ3UQ3JOZANCNFSM5FSLXXPQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

nishusingh11 commented 2 years ago

Sure tomorrow 11 am sounds good to me. I will check your website.

Thanks and regards Nishu Singh

On Tue, Dec 14, 2021 at 12:03 PM Vince Dayes @.***> wrote:

Hi Nishu,

Yes, let's meet and discuss the data. (Am pretty sure your computer configuration is fine)

How about if we meet tomorrow,Wednesday at 11 am or whatever time works best for you. Actually my schedule is wide open. I can also meet Thursday at almost any time.

In BDA 594 we made a website that describes the project I would like to do as well as the data in detail. The raw data (Stage 1) is just 7 fields in CSV .txt files. I can help explain how the data is processed from Stage 1 to Stage 2.

Check it out:

https://viktorthepredictor.com/

Hope to see you soon. Vince

On Mon, Dec 13, 2021 at 9:34 PM Nishu Singh @.***> wrote:

Hi Vince,

I'm doing well and hoping you are doing well too.

Sorry for the late reply.

We can meet in person to discuss in detail. I want to discuss your dataset and Is my machine configuration sufficient to work with your dataset? If it is okay with you we can meet on wednesday or thursday on campus whenever you are available.

Kindly let me know.

Kind regards Nishu Singh

On Sun, Dec 12, 2021 at 4:38 PM Vince Dayes @.***> wrote:

Hi Nishu, hope you are doing well.

Am wondering if you are still interested in this one month project? Basically it is the same as the 696 Final, only with my data. (Futures Commodities Historical data)

Financial compensation of course. So let me know if you want to discuss further. I can meet you on campus any day if you want. This is an exciting project with great future possibilities. "The Future is in Futures".

Your Code Buddy, Vince🙋

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <https://github.com/nishusingh11/bda696/pull/5#issuecomment-992007656 , or unsubscribe <

https://github.com/notifications/unsubscribe-auth/AFJUEO2NF77SLIJE5HITUDLUQU6BTANCNFSM5FSLXXPQ

. Triage notifications on the go with GitHub Mobile for iOS <

https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675

or Android <

https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub

.

— You are receiving this because your review was requested. Reply to this email directly, view it on GitHub https://github.com/nishusingh11/bda696/pull/5#issuecomment-993174550, or unsubscribe < https://github.com/notifications/unsubscribe-auth/AR5JQ2U5JZLYAUTBRL33XJ3UQ3JOZANCNFSM5FSLXXPQ

. Triage notifications on the go with GitHub Mobile for iOS < https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675

or Android < https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub .

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/nishusingh11/bda696/pull/5#issuecomment-993934872, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFJUEO5PZ23VEYEJ7FVMQ2DUQ6PI3ANCNFSM5FSLXXPQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

vdayes7 commented 2 years ago

11:00 on 12/15/21 great! Starbucks? Let's celebrate!

On Tue, Dec 14, 2021 at 1:32 PM Nishu Singh @.***> wrote:

Sure tomorrow 11 am sounds good to me. I will check your website.

Thanks and regards Nishu Singh

On Tue, Dec 14, 2021 at 12:03 PM Vince Dayes @.***> wrote:

Hi Nishu,

Yes, let's meet and discuss the data. (Am pretty sure your computer configuration is fine)

How about if we meet tomorrow,Wednesday at 11 am or whatever time works best for you. Actually my schedule is wide open. I can also meet Thursday at almost any time.

In BDA 594 we made a website that describes the project I would like to do as well as the data in detail. The raw data (Stage 1) is just 7 fields in CSV .txt files. I can help explain how the data is processed from Stage 1 to Stage 2.

Check it out:

https://viktorthepredictor.com/

Hope to see you soon. Vince

On Mon, Dec 13, 2021 at 9:34 PM Nishu Singh @.***> wrote:

Hi Vince,

I'm doing well and hoping you are doing well too.

Sorry for the late reply.

We can meet in person to discuss in detail. I want to discuss your dataset and Is my machine configuration sufficient to work with your dataset? If it is okay with you we can meet on wednesday or thursday on campus whenever you are available.

Kindly let me know.

Kind regards Nishu Singh

On Sun, Dec 12, 2021 at 4:38 PM Vince Dayes @.***> wrote:

Hi Nishu, hope you are doing well.

Am wondering if you are still interested in this one month project? Basically it is the same as the 696 Final, only with my data. (Futures Commodities Historical data)

Financial compensation of course. So let me know if you want to discuss further. I can meet you on campus any day if you want. This is an exciting project with great future possibilities. "The Future is in Futures".

Your Code Buddy, Vince🙋

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub < https://github.com/nishusingh11/bda696/pull/5#issuecomment-992007656 , or unsubscribe <

https://github.com/notifications/unsubscribe-auth/AFJUEO2NF77SLIJE5HITUDLUQU6BTANCNFSM5FSLXXPQ

. Triage notifications on the go with GitHub Mobile for iOS <

https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675

or Android <

https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub

.

— You are receiving this because your review was requested. Reply to this email directly, view it on GitHub <https://github.com/nishusingh11/bda696/pull/5#issuecomment-993174550 , or unsubscribe <

https://github.com/notifications/unsubscribe-auth/AR5JQ2U5JZLYAUTBRL33XJ3UQ3JOZANCNFSM5FSLXXPQ

. Triage notifications on the go with GitHub Mobile for iOS <

https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675

or Android <

https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub

.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/nishusingh11/bda696/pull/5#issuecomment-993934872, or unsubscribe < https://github.com/notifications/unsubscribe-auth/AFJUEO5PZ23VEYEJ7FVMQ2DUQ6PI3ANCNFSM5FSLXXPQ

. Triage notifications on the go with GitHub Mobile for iOS < https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675

or Android < https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub .

— You are receiving this because your review was requested. Reply to this email directly, view it on GitHub https://github.com/nishusingh11/bda696/pull/5#issuecomment-994036078, or unsubscribe https://github.com/notifications/unsubscribe-auth/AR5JQ2RURJBBEAKBXMOEIQDUQ6ZVVANCNFSM5FSLXXPQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

vdayes7 commented 2 years ago

I've shared an item with you:

Commodities https://docs.google.com/spreadsheets/d/1xabAioRuEjBVX1_qeevQ-Z04sfaVX7t_w8ExROyBbaY/edit?usp=sharing&invite=CI_WpMcF&ts=61b9274e

It's not an attachment -- it's stored online. To open this item, just click
the link above.

Main Table

nishusingh11 commented 2 years ago

Sure, see you then.

On Tue, Dec 14, 2021 at 3:21 PM Vince Dayes @.***> wrote:

11:00 on 12/15/21 great! Starbucks? Let's celebrate!

On Tue, Dec 14, 2021 at 1:32 PM Nishu Singh @.***> wrote:

Sure tomorrow 11 am sounds good to me. I will check your website.

Thanks and regards Nishu Singh

On Tue, Dec 14, 2021 at 12:03 PM Vince Dayes @.***> wrote:

Hi Nishu,

Yes, let's meet and discuss the data. (Am pretty sure your computer configuration is fine)

How about if we meet tomorrow,Wednesday at 11 am or whatever time works best for you. Actually my schedule is wide open. I can also meet Thursday at almost any time.

In BDA 594 we made a website that describes the project I would like to do as well as the data in detail. The raw data (Stage 1) is just 7 fields in CSV .txt files. I can help explain how the data is processed from Stage 1 to Stage 2.

Check it out:

https://viktorthepredictor.com/

Hope to see you soon. Vince

On Mon, Dec 13, 2021 at 9:34 PM Nishu Singh @.***> wrote:

Hi Vince,

I'm doing well and hoping you are doing well too.

Sorry for the late reply.

We can meet in person to discuss in detail. I want to discuss your dataset and Is my machine configuration sufficient to work with your dataset? If it is okay with you we can meet on wednesday or thursday on campus whenever you are available.

Kindly let me know.

Kind regards Nishu Singh

On Sun, Dec 12, 2021 at 4:38 PM Vince Dayes @.***> wrote:

Hi Nishu, hope you are doing well.

Am wondering if you are still interested in this one month project? Basically it is the same as the 696 Final, only with my data. (Futures Commodities Historical data)

Financial compensation of course. So let me know if you want to discuss further. I can meet you on campus any day if you want. This is an exciting project with great future possibilities. "The Future is in Futures".

Your Code Buddy, Vince🙋

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub < https://github.com/nishusingh11/bda696/pull/5#issuecomment-992007656 , or unsubscribe <

https://github.com/notifications/unsubscribe-auth/AFJUEO2NF77SLIJE5HITUDLUQU6BTANCNFSM5FSLXXPQ

. Triage notifications on the go with GitHub Mobile for iOS <

https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675

or Android <

https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub

.

— You are receiving this because your review was requested. Reply to this email directly, view it on GitHub < https://github.com/nishusingh11/bda696/pull/5#issuecomment-993174550 , or unsubscribe <

https://github.com/notifications/unsubscribe-auth/AR5JQ2U5JZLYAUTBRL33XJ3UQ3JOZANCNFSM5FSLXXPQ

. Triage notifications on the go with GitHub Mobile for iOS <

https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675

or Android <

https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub

.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <https://github.com/nishusingh11/bda696/pull/5#issuecomment-993934872 , or unsubscribe <

https://github.com/notifications/unsubscribe-auth/AFJUEO5PZ23VEYEJ7FVMQ2DUQ6PI3ANCNFSM5FSLXXPQ

. Triage notifications on the go with GitHub Mobile for iOS <

https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675

or Android <

https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub

.

— You are receiving this because your review was requested. Reply to this email directly, view it on GitHub https://github.com/nishusingh11/bda696/pull/5#issuecomment-994036078, or unsubscribe < https://github.com/notifications/unsubscribe-auth/AR5JQ2RURJBBEAKBXMOEIQDUQ6ZVVANCNFSM5FSLXXPQ

. Triage notifications on the go with GitHub Mobile for iOS < https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675

or Android < https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub .

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/nishusingh11/bda696/pull/5#issuecomment-994132278, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFJUEOYLGHM67Y5H64ZQ6ILUQ7GRFANCNFSM5FSLXXPQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.