Feat: CSV Import and Export

Reimirno commented 9 months ago

This PR:

allows room and student rosters to be imported from uploading csv (same format as google sheet).
allows exporting exam seating data to csv.

Please note that the csv import and export are NOT symmetric. The export feature is only for humans to keep track of or for archiving purposes. The exported csv cannot be fed into csv import again.

github-actions[bot] commented 9 months ago

Coverage for unit tests for Python 3.11

File	Stmts	Miss	Cover	Missing
server
__init__.py	42	4	90%	20–21, 46, 54
forms.py	88	10	89%	18–20, 45–47, 97–100
models.py	153	33	78%	28, 56, 59, 62, 88, 92, 95–104, 107, 110, 124, 127–129, 132, 136, 148, 152, 156, 160–161, 167, 187, 190, 211, 214, 228
views.py	412	330	20%	33–38, 51–52, 70–88, 99–101, 110–117, 126, 137–140, 150–169, 181–205, 213–235, 247–251, 260–282, 291–293, 301–304, 312–337, 345–370, 378–406, 414–431, 438, 443–447, 456–458, 463–511, 516–521, 526–546, 551–566, 571–586, 596, 601, 606, 614–615, 621, 626–630
server/controllers
__init__.py	65	37	43%	25–52, 55, 66–86, 89
auth_controllers.py	38	25	34%	13–15, 21–47, 53–55
dev_login_controllers.py	34	23	32%	11–25, 30–39, 44–56
health_controllers.py	13	2	85%	17–18
server/services/auth
__init__.py	28	4	86%	21, 49, 54–55
server/services/canvas
__init__.py	68	51	25%	18–25, 29, 33, 37, 47–80, 84–99, 103
fake_canvas.py	39	26	33%	9, 12, 15, 20–25, 28–29, 37–46, 49–56
server/services/core
assign.py	25	20	20%	16–60
data.py	26	16	38%	10–15, 19–23, 27–29, 33–34, 38–39
export.py	8	6	25%	8–21
room.py	61	56	8%	11–33, 41–89
student.py	41	38	7%	9–54
server/services/csv
__init__.py	18	12	33%	11–12, 19–22, 29–34
server/services/email
__init__.py	30	21	30%	18–59
smtp.py	39	11	72%	15, 27–29, 31–33, 49–52
server/services/email/templates
__init__.py	33	1	97%	20
server/services/google
__init__.py	54	29	46%	23, 31, 33, 41–44, 48–54, 58–77
server/typings
exception.py	25	9	64%	16–29, 35, 41–42, 51, 54
server/utils
date.py	7	4	43%	17–19, 30
misc.py	6	5	17%	5–9
TOTAL	1377	773	44%

Tests	Skipped	Failures	Errors	Time
16	0 :zzz:	0 :x:	0 :fire:	0.686s :stopwatch:

github-actions[bot] commented 9 months ago

Coverage for unit tests for Python 3.10

File	Stmts	Miss	Cover	Missing
server
__init__.py	42	4	90%	20–21, 46, 54
forms.py	88	10	89%	18–20, 45–47, 97–100
models.py	153	33	78%	28, 56, 59, 62, 88, 92, 95–104, 107, 110, 124, 127–129, 132, 136, 148, 152, 156, 160–161, 167, 187, 190, 211, 214, 228
views.py	412	330	20%	33–38, 51–52, 70–88, 99–101, 110–117, 126, 137–140, 150–169, 181–205, 213–235, 247–251, 260–282, 291–293, 301–304, 312–337, 345–370, 378–406, 414–431, 438, 443–447, 456–458, 463–511, 516–521, 526–546, 551–566, 571–586, 596, 601, 606, 614–615, 621, 626–630
server/controllers
__init__.py	65	37	43%	25–52, 55, 66–86, 89
auth_controllers.py	38	25	34%	13–15, 21–47, 53–55
dev_login_controllers.py	34	23	32%	11–25, 30–39, 44–56
health_controllers.py	13	2	85%	17–18
server/services/auth
__init__.py	28	4	86%	21, 49, 54–55
server/services/canvas
__init__.py	68	51	25%	18–25, 29, 33, 37, 47–80, 84–99, 103
fake_canvas.py	39	26	33%	9, 12, 15, 20–25, 28–29, 37–46, 49–56
server/services/core
assign.py	25	20	20%	16–60
data.py	26	16	38%	10–15, 19–23, 27–29, 33–34, 38–39
export.py	8	6	25%	8–21
room.py	61	56	8%	11–33, 41–89
student.py	41	38	7%	9–54
server/services/csv
__init__.py	18	12	33%	11–12, 19–22, 29–34
server/services/email
__init__.py	30	21	30%	18–59
smtp.py	39	11	72%	15, 27–29, 31–33, 49–52
server/services/email/templates
__init__.py	33	1	97%	20
server/services/google
__init__.py	54	29	46%	23, 31, 33, 41–44, 48–54, 58–77
server/typings
exception.py	25	9	64%	16–29, 35, 41–42, 51, 54
server/utils
date.py	7	4	43%	17–19, 30
misc.py	6	5	17%	5–9
TOTAL	1377	773	44%

Tests	Skipped	Failures	Errors	Time
16	0 :zzz:	0 :x:	0 :fire:	5.702s :stopwatch:

github-actions[bot] commented 9 months ago

Coverage for unit tests for Python 3.12

File	Stmts	Miss	Cover	Missing
server
__init__.py	42	4	90%	20–21, 46, 54
forms.py	88	10	89%	18–20, 45–47, 97–100
models.py	153	33	78%	28, 56, 59, 62, 88, 92, 95–104, 107, 110, 124, 127–129, 132, 136, 148, 152, 156, 160–161, 167, 187, 190, 211, 214, 228
views.py	412	330	20%	33–38, 51–52, 70–88, 99–101, 110–117, 126, 137–140, 150–169, 181–205, 213–235, 247–251, 260–282, 291–293, 301–304, 312–337, 345–370, 378–406, 414–431, 438, 443–447, 456–458, 463–511, 516–521, 526–546, 551–566, 571–586, 596, 601, 606, 614–615, 621, 626–630
server/controllers
__init__.py	65	37	43%	25–52, 55, 66–86, 89
auth_controllers.py	38	25	34%	13–15, 21–47, 53–55
dev_login_controllers.py	34	23	32%	11–25, 30–39, 44–56
health_controllers.py	13	2	85%	17–18
server/services/auth
__init__.py	28	4	86%	21, 49, 54–55
server/services/canvas
__init__.py	68	51	25%	18–25, 29, 33, 37, 47–80, 84–99, 103
fake_canvas.py	39	26	33%	9, 12, 15, 20–25, 28–29, 37–46, 49–56
server/services/core
assign.py	25	20	20%	16–60
data.py	26	16	38%	10–15, 19–23, 27–29, 33–34, 38–39
export.py	8	6	25%	8–21
room.py	61	56	8%	11–33, 41–89
student.py	41	38	7%	9–54
server/services/csv
__init__.py	18	12	33%	11–12, 19–22, 29–34
server/services/email
__init__.py	30	21	30%	18–59
smtp.py	39	11	72%	15, 27–29, 31–33, 49–52
server/services/email/templates
__init__.py	33	1	97%	20
server/services/google
__init__.py	54	29	46%	23, 31, 33, 41–44, 48–54, 58–77
server/typings
exception.py	25	9	64%	16–29, 35, 41–42, 51, 54
server/utils
date.py	7	4	43%	17–19, 30
misc.py	6	5	17%	5–9
TOTAL	1377	773	44%

Tests	Skipped	Failures	Errors	Time
16	0 :zzz:	0 :x:	0 :fire:	0.705s :stopwatch:

github-actions[bot] commented 9 months ago

Coverage for e2e tests for Python 3.11

File	Stmts	Miss	Cover	Missing
server
__init__.py	42	10	76%	12, 15–21, 26, 46, 54
forms.py	88	10	89%	18–20, 45–47, 97–100
models.py	153	35	77%	27–30, 56, 59, 62, 88, 92, 95–104, 107, 110, 124, 127–129, 132, 136, 148, 152, 156, 160–161, 167, 187, 190, 211, 214, 228
views.py	412	330	20%	33–38, 51–52, 70–88, 99–101, 110–117, 126, 137–140, 150–169, 181–205, 213–235, 247–251, 260–282, 291–293, 301–304, 312–337, 345–370, 378–406, 414–431, 438, 443–447, 456–458, 463–511, 516–521, 526–546, 551–566, 571–586, 596, 601, 606, 614–615, 621, 626–630
server/controllers
__init__.py	65	37	43%	25–52, 55, 66–86, 89
auth_controllers.py	38	25	34%	13–15, 21–47, 53–55
dev_login_controllers.py	34	23	32%	11–25, 30–39, 44–56
health_controllers.py	13	7	46%	8, 13–18
server/services/auth
__init__.py	28	6	79%	21, 49, 54–55, 60–61
server/services/canvas
__init__.py	68	51	25%	18–25, 29, 33, 37, 47–80, 84–99, 103
fake_canvas.py	39	26	33%	9, 12, 15, 20–25, 28–29, 37–46, 49–56
server/services/core
assign.py	25	20	20%	16–60
data.py	26	16	38%	10–15, 19–23, 27–29, 33–34, 38–39
export.py	8	6	25%	8–21
room.py	61	56	8%	11–33, 41–89
student.py	41	38	7%	9–54
server/services/csv
__init__.py	18	12	33%	11–12, 19–22, 29–34
server/services/email
__init__.py	30	21	30%	18–59
smtp.py	39	27	31%	15, 24–52
server/services/email/templates
__init__.py	33	23	30%	9–11, 14–17, 20, 30–41, 45–47
server/services/google
__init__.py	54	29	46%	23, 31, 33, 41–44, 48–54, 58–77
server/typings
exception.py	25	9	64%	16–29, 35, 41–42, 51, 54
server/utils
date.py	7	4	43%	17–19, 30
misc.py	6	5	17%	5–9
TOTAL	1377	826	40%

Tests	Skipped	Failures	Errors	Time
8	0 :zzz:	0 :x:	0 :fire:	18.799s :stopwatch:

github-actions[bot] commented 9 months ago

Coverage for e2e tests for Python 3.10

File	Stmts	Miss	Cover	Missing
server
__init__.py	42	10	76%	12, 15–21, 26, 46, 54
forms.py	88	10	89%	18–20, 45–47, 97–100
models.py	153	35	77%	27–30, 56, 59, 62, 88, 92, 95–104, 107, 110, 124, 127–129, 132, 136, 148, 152, 156, 160–161, 167, 187, 190, 211, 214, 228
views.py	412	330	20%	33–38, 51–52, 70–88, 99–101, 110–117, 126, 137–140, 150–169, 181–205, 213–235, 247–251, 260–282, 291–293, 301–304, 312–337, 345–370, 378–406, 414–431, 438, 443–447, 456–458, 463–511, 516–521, 526–546, 551–566, 571–586, 596, 601, 606, 614–615, 621, 626–630
server/controllers
__init__.py	65	37	43%	25–52, 55, 66–86, 89
auth_controllers.py	38	25	34%	13–15, 21–47, 53–55
dev_login_controllers.py	34	23	32%	11–25, 30–39, 44–56
health_controllers.py	13	7	46%	8, 13–18
server/services/auth
__init__.py	28	6	79%	21, 49, 54–55, 60–61
server/services/canvas
__init__.py	68	51	25%	18–25, 29, 33, 37, 47–80, 84–99, 103
fake_canvas.py	39	26	33%	9, 12, 15, 20–25, 28–29, 37–46, 49–56
server/services/core
assign.py	25	20	20%	16–60
data.py	26	16	38%	10–15, 19–23, 27–29, 33–34, 38–39
export.py	8	6	25%	8–21
room.py	61	56	8%	11–33, 41–89
student.py	41	38	7%	9–54
server/services/csv
__init__.py	18	12	33%	11–12, 19–22, 29–34
server/services/email
__init__.py	30	21	30%	18–59
smtp.py	39	27	31%	15, 24–52
server/services/email/templates
__init__.py	33	23	30%	9–11, 14–17, 20, 30–41, 45–47
server/services/google
__init__.py	54	29	46%	23, 31, 33, 41–44, 48–54, 58–77
server/typings
exception.py	25	9	64%	16–29, 35, 41–42, 51, 54
server/utils
date.py	7	4	43%	17–19, 30
misc.py	6	5	17%	5–9
TOTAL	1377	826	40%

Tests	Skipped	Failures	Errors	Time
8	0 :zzz:	0 :x:	0 :fire:	20.224s :stopwatch:

codecov[bot] commented 9 months ago

Codecov Report

Attention: 212 lines in your changes are missing coverage. Please review.

Comparison is base (98b56a5) 45.41% compared to head (bfa967a) 43.86%.

Files	Patch %	Lines
server/views.py	14.10%	67 Missing :warning:
server/services/core/room.py	8.19%	56 Missing :warning:
server/services/core/student.py	7.31%	38 Missing :warning:
server/services/canvas/__init__.py	5.88%	16 Missing :warning:
server/services/core/data.py	40.90%	13 Missing :warning:
server/services/csv/__init__.py	33.33%	12 Missing :warning:
server/services/core/export.py	25.00%	6 Missing :warning:
server/forms.py	83.33%	4 Missing :warning:

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #32 +/- ## ========================================== - Coverage 45.41% 43.86% -1.55% ========================================== Files 22 26 +4 Lines 1264 1377 +113 ========================================== + Hits 574 604 +30 - Misses 690 773 +83 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

github-actions[bot] commented 9 months ago

Coverage for e2e tests for Python 3.12

File	Stmts	Miss	Cover	Missing
server
__init__.py	42	10	76%	12, 15–21, 26, 46, 54
forms.py	88	10	89%	18–20, 45–47, 97–100
models.py	153	35	77%	27–30, 56, 59, 62, 88, 92, 95–104, 107, 110, 124, 127–129, 132, 136, 148, 152, 156, 160–161, 167, 187, 190, 211, 214, 228
views.py	412	330	20%	33–38, 51–52, 70–88, 99–101, 110–117, 126, 137–140, 150–169, 181–205, 213–235, 247–251, 260–282, 291–293, 301–304, 312–337, 345–370, 378–406, 414–431, 438, 443–447, 456–458, 463–511, 516–521, 526–546, 551–566, 571–586, 596, 601, 606, 614–615, 621, 626–630
server/controllers
__init__.py	65	37	43%	25–52, 55, 66–86, 89
auth_controllers.py	38	25	34%	13–15, 21–47, 53–55
dev_login_controllers.py	34	23	32%	11–25, 30–39, 44–56
health_controllers.py	13	7	46%	8, 13–18
server/services/auth
__init__.py	28	6	79%	21, 49, 54–55, 60–61
server/services/canvas
__init__.py	68	51	25%	18–25, 29, 33, 37, 47–80, 84–99, 103
fake_canvas.py	39	26	33%	9, 12, 15, 20–25, 28–29, 37–46, 49–56
server/services/core
assign.py	25	20	20%	16–60
data.py	26	16	38%	10–15, 19–23, 27–29, 33–34, 38–39
export.py	8	6	25%	8–21
room.py	61	56	8%	11–33, 41–89
student.py	41	38	7%	9–54
server/services/csv
__init__.py	18	12	33%	11–12, 19–22, 29–34
server/services/email
__init__.py	30	21	30%	18–59
smtp.py	39	27	31%	15, 24–52
server/services/email/templates
__init__.py	33	23	30%	9–11, 14–17, 20, 30–41, 45–47
server/services/google
__init__.py	54	29	46%	23, 31, 33, 41–44, 48–54, 58–77
server/typings
exception.py	25	9	64%	16–29, 35, 41–42, 51, 54
server/utils
date.py	7	4	43%	17–19, 30
misc.py	6	5	17%	5–9
TOTAL	1377	826	40%

Tests	Skipped	Failures	Errors	Time
8	0 :zzz:	0 :x:	0 :fire:	33.800s :stopwatch:

berkeley-cdss / seating

Feat: CSV Import and Export #32

Codecov Report