search

cschaffner / InformationTheory

Documents for Information Theory used in Master of Logic course Information Theory at the UvA
Other
34 stars 13 forks source link

Check practice problems #1 #2

Closed Yfke closed 8 years ago

Yfke commented 8 years ago

I have added some practice problems for Tuesday's tutorial based on the ideas we discussed, can you have a look at them and make changes/additions as needed? They are in staging.

cschaffner commented 8 years ago

Cool, I think it's good, I've slightly rearranged. and made the "only if" part of the uniform entropy a "slightly harder" one. Or is there an easy way of proving this without using the "only if" part of Jensen's inequality? See #3

Yfke commented 8 years ago

No I think you do need Jensen for that direction. Using Jensen will already give you both directions at the same time of course, but separating it like this is probably better.

In the homework I want to put at least one exercise using Jensen's inequality so it would be good to practice this one with the students tomorrow even though it is a bit harder.

cschaffner commented 8 years ago

They will not have seen Jensen yet after the two hours tomorrow, it's only happening on Friday...

Yfke commented 8 years ago

O of course, you are right. Is it possible to do without Jensen, or should we postpone the starred exercise entirely until next week's exercise session?

cschaffner commented 8 years ago

I think we can leave it in as a challenge for those who'd like to try before having seen the tools. Anyway, I don't think there will be time to do all of them in the 2 hours. Maybe only: 1abc, 3abc, 4ab, 5abc, 6ab ? So, all but: 1d, 2, 4, 5

Yfke commented 8 years ago

Apparently github treats text between *'s as emphasized, so that list was challenging to decode 😆 but, yes, I agree that would be a good set.