Understanding networks exercise

DTUComputeCognitiveSystems / AI_playground

A set of demos for teaching and introducing students to advanced AI-models with few prerequisites.

Apache License 2.0

5 stars 1 forks source link

Understanding networks exercise #8

Closed NorthGuard closed 6 years ago

NorthGuard commented 6 years ago

Basic Idea:

Plot three lines depending on user-chosen normal-vectors
Plot with a user-chosen point and its projections on these vectors
Plot with neural network using these parameters
Perhaps a plot with a trained neural network (which will probably chose a different set of lines)
Discuss why

NorthGuard commented 6 years ago

This was from meeting with Lars: Consider motivation with RBG colors in coordinate system. Simple colored images -> mean color -> 3D coordinate system showing that they can be separated. This should maybe be in the image-notebook, but it motivates the geometrical idea like in this notebook.

NorthGuard commented 6 years ago

From our meeting this morning:

2nd plot, 3rd code-block: Lars would like biases in vectors. It would be awesome to have the vectors defined in widgets
4th plot, 5th code-block: Add "%matplotlib notebook" to cell - 3D plots are great when interactive Make surface a plane that exactly separates blue from red
5th plot, 6th code-block: Make x and y meshes fit with data. Perhaps define a range (fx. (-7, 7)) and use this range for both mesh-grid and for ax.set_xlim etc.

We also need more text :/ Perhaps we can meet later and discuss text-parts.

SkafteNicki commented 6 years ago

As discussed yesterday, this exercise more or less only needs text now. I have added some, but if it is meant to take 2 hours (normal exercise session at DTU) then it definitely need to more. We should get Lars comments on this.

NorthGuard commented 6 years ago

From meeting:

Start out with exercise about projections (right half of Lars whiteboard)
- Make the derivation of dot-product being related to the angle between vectors
- Make a plot with vectors (that you can adjust), and visualize the projections (the vector may be "fatter" on the projection)
- Hopefully they get comfortable with the concept
Second part (left half of whiteboard).
- Start out with an equation where a is related to three parameters
- Derive that this is a line
- Learn how to place a line (parhaps fill a plot with datapoints and have them separate two seperable groups).
- That feeds into the exercise of the three lines and the circled data

SkafteNicki commented 6 years ago

Closing this know, since the notebook is practically done.