learning-software-engineering / learning-software-engineering.github.io

MIT License
15 stars 202 forks source link

Created New markdown file for the issue #562

Closed Adrianhui123 closed 6 months ago

Adrianhui123 commented 6 months ago

Created New markdown file for the issue with preliminary write ups for the Introduction and Understanding Section, Application section(Code Generation part), as well as Citation section

Adrianhui123 commented 6 months ago

For citations, use a consistent format and provide a descriptive text for the links, so readers know what to expect when they click on them. Use eitherinline links and reference-style links.

Yeah i added a placeholder title for the link to make it more intuitive

sfnicholas commented 6 months ago

Can you add some commonly used LLM examples? so students can relate better what they are learning.

Adrianhui123 commented 6 months ago

Can you add some commonly used LLM examples? so students can relate better what they are learning.

Yes added some common examples, i also have Imagine prompting an LLM with the sentence "The sunset over the ocean was a breathtaking sight," and the model continues with "as the hues of pink and orange painted a masterpiece in the sky, reflecting the day's end with a promise of renewal." This example showcases the model's ability to continue the narrative in a way that's contextually appropriate and stylistically coherent.

for a common exmaple if you didn't see

sfnicholas commented 6 months ago

I find some interesting image online, do you think it is good to add this picture? It will be more vivid to introduce what is pre-training and fine tuning. https://www.researchgate.net/publication/373642018/figure/fig1/AS:11431281185751651@1693796764125/Overview-of-LLM-training-process-LLMs-learn-from-more-focused-inputs-at-each-stage-of.png

Adrianhui123 commented 6 months ago

https://www.researchgate.net/publication/373642018/figure/fig1/AS:11431281185751651@1693796764125/Overview-of-LLM-training-process-LLMs-learn-from-more-focused-inputs-at-each-stage-of.png

I think it is rather too comprehensive, we are working on a more baisic understanding page