kamranahmedse / developer-roadmap

Interactive roadmaps, guides and other educational content to help developers grow in their careers.
https://roadmap.sh
Other
296.36k stars 39.08k forks source link

Refactor: Hyperparameters [sub-topic] (Prompt Engineering): 1 current -> 4 new nodes #7584

Open iPoetDev opened 1 week ago

iPoetDev commented 1 week ago

Roadmap URL

https://draw.roadmap.sh/6716b80e791f57dd60650121

Suggestions

Context Copy editing in Q4 2024 to update/refresh entire Prompt Engineering roadmap (1st/last edit: May 2023)

Issue: Under LLM Settings, sub topic Hyperparameters is blank, null, with no content/links. Constraint: Current guidelines seek a concise single paragraph.

Backstory: In refreshing and researching LLM settings / hyperparameters, it was found / is obvious that Temperature and Top P are not the only ones. There are more, as follows:

  1. Top K (similar, not as available) Top P
  2. Stop Sequences
  3. Frequency Penalty
  4. Presence Penalty.

These are mostly available in OpenAI and or Google AI Studio, and less so on Anthropic, though by consensus, these are the other hyperparameters that could be exposed by direct API parameters (to be verified), when they may not be so readily available via Playground/Console UIs.

Condensing all of these into one paragraph (if inserted into one node only) will mean a loss of fidelity and meaning of their relative importance and usefulness to beginners. I.e. too compressed, and overly summarised.

Request:

Rational: Spliting a larger collective node / content into smaller discrete nodes / content improve readability, access and usefulness.

iPoetDev commented 1 week ago

Was closed without review, unclear as to why. Reached out in other channels.