Incorrect formatting of the text as code (5.3.1 Temperature scaling)

[labdmitriy]

Bug description

Hi @rasbt,

Probably the sentence between two code blocks was mistakenly merged with this blocks:

def softmax_with_temperature(logits, temperature):
    scaled_logits = logits / temperature
    return torch.softmax(scaled_logits, dim=0)
Temperatures greater than 1 result in more uniformly distributed token probabilities,
and Temperatures smaller than 1 will result in more confident (sharper or more peaky)
distributions. Let's illustrate this by plotting the original probabilities alongside
probabilities scaled with different temperature values:
temperatures = [1, 0.1, 5]     #A
scaled_probas = [softmax_with_temperature(next_token_logits, T) for T in temperatures]
x = torch.arange(len(vocab))
bar_width = 0.15
fig, ax = plt.subplots(figsize=(5, 3))
for i, T in enumerate(temperatures):
    rects = ax.bar(x + i * bar_width, scaled_probas[i],
                           bar_width, label=f'Temperature = {T}')
ax.set_ylabel('Probability')
ax.set_xticks(x)
ax.set_xticklabels(vocab.keys(), rotation=90)
ax.legend()
plt.tight_layout()
plt.show()

Thank you.

What operating system are you using?

None

Where do you run your code?

None

Environment

[d-kleine]

in live book

[labdmitriy]

And also in PDF.

[rasbt]

Ah yes, you are right. It's fine in the layouted PDF but definitely looks incorrect online. One of the things that hopefully gets resolved soon when the layouts are synced. Thanks!