Perhaps a small tutorial. Saying archives.php template translates to endpoint /rest/?my_archives=whatever/. And offer the non-dev wp user some common endpoints he might want to have a look at when installing his site.
Using existing WP concepts to establish what the API does would be a good way to introduce the endpoint usage section.
apedog proposes,
Using existing WP concepts to establish what the API does would be a good way to introduce the endpoint usage section.