[Topic Entry] Data science: Tokenization - Githubissues

Codecademy / docs

Codecademy Docs is a collection of information for all things code. 📕

https://www.codecademy.com/resources/docs

771 stars 3.48k forks source link

[Topic Entry] Data science: Tokenization #4949

Closed dakshdeepHERE closed 2 months ago

dakshdeepHERE commented 2 months ago

Reason/inspiration (optional)

Adding an entry related to Tokenization present on the path Codecademy/docs/content/general/concepts/tokenization/tokenization.md.

This entry includes:

Information about tokenization and how it is used in the field of AI and ML.
Types of Tokenization
Importance in NLP

Entry Type (select all that apply)

New Topic Entry

Code of Conduct

[X] By submitting this issue, I agree to follow Codecademy Doc's Code of Conduct.

For Maintainers

[X] Labels added
[X] Issue is assigned

github-actions[bot] commented 2 months ago

🌸 Thanks for closing this Issue! Please head over to the Docs Forum if you have any questions about Docs, or reply to the thread on Possible Content Discussion to share ideas and collaborate with other contributors, maintainers, or super users to determine good future issues that will help expand Docs!