Use Praw + Huggingface to fine-tune a speech model against a specific subreddit

[dkmiller]

Idea: use Azure ML's v2 CLI (worst-case: fall back to Shrike).

• Component to map a subreddit name, credential, and some "filter" info to produce a JSONL dataset (shard by # posts / file)
  • Open question: accept a single subreddit or collection of them?
• Use Huggingface to fine-tune some models
  • E.g., NSFW or not, which tag (subreddit-specific)

Use this workspace? amlworkspace6upghgpmdpxoq

[dkmiller]

How to Fine-Tune GPT-2 for Text Generation

[dkmiller]

deberta-v3-large

One idea: train model to "speak like" a Subreddit, e.g. r/creepypasta or r/jokes.

[dkmiller]

🤗 > Fine-tune a pretrained model