search

princeton-nlp / calm-textgame

[EMNLP 2020] Keep CALM and Explore: Language Models for Action Generation in Text-based Games
65 stars 7 forks source link

Any try on other RL agent ? #5

Closed Hannibal046 closed 2 years ago

Hannibal046 commented 2 years ago

Hi, thanks for the great work of text game. I have one question about the RL agent. In this paper, your agent is Deep Reinforcement Relevance Network (DRRN) from ACL2016 paper. I am wondering did you ever conduct some preliminary experiments on more powerful encoding function like BERT for better contextualized word embedding ? Do you have some intuition for making Transformer as Q-network in DRL ? Much Thanks !

Hannibal046 commented 2 years ago

This paper solves my problem. https://arxiv.org/pdf/2107.08408.pdf