bayesoptbook / bayesoptbook.github.io

Companion webpage for the book "Bayesian Optimization" by Roman Garnett
MIT License
876 stars 42 forks source link

Transformers and Deep GPs as Alternative Surrogate Models in Section 8.11 #37

Closed Ryan-Rhys closed 2 years ago

Ryan-Rhys commented 2 years ago

Description of issue Appreciate this is a late addition! I was wondering if it may be worth referencing transformers [1] and deep GPs [2] in section 8.11 when discussing alternative surrogate models?

Proposed resolution

[1] Maraval, A., Zimmer, M., Grosnit, A., Tutunov, R., Wang, J. and Ammar, H.B., Sample-Efficient Optimisation with Probabilistic Transformer Surrogates. arXiv, 2022.

[2] Dai, Z., Damianou, A., González, J. and Lawrence, N., Variational Auto-Encoded Deep Gaussian Processes. ICLR, 2016.

bayesoptbook commented 2 years ago

Sorry for the delay and thank you for the suggestion. I somehow managed to squeeze these citations in; will appear in an updated/the final version!