search

shyamsn97 / mario-gpt

[Neurips 2023] Generating Mario Levels with GPT2. Code for the paper "MarioGPT: Open-Ended Text2Level Generation through Large Language Models" https://arxiv.org/abs/2302.05981
https://huggingface.co/shyamsn97/Mario-GPT2-700-context-length
MIT License
1.12k stars 101 forks source link

Some simple benchmarks #14

Open TheFiZi opened 1 year ago

TheFiZi commented 1 year ago

I don't see the Wiki enabled in this repo or I'd suggest putting them there. Maybe a new section at the bottom of the README so people can get a general idea of how long generation takes?

This was with the default example provided in the README

#MarioGPU Benchmarks
## CPU (Intel i7-12700K)
Execution time: 293.0745s

## CPU (AMD Ryzen 9 5950X)
Execution time: 384.3558s

## CPU (Intel Xeon E-2176G (2 cores))
Execution time: 751.6939s

## CUDA (Nvidia Quadro P620)
Execution time: 186.1026s

## CUDA (Nvidia 3070)
Execution time: 21.4382s

## CUDA (Nvidia 3090 Ti)
Execution time: 11.7694s
shyamsn97 commented 1 year ago

Sounds good!