search

corl-team / CORL

High-quality single-file implementations of SOTA Offline and Offline-to-Online RL algorithms: AWAC, BC, CQL, DT, EDAC, IQL, SAC-N, TD3+BC, LB-SAC, SPOT, Cal-QL, ReBRAC
https://corl-team.github.io/CORL
Apache License 2.0
416 stars 15 forks source link

[Docs] Mention request for JAX-CORL #18

Open nissymori opened 1 month ago

nissymori commented 1 month ago

Dear CORL Team,

Firstly, I would like to express my appreciation for your work on the CORL codebase. The clean, single-file implementation coupled with a robust performance report has greatly impressed me, and I truly enjoy using it.

As someone who predominantly uses JAX in my research due to its speed and efficiency, I realized the potential value of a JAX-based counterpart to CORL. To address this gap, I recently launched JAX-CORL, which provides single-file implementations of Offline RL algorithms specifically in JAX.

Currently, JAX-CORL includes three algorithms: AWAC, IQL, and TD3+BC, and I have plans to expand it further to include other algorithms such as CQL, DT, and TD7 in near future.

Understanding that my repository is still in the early stages compared to CORL, I would be immensely grateful if you could consider mentioning JAX-CORL as a JAX-based single-file codebase for offline RL in your README.md. This acknowledgment would not only help in reaching more researchers who could benefit from this resource but also potentially foster further collaborative enhancements.

Thank you for considering this request.

Howuhh commented 1 month ago

@nissymori Hi! You're doing a really cool work! We will definitely mention it, but for now CORL is in a slightly frozen state. We think it might move to Farama-Foundation soon, so we're not changing anything right now.

nissymori commented 1 month ago

Thank you for the warm words! I understand the situation and continue development to make the repo more useful by the time it is mentioned!