when I run train script, an errors occurs

[BitcoinNLPer]

When I run this train script, I encounter some errors. The error log is as follows:

Do you know how to solve it?

Furthermore. there are too many files in code_clippy_data file. Is there a script to download this dataset conveniently?

[reshinthadithyan]

Hello. As we discussed, this is a python specific error. You'll have to reset your recursion limit to some higher number. Refer here. Feel free to re-open the issue if something pops up. Thanks.

[BitcoinNLPer]

Hi, I increased the number of layers for the file with the error, and found that the error is still reported. I want to ask two questions.

• May I just clone this project and install the corresponding library, and then I can run run_clm_streaming_flax.py? Do I need to download more than 200g of training corpus into my local server? Or does it download automatically? Can you provide a more detailed pre-training guide?
• The server I use has a GPU, so why do I run run_clm_streaming_flax.py directly and use the CPU by default?

Thanks!