PaddlePaddle / Paddle

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (『飞桨』核心框架,深度学习&机器学习高性能单机、分布式训练和跨平台部署)
http://www.paddlepaddle.org/
Apache License 2.0
21.66k stars 5.44k forks source link

Save checkpoint automatically. #25391

Closed gongweibao closed 3 years ago

gongweibao commented 3 years ago

PR types

New features

PR changes

APIs

Describe

Automatic checkpoint is used under two scenes:

  1. When user use auto_checkpoint.train_epoch_range:

    import paddle.fluid.incubate.auto_checkpoint as acp
    for i in acp.train_epoch_range(3):
      for data in data_loader():
            exe.run(program, data, fetch)
  2. Otherwise it useful when user use DataLoader.from_generator

    data_loader=DataLoader.from_generator(reader)
    for i in range(3):
      for data in data_loader():
            exe.run(program, data, fetch)

It's only used on paddlecloud platform now.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

✅ This PR's description meets the template requirements! Please wait for other CI results.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.

paddle-bot-old[bot] commented 3 years ago

Thanks for your contribution! Please add test = develop in your commit message to trigger CI to ensure your PR can be merged. See Paddle CI Manual for details.