The Trading Environment provides an environment for single-instrument trading using historical bar data.
See here for a jupyter notebook describing basic usage and illustrating a (sometimes) winning strategy based on policy gradients implemented on tensorflow.