The proposed two medical datasets are named as CTRG-Brain-263K and CTRG-Chest-548K, respectively. CTRG-Brain-263K contains 263670 brain CT scans. CTRG-Chest-548K contains 548696 chest CT scans with authoritative diagnosis reports. We show some examples of the datasets in the 'example.rar' and some basic structures of the image captioning. The entire datasets are available at https://pan.baidu.com/s/1ucQNTaS1KKzaGfes4IPKEw code: nfyn