Create dataset india_news_headlines_dataset

[albertvillanova]

• uid: india_news_headlines_dataset
• type: processed
• description:
  • name: India News Headlines Dataset
  • description: This news dataset is a persistent historical archive of noteable events in the Indian subcontinent from start-2001 to end-2020, recorded in real-time by the journalists of India. It contains approximately 3.4 million events published by Times of India. A majority of the data is focusing on Indian local news including national, city level and entertainment. The individual events can be explored in detail via the archives section on the agency website.
  • homepage: https://www.kaggle.com/therohk/india-headlines-news-dataset
  • validated: True
• languages:
  • language_names:
  • English
  • language_comments: Indian English
  • language_locations:
  • Southern Asia
  • India
  • validated: False
• custodian:
  • name: Rohit Kulkarni
  • in_catalogue:
  • type: A private individual
  • location: India
  • contact_name: Rohit Kulkarni
  • contact_email:
  • contact_submitter: False
  • additional: https://www.kaggle.com/therohk
  • validated: False
• availability:
  • procurement:
  • for_download: Yes - it has a direct download link or links
  • download_url: https://www.kaggle.com/therohk/india-headlines-news-dataset
  • download_email:
  • licensing:
  • has_licenses: Yes
  • license_text:
  • license_properties:
    • public domain
  • license_list:
    • cc0-1.0: Creative Commons Zero v1.0 Universal
  • pii:
  • has_pii: Yes
  • generic_pii_likely: very likely
  • generic_pii_list:
    • names
  • numeric_pii_likely: none
  • numeric_pii_list:
  • sensitive_pii_likely: unlikely
  • sensitive_pii_list:
    • political opinions
  • no_pii_justification_class:
  • no_pii_justification_text:
  • validated: False
• processed_from_primary:
  • from_primary: Taken from primary source
  • primary_availability: Yes - they are fully available
  • primary_license: Unclear / I don't know
  • primary_types:
  • web | news or magazine website
  • validated: False
  • from_primary_entries:
  • the_times_of_india
• media:
  • category:
  • text
  • text_format:
  • .CSV
  • audiovisual_format:
  • image_format:
  • database_format:
  • .CSV
  • text_is_transcribed: No
  • instance_type: article
  • instance_count: 1M<n<1B
  • instance_size: 100<n<10,000
  • validated: False
• fname: india_news_headlines_dataset.json

[albertvillanova]

Please note that although this dataset is already available at https://huggingface.co/datasets/times_of_india_news_headlines, it requires MANUAL download.

[albertvillanova]

DONE: https://huggingface.co/datasets/bigscience-catalogue-data/india_news_headlines_dataset

Example:

{'publish_date': 20010102,
 'headline_category': 'unknown',
 'headline_text': 'Status quo will not be disturbed at Ayodhya; says Vajpayee'}

[albertvillanova]

DONE: https://huggingface.co/datasets/bigscience-catalogue-lm-data/lm_en_india_news_headlines_dataset

{'text': 'Status quo will not be disturbed at Ayodhya; says Vajpayee'}