albertvillanova commented 2 years ago

uid: bloom_library
type: primary
description:
- name: Bloom Library
- description: SIL International’s innovative Bloom software eases the process of bookmaking so that more people can participate – if you can type on a computer, you can create a book in Bloom.
Bloom users can create an original text or select a template, called a “shell book,” and insert culturally appropriate pictures and local translations of text. The books created can then be saved as a PDF and distributed in printed or electronic form. It is also possible to use Bloom to create EPUBs and “talking books.”

SIL has been developing and using Bloom since 2011. For the All Children Reading Enabling Writers competition, SIL added features to let Bloom users create decodable texts and leveled readers. Literacy specialists can create “Reader Templates” that help writers create texts for specific languages that are decodable at various stages of learning and conform to leveling guidelines.
- homepage: https://bloomlibrary.org/
- validated: True
languages:
- language_names:
- Niger-Congo
- English
- Chinese
- Indic
- Vietnamese
- Portuguese
- Spanish
- Indonesian
- French
- Arabic
- Akan
- Fon
- isiZulu
- Kinyarwanda
- Kikuyu
- Swahili
- Assamese
- Bengali
- Gujarati
- Hindi
- Kannada
- Malayalam
- Marathi
- Telugu
- Tamil
- Urdu
- ar-MSA
- ar-TN
- English
- Spanish, Castilian
- French
- Tok Pisin
- Hausa
- Thai
- Haitian, Haitian Creole
- Indonesian
- Russian
- Cebuano
- Nepali (individual language)
- Kirghiz, Kyrgyz
- Bengali, Bangla
- Kagayanen
- Dotyali
- Maithili
- Kalanguya, Kayapa Kallahan
- Dangaura Tharu
- Bhojpuri
- Awadhi
- Swahili (individual language), Kiswahili
- German
- Mam
- Portuguese
- Korean
- K'iche', Quiché
- Q'anjob'al, Kanjobal
- Papua New Guinean Sign Language
- Tetun Dili
- Akha
- Maru, Lhaovo
- Bisu
- Khmer, Central Khmer
- Kaqchikel, Cakchiquel
- Tagalog
- Kanuri
- Fali
- Chinese
- Mamara Senoufo
- Soninke
- Athpariya
- Krung
- Lü
- Fataluku
- Nehan
- Tampuan
- Kwakum
- Western Tamang
- Pijin
- South Tairora
- Hindi
- Gapapaiwa
- Makasae
- Afrikaans
- Kamano
- Waray (Australia)
- Kanite
- Zulu
- Tibetan
- Bunak
- Mambae
- Western Juxtlahuaca Mixtec
- Jarai
- Nauete
- Surigaonon
- Galolen
- Kannada
- Kikuyu, Gikuyu
- Terik
- Bu-Nao Bunu
- Burmese
- Lugbara
- Malay (individual language)
- North Tanna
- Tamil
- Baikeno
- Malayalam
- Marathi
- Salvadoran Sign Language
- Sos Kundi
- Honduras Sign Language
- Mumuye
- Western Niger Fulfulde
- Filipino, Pilipino
- Lao
- Peranakan Indonesian
- Teop
- Braj
- Eastern Lawa
- Adamawa Fulfulde
- Indian Sign Language
- Mandaya
- Nepalese Sign Language
- Urdu
- Western Durango Nahuatl
- Zarma
- Guatemalan Sign Language
- Gujarati
- Hakö
- Isthmus-Mecayapan Nahuatl
- Petats
- Sibe
- Yamap
- Halia
- Naasioi
- Pedi, Northern Sotho, Sepedi
- Turka
- Tiéyaxo Bozo
- Jenaama Bozo
- Dagbani
- Lengo
- Lahu
- Masaaba
- Panjabi, Punjabi
- Saposa
- Terei
- Teso
- Tswana
- Vietnamese
- Vili
- Akeu
- Amri Karbi
- Chuka, Gichuka
- Eastern Apurímac Quechua
- Ganda, Luganda
- Hiligaynon
- Northern Kurdish
- Limbum
- Mon
- Dutch, Flemish
- Nigerian Fulfulde
- Rotokas
- Shan
- Soga
- South Nuaulu
- Yetfa
- Adangme
- Bafaw-Balong
- Bambili-Bambui
- Bislama
- Sanskrit
- Bukusu, Lubukusu
- Candoshi-Shapra
- Chitwania Tharu
- Cimbrian
- Western Dani
- Ghotuo
- Ilwana, Kiwilwana
- Javanese
- Kamwe
- Kimaragang
- Kinyarwanda
- Lhomi
- Loke
- Kabras, Lukabaras
- Tachoni, Lutachoni
- Marwari (Pakistan)
- Meru
- Meta'
- Ngaju
- Nias
- Ntcham
- Nyungwe
- Obolo
- Od
- Ravula
- Riang (India)
- Semai
- Southern Balochi
- Tairaha
- Northern Thai
- Toraja-Sa'dan
- Tsonga
- Tz'utujil
- Pokomo, Kipfokomo
- Wa
- Yanesha'
- Adangbe
- Aghem
- Akan
- Akoose
- Alor
- Ambai
- Guerrero Amuzgo
- Arabic
- Aragonese
- Awing
- Ambala Ayta
- Babanki
- Bafut
- Baka (Cameroon)
- Bakoko
- Bambam
- Bamenyam
- Batak
- Batak Toba
- Bima
- Buwal
- Digo, Chidigo
- Duruma, Chiduruma
- Cia-Cia
- Swampy Cree
- Cusco Quechua
- Dakka
- Dela-Oenale
- Duri
- Dusun Malang
- Elip
- Esimbi
- Ewondo
- Gadsup
- Gavar
- Gourmanchéma
- Gun
- Italian
- Japanese
- Kaera
- Da'a Kaili
- Kalumpang
- Kendayan, Salako
- Kenyang
- Upper Kinabatangan
- Tharaka, Kitharaka
- Koalib
- Kodi
- Lamboya
- Lamnso'
- Lefa
- Lole
- Makhuwa-Meetto
- Papuan Malay
- Malila
- Mamasa
- Manambu
- Mandar
- Manggarai
- Masbatenyo
- Matal
- Maxi Gbe
- Mbudum
- Mengaka
- Ayutla Mixtec
- Tlacoapa Me'phaa, Tlacoapa Tlapanec
- Mmen
- Central Mnong
- Mofu-Gudur
- Mokpwe
- Moloko
- Mpumpong
- Mpur
- Muduga
- Mundani
- Muthuvan
- Narim
- Naskapi
- Ndo
- Ndut
- Ngomba
- Ngombale
- Ngwe
- Ngwo
- Njyem
- Nyole
- Odia (individual language), Oriya (individual language)
- Eastern Ojibwa
- Pagibete
- Pancana
- Panchpargania
- Paniya
- Punan Tubu
- Margos-Yarowilca-Lauricocha Quechua
- Lambayeque Quechua
- Ranglong
- Rendille
- Ruching Palaung
- Rusyn
- Samburu
- Sangil
- Sasak
- Segai
- Somali
- Suba
- Swo
- Tajio
- Taveta
- Tehit
- Telugu
- Southern Tidung
- Tolaki
- Toma
- Tombulu
- Tontemboan
- Topoiyo
- Tsamai
- Tuki
- Turkana
- Uab Meto
- Ulumanda'
- Umatilla
- Usarufa
- Waata
- Walak
- Wambon
- Wanukaka
- Wayuu
- Wejewa
- Western Bru
- Wolio
- Yale
- Yasa
- Yemba
- Yiddish
- language_comments: This resource includes books, primers, etc. in 422 languages that are templated such that they can be rapidly translated into many languages. It includes many languages that aren't listed here in this data catalogue interface in addition to the ones I have selected.
- language_locations:
- World-Wide
- validated: False
custodian:
- name: SIL International
- in_catalogue:
- type: A nonprofit/NGO (other)
- location: United States of America
- contact_name: Bloom Library
- contact_email: dan_whitenack@sil.org
- contact_submitter: False
- additional: https://www.sil.org/
- validated: False
availability:
- procurement:
- for_download: Yes - it has a direct download link or links
- download_url: https://bloomlibrary.org/
- download_email:
- licensing:
- has_licenses: Yes
- license_text: All of your book's content must be either in the public domain, your own content, or content that you have permission to republish. Your book's Credits or Title Page must give credit to images used and describe the terms under which they are being used in the book (e.g. Creative Commons license). The presence of an image on the Internet (a blog, news reports, a clipart site, etc.) does not give you the right to republish it here, even if you give credit. Nor does a site saying "Royalty Free".
- license_properties:
  - open license
- license_list:
  - cc-by-sa-4.0: Creative Commons Attribution Share Alike 4.0 International
- pii:
- has_pii: No
- generic_pii_likely:
- generic_pii_list:
- numeric_pii_likely:
- numeric_pii_list:
- sensitive_pii_likely:
- sensitive_pii_list:
- no_pii_justification_class: general knowledge not written by or referring to private persons
- no_pii_justification_text:
- validated: False
source_category:
- category_type: collection
- category_web:
- category_media: books/book publisher
- validated: False
media:
- category:
- text
- image
- audiovisual
- text_format:
- other
- There is a Bloom reader format. However Daniel Whitenack at SIL (dan_whitenack@sil.org) has access to and can parse the text portions of the books.
- audiovisual_format:
- .MP4
- .WAV
- image_format:
- .PNG
- database_format:
- text_is_transcribed: No
- instance_type: book
- instance_count: n<100
- instance_size: 100<n<10,000
- validated: False
fname: bloom_library.json

cccntu commented 2 years ago

I don't see a direct link to download all of the data at once. Should we write code to crawl it, or contact the site owner first? similar situation: #230 #241

albertvillanova commented 2 years ago

Hi @cccntu,

Yes, I agree: no direct link seems to exist

Moreover, crawling their site is forbidden by their terms of use: https://bloomlibrary.org/page/termsOfUse

Acts Against the Site/Services 

...
(f) using manual or automated software, devices, scripts, robots, or other means or processes to access, "scrape," "crawl," or "spider" any pages contained in the Site;

I guess we should contact site owners first to ask for permission.

CC: @yjernite

apergo-ai commented 2 years ago

self-assign

apergo-ai commented 2 years ago

request for permission sent

albertvillanova commented 2 years ago

Thanks, @apergo-ai. Any feedback on this? Did you contact Daniel Whitenack from SIL?

apergo-ai commented 2 years ago

They are working on it. I'll check

bigscience-workshop / data_tooling

Create dataset bloom_library #198

self-assign