[Wizard of Wikipedia] dataset download

[aagohary]

Hi, I am not familiar with ParlAI setup and I am interested in examining some examples from the Wizard of Wikipedia benchmark. Would you please point me to where I can find the dataset. Thanks!

[jaseweston]

Info is here:

http://parl.ai/projects/wizard_of_wikipedia/

On Wed, Mar 20, 2019 at 6:23 AM Ahmed Elgohary notifications@github.com wrote:

Hi, I am not familiar with ParlAI setup and I am interested in examining some examples from the Wizard of Wikipedia benchmark. Would you please point me to where find the dataset. Thanks!

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/facebookresearch/ParlAI/issues/1566, or mute the thread https://github.com/notifications/unsubscribe-auth/AKjk-MXHn-LqMzaSTvck67MSNQLCTt8Jks5vYdPJgaJpZM4b-kDO .

[aagohary]

thanks for your reply, but the page does not mention how the already constructed dataset can be downloaded. under the Dataset section, the only thing it says is _"You can train your own ParlAI agent on the Wizard of Wikipedia task with -t wizard_of_wikipedia. The ParlAI MTurk collection scripts are also made available, for those interested in replication, analysis, or additional data collection"

[jaseweston]

Ah yes the quickstart should help: http://www.parl.ai/static/docs/tutorial_quick.html

On Wed, Mar 20, 2019 at 10:19 AM Ahmed Elgohary notifications@github.com wrote:

thanks for your reply, but the page does not mention how the already constructed dataset can be downloaded. under the Dataset section, the only thing it says is _"You can train your own ParlAI agent on the Wizard of Wikipedia task with -t wizard_of_wikipedia. The ParlAI MTurk collection scripts are also made available, for those interested in replication, analysis, or additional data collection"

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/facebookresearch/ParlAI/issues/1566#issuecomment-474769584, or mute the thread https://github.com/notifications/unsubscribe-auth/AKjk-N_k4Ef0J2GbsJnYMTZjckc82QeDks5vYgsygaJpZM4b-kDO .

[aagohary]

Got it! Thanks.

[JBoRu]

Got it! Thanks.

Excuse me, so can you describe how to download the dataset?

[stephenroller]

Run python examples/display_data.py -t wizard_of_wikipedia and it will download.

[dhpollack]

In case, anyone wants to download the dataset without installing parl.ai.

the url of the dataset can be found here. I was able to download the dataset with my favorite cli program.

[shashankMadan-designEsthetics]

Hey guys is there any sample of the data set... like .json sample, not display_data sample.

[stephenroller]

{
  "chosen_topic": "Science fiction",
  "persona": "i enjoy movies about aliens invading the earth.",
  "wizard_eval": 5,
  "dialog": [
    {
      "speaker": "0_Wizard",
      "text": "I think science fiction is an amazing genre for anything. Future science, technology, time travel, FTL travel, they're all such interesting concepts.",
      "checked_sentence": {
        "chosen_Science_fiction_0": "Science fiction (often shortened to SF or sci-fi) is a genre of speculative fiction, typically dealing with imaginative concepts such as futuristic science and technology, space travel, time travel, faster than light travel, parallel universes, and extraterrestrial life."
      },
      "checked_passage": {
        "chosen_topic_0_Science_fiction": "Science fiction"
      },
      "retrieved_passages": [
        {
          "Hyperspace (science fiction)": [
            "Hyperspace is a faster-than-light (FTL) method of traveling used in science fiction.",
            "It is typically described as an alternative \"sub-region\" of space co-existing with our own universe which may be entered using an energy field or other device.",
            "As seen in most fiction hyperspace is most succinctly described as a \"somewhere else\" within which the laws of general and special relativity decidedly do \"not\" apply – especially with respect to the speed of light being the cosmic speed limit.",
            "Entering and exiting said \"elsewhere\" thus directly enables travel near or faster than the speed of light – almost universally with the aid of extremely advanced technology."
          ]
        },
        {
          "Science fiction": [
            "Science fiction (often shortened to SF or sci-fi) is a genre of speculative fiction, typically dealing with imaginative concepts such as futuristic science and technology, space travel, time travel, faster than light travel, parallel universes, and extraterrestrial life.",
            "Science fiction often explores the potential consequences of scientific and other innovations, and has been called a \"literature of ideas\".",
            "It usually avoids the supernatural, unlike the related genre of fantasy.",
            "Historically, science-fiction stories have had a grounding in actual science, but now this is only expected of hard science fiction."
          ]
        },
        {
          "History of science fiction": [
            "The literary genre of science fiction is diverse, and its exact definition remains a contested question among both scholars and devotees.",
            "This lack of consensus is reflected in debates about the genre's history, particularly over determining its exact origins.",
            "There are two broad camps of thought, one that identifies the genre's roots in early fantastical works such as the Sumerian \"Epic of Gilgamesh\" (earliest Sumerian text versions c. 2150–2000 BCE).",
            "A second approach argues that science fiction only became possible sometime between the 17th and early 19th centuries, following the scientific revolution and major discoveries in astronomy, physics, and mathematics."
          ]
        },
        {
          "Science fiction film": [
            "Science fiction film (or sci-fi film) is a genre that uses speculative, fictional science-based depictions of phenomena that are not fully accepted by mainstream science, such as extraterrestrial lifeforms, alien worlds, extrasensory perception and time travel, along with futuristic elements such as spacecraft, robots, cyborgs, interstellar travel or other technologies.",
            "Science fiction films have often been used to focus on political or social issues, and to explore philosophical issues like the human condition.",
            "In many cases, tropes derived from written science fiction may be used by filmmakers ignorant of or at best indifferent to the standards of scientific plausibility and plot logic to which written science fiction is traditionally held."
          ]
        },
        {
          "Time travel": [
            "Time travel is the concept of movement between certain points in time, analogous to movement between different points in space by an object or a person, typically using a hypothetical device known as a time machine, in the form of a vehicle or of a portal connecting distant points in spacetime, either to an earlier time or to a later time, without the need for the time-traveling body to experience the intervening period in the usual sense.",
            "Time travel is a widely-recognized concept in philosophy and fiction.",
            "It was popularized by H. G. Wells' 1895 novel \"The Time Machine\", which moved the concept of time travel into the public imagination."
          ]
        },
        {
          "List of starships in Stargate": [
            "This is a list of fictional starships in the \"Stargate\" universe depicted through a series of television shows and three feature-length movies.",
            "The Ancients are one of the most technologically advanced races in \"Stargate\", and this is reflected in their starships.",
            "Duplicates of these ships are utilized by their nanite creations, the Asurans, as they also possess knowledge of Ancient technology.",
            "The Puddle Jumper or Jumper is a small spacecraft used extensively in the \"Stargate Atlantis\" series.",
            "Puddle Jumpers were created by the Ancients and most exist within the city built by the Ancients known as Atlantis."
          ]
        },
        {
          "History of US science fiction and fantasy magazines to 1950": [
            "Science fiction and fantasy magazines began to be published in the US in the 1920s.",
            "Stories with science fiction themes had been appearing for decades in pulp magazines such as \"Argosy\", but there were no magazines that specialized in a single genre until 1915, when Street & Smith, one of the major pulp publishers, brought out \"Detective Story Magazine\".",
            "The first magazine to focus solely on fantasy and horror was \"Weird Tales\", which was launched in 1923, and established itself as the leading weird fiction magazine over the next two decades; writers such as H.P.",
            "Lovecraft, Clark Ashton Smith and Robert E. Howard became regular contributors."
          ]
        }
      ],
      "retrieved_topics": [
        "Hyperspace (science fiction)",
        "Science fiction",
        "History of science fiction",
        "Science fiction film",
        "Time travel",
        "List of starships in Stargate",
        "History of US science fiction and fantasy magazines to 1950"
      ]
    },
    {
      "speaker": "1_Apprentice",
      "text": "I'm a huge fan of science fiction myself! ",
      "retrieved_passages": [
        {
          "Science fiction": [
            "Science fiction (often shortened to SF or sci-fi) is a genre of speculative fiction, typically dealing with imaginative concepts such as futuristic science and technology, space travel, time travel, faster than light travel, parallel universes, and extraterrestrial life.",
            "Science fiction often explores the potential consequences of scientific and other innovations, and has been called a \"literature of ideas\".",
            "It usually avoids the supernatural, unlike the related genre of fantasy.",
            "Historically, science-fiction stories have had a grounding in actual science, but now this is only expected of hard science fiction."
          ]
        },
        {
          "History of science fiction": [
            "The literary genre of science fiction is diverse, and its exact definition remains a contested question among both scholars and devotees.",
            "This lack of consensus is reflected in debates about the genre's history, particularly over determining its exact origins.",
            "There are two broad camps of thought, one that identifies the genre's roots in early fantastical works such as the Sumerian \"Epic of Gilgamesh\" (earliest Sumerian text versions c. 2150–2000 BCE).",
            "A second approach argues that science fiction only became possible sometime between the 17th and early 19th centuries, following the scientific revolution and major discoveries in astronomy, physics, and mathematics."
          ]
        },
        {
          "Isaac Asimov": [
            "Isaac Asimov (; born Isaak Ozimov; January 2, 1920 – April 6, 1992) was an American writer and professor of biochemistry at Boston University.",
            "He was known for his works of science fiction and popular science.",
            "Asimov was a prolific writer, and wrote or edited more than 500 books and an estimated 90,000 letters and postcards.",
            "His books have been published in 9 of the 10 major categories of the Dewey Decimal Classification.",
            "Asimov wrote hard science fiction and, along with Robert A. Heinlein and Arthur C. Clarke, he was considered one of the \"Big Three\" science fiction writers during his lifetime."
          ]
        },
        {
          "U.S. television science fiction": [
            "U.S. television science fiction is a popular genre of television in the United States that has produced many of the best-known and most popular science fiction shows in the world.",
            "Most famous of all, and one of the most influential science-fiction series in history, is the iconic \"\" and its various spin-off shows, which comprise the Star Trek franchise.",
            "Other hugely influential programs have included the 1960s anthology series \"The Twilight Zone,\" the internationally successful \"The X-Files,\" and a wide variety of television movies and continuing series for more than half a century.",
            "The first popular science-fiction program on American television was the children's adventure serial \"Captain Video and His Video Rangers\", which ran from June 1949 to April 1955."
          ]
        },
        {
          "History of US science fiction and fantasy magazines to 1950": [
            "Science fiction and fantasy magazines began to be published in the US in the 1920s.",
            "Stories with science fiction themes had been appearing for decades in pulp magazines such as \"Argosy\", but there were no magazines that specialized in a single genre until 1915, when Street & Smith, one of the major pulp publishers, brought out \"Detective Story Magazine\".",
            "The first magazine to focus solely on fantasy and horror was \"Weird Tales\", which was launched in 1923, and established itself as the leading weird fiction magazine over the next two decades; writers such as H.P.",
            "Lovecraft, Clark Ashton Smith and Robert E. Howard became regular contributors."
          ]
        },
        {
          "Starstruck (comics)": [
            "Starstruck is an American comic book series.",
            "It was inspired by the off-Broadway stage play with the same name written by Elaine Lee, with contributions from Susan Norfleet Lee and Dale Place.",
            "The \"Starstruck\" creator-owned illustrated science fiction serial has been produced at various intervals since 1982 by writer Lee and artist Michael Wm.",
            "Kaluta; their primary collaborators are colorist Lee Moyer and letterer Todd Klein.",
            "The series, epic in scope, has been carried across multiple comic companies, but primarily by Epic Comics, Dark Horse Comics, and IDW Publishing.",
            "It was collected in a revised and recolored hardcover book form as \"Starstruck Deluxe Edition\" in 2011."
          ]
        },
        {
          "LGBT themes in speculative fiction": [
            "LGBT themes in speculative fiction refer to the incorporation of lesbian, gay, bisexual, or transgender (LGBT) themes into science fiction, fantasy, horror fiction and related genres.",
            "Such elements may include an LGBT character as the protagonist or a major character, or explorations of sexuality or gender that deviate from the hetero-normative.",
            "Science fiction and fantasy have traditionally been puritanical genres aimed at a male readership, and can be more restricted than non-genre literature by their conventions of characterisation and the effect that these conventions have on depictions of sexuality and gender."
          ]
        }
      ],
      "retrieved_topics": [
        "Science fiction",
        "History of science fiction",
        "Isaac Asimov",
        "U.S. television science fiction",
        "History of US science fiction and fantasy magazines to 1950",
        "Starstruck (comics)",
        "LGBT themes in speculative fiction"
      ]
    },
    {
      "speaker": "0_Wizard",
      "text": "Awesome! I really love how sci-fi storytellers focus on political/social/philosophical issues that would still be around even in the future. Makes them relatable.",
      "checked_sentence": {
        "self_Science_fiction_film_1": "Science fiction films have often been used to focus on political or social issues, and to explore philosophical issues like the human condition."
      },
      "checked_passage": {
        "self_3_Science_fiction_film": "Science fiction film"
      },
      "retrieved_passages": [
        {
          "Oddworld Inhabitants": [
            "Oddworld Inhabitants Inc. is an American video game developer founded in 1994 by special-effects and computer-animation veterans Sherry McKenna and Lorne Lanning.",
            "The company is primarily known for the incomplete \"Oddworld Quintology\", a series of award-winning video games about the fictional planet of Oddworld and its native creatures.",
            "The series debuted with \"\" in 1997 and continued with \"\" in 2001 but the studio has also developed standalone titles \"\" in 1998 and \"\" in 2005.",
            "Oddworld Inhabitants took a break from game development for a time following the release of \"Stranger's Wrath\", even though it had already begun preliminary work on its next Oddworld title, \"The Brutal Ballad of Fangus Klot\"."
          ]
        },
        {
          "Legalism (Chinese philosophy)": [
            "Fajia () or Legalism is one of Sima Tan's six classical schools of thought in Chinese philosophy.",
            "Roughly meaning \"house of Fa\" (administrative \"methods\" or \"standards\"), the \"school\" (term) represents some several branches of realistic statesmen or \"men of methods\" (fashu zishi) foundational for the traditional Chinese bureaucratic empire.",
            "Compared with Machiavelli, it has often been considered in the Western world as akin to the Realpolitikal thought of ancient China.",
            "Largely ignoring morality or questions on how a society ideally should function, they examined contemporary government; emphasizing a realistic consolidation of the wealth and power of autocrat and state, with the goal of achieving increased order, security and stability."
          ]
        },
        {
          "Sci-Fi on the Rock": [
            "Sci-Fi on the Rock is an annual science fiction, fantasy and horror festival held in St. John's, Newfoundland, Canada.",
            "It was founded by Darren Hann and Melanie Collins in mid-to-late 2006, and held its first festival in 2007.",
            "It began in 2007 at the Hotel Mount Pearl, moving on to be housed in the Holiday Inn in St. John's as of April 2008.",
            "The convention made another move in 2016 to the Sheraton Hotel Newfoundland.",
            "The festival has had a number a notable guests both from Newfoundland and beyond, including science-fiction author Kenneth Tam (\"Defense Command\", \"His Majesty's New World\"), comic-book artist Paul Tucker (\"The Underworld Railroad\", \"Google John Smith\"), actor Brian Downey (\"Lexx\", \"Millennium\"), actor Jeremy Bulloch (\"The Empire Strikes Back\", \"Octopussy\"), author William Meikle (\"The Midnight Eye\" series), horror author Matthew LeDrew (\"Black Womb\", \"Roulette\") and author Shannon Patrick Sullivan (\"The Dying Days\")."
          ]
        },
        {
          "Starstruck (comics)": [
            "Starstruck is an American comic book series.",
            "It was inspired by the off-Broadway stage play with the same name written by Elaine Lee, with contributions from Susan Norfleet Lee and Dale Place.",
            "The \"Starstruck\" creator-owned illustrated science fiction serial has been produced at various intervals since 1982 by writer Lee and artist Michael Wm.",
            "Kaluta; their primary collaborators are colorist Lee Moyer and letterer Todd Klein.",
            "The series, epic in scope, has been carried across multiple comic companies, but primarily by Epic Comics, Dark Horse Comics, and IDW Publishing.",
            "It was collected in a revised and recolored hardcover book form as \"Starstruck Deluxe Edition\" in 2011."
          ]
        },
        {
          "The Spirit of the Age": [
            "The Spirit of the Age (full title \"The Spirit of the Age: Or, Contemporary Portraits\") is a collection of character sketches by the early 19th century English essayist, literary critic, and social commentator William Hazlitt, portraying 25 men, mostly British, whom he believed to represent significant trends in the thought, literature, and politics of his time.",
            "The subjects include thinkers, social reformers, politicians, poets, essayists, and novelists, many of whom Hazlitt was personally acquainted with or had encountered.",
            "Originally appearing in English periodicals, mostly \"The New Monthly Magazine\" in 1824, the essays were collected with several others written for the purpose and published in book form in 1825."
          ]
        },
        {
          "Science fiction film": [
            "Science fiction film (or sci-fi film) is a genre that uses speculative, fictional science-based depictions of phenomena that are not fully accepted by mainstream science, such as extraterrestrial lifeforms, alien worlds, extrasensory perception and time travel, along with futuristic elements such as spacecraft, robots, cyborgs, interstellar travel or other technologies.",
            "Science fiction films have often been used to focus on political or social issues, and to explore philosophical issues like the human condition.",
            "In many cases, tropes derived from written science fiction may be used by filmmakers ignorant of or at best indifferent to the standards of scientific plausibility and plot logic to which written science fiction is traditionally held."
          ]
        },
        {
          "Music of the Marvel Cinematic Universe": [
            "The music of the Marvel Cinematic Universe (MCU) is the film and television scores composed by various composers for the films and television series of that franchise.",
            "Ramin Djawadi provided the first MCU music with his original score for \"Iron Man\" in 2008.",
            "Alan Silvestri was the first composer to work on multiple MCU films after he transitioned from scoring \"\" (2011) to \"Marvel's The Avengers\" (2012), while Brian Tyler was the first composer to reference the work of another MCU composer when he quoted Silvestri's \"Captain America March\" in his score for \"\" (2013).",
            "Original music has also been composed for the Marvel One-Shots short film series, and other related projects of the MCU, including the fanfares for the two Marvel Studios logos, composed by Tyler and Michael Giacchino, respectively."
          ]
        }
      ],
      "retrieved_topics": [
        "Oddworld Inhabitants",
        "Legalism (Chinese philosophy)",
        "Sci-Fi on the Rock",
        "Starstruck (comics)",
        "The Spirit of the Age",
        "Science fiction film",
        "Music of the Marvel Cinematic Universe"
      ]
    },
    {
      "speaker": "1_Apprentice",
      "text": "I agree. One of my favorite forms of science fiction is anything related to time travel! I find it fascinating.",
      "retrieved_passages": [
        {
          "Science fiction": [
            "Science fiction (often shortened to SF or sci-fi) is a genre of speculative fiction, typically dealing with imaginative concepts such as futuristic science and technology, space travel, time travel, faster than light travel, parallel universes, and extraterrestrial life.",
            "Science fiction often explores the potential consequences of scientific and other innovations, and has been called a \"literature of ideas\".",
            "It usually avoids the supernatural, unlike the related genre of fantasy.",
            "Historically, science-fiction stories have had a grounding in actual science, but now this is only expected of hard science fiction."
          ]
        },
        {
          "Science fiction film": [
            "Science fiction film (or sci-fi film) is a genre that uses speculative, fictional science-based depictions of phenomena that are not fully accepted by mainstream science, such as extraterrestrial lifeforms, alien worlds, extrasensory perception and time travel, along with futuristic elements such as spacecraft, robots, cyborgs, interstellar travel or other technologies.",
            "Science fiction films have often been used to focus on political or social issues, and to explore philosophical issues like the human condition.",
            "In many cases, tropes derived from written science fiction may be used by filmmakers ignorant of or at best indifferent to the standards of scientific plausibility and plot logic to which written science fiction is traditionally held."
          ]
        },
        {
          "History of science fiction": [
            "The literary genre of science fiction is diverse, and its exact definition remains a contested question among both scholars and devotees.",
            "This lack of consensus is reflected in debates about the genre's history, particularly over determining its exact origins.",
            "There are two broad camps of thought, one that identifies the genre's roots in early fantastical works such as the Sumerian \"Epic of Gilgamesh\" (earliest Sumerian text versions c. 2150–2000 BCE).",
            "A second approach argues that science fiction only became possible sometime between the 17th and early 19th centuries, following the scientific revolution and major discoveries in astronomy, physics, and mathematics."
          ]
        },
        {
          "Time travel": [
            "Time travel is the concept of movement between certain points in time, analogous to movement between different points in space by an object or a person, typically using a hypothetical device known as a time machine, in the form of a vehicle or of a portal connecting distant points in spacetime, either to an earlier time or to a later time, without the need for the time-traveling body to experience the intervening period in the usual sense.",
            "Time travel is a widely-recognized concept in philosophy and fiction.",
            "It was popularized by H. G. Wells' 1895 novel \"The Time Machine\", which moved the concept of time travel into the public imagination."
          ]
        },
        {
          "Parallel universes in fiction": [
            "A parallel universe is a hypothetical self-contained reality co-existing with one's own.",
            "A specific group of parallel universes are called a \"multiverse\", although this term can also be used to describe the possible parallel universes that constitute reality.",
            "While the terms \"parallel universe\" and \"alternative reality\" are generally synonymous and can be used interchangeably in most cases, there is sometimes an additional connotation implied with the term \"alternative reality\" that implies that the reality is a variant of our own.",
            "The term \"parallel universe\" is more general, without any connotations implying a relationship, or lack of relationship, with our own universe."
          ]
        },
        {
          "Alternate history": [
            "Alternate history or alternative history (Commonwealth English), sometimes abbreviated as AH, is a genre of fiction consisting of stories in which one or more historical events occur differently.",
            "These stories usually contain \"what if\" scenarios at crucial points in history and present outcomes other than those in the historical record.",
            "The stories are conjectural, but are sometimes based on fact.",
            "Alternate history has been seen as a subgenre of literary fiction, science fiction, or historical fiction; alternate history works may use tropes from any or all of these genres.",
            "Another term occasionally used for the genre is \"allohistory\" (literally \"other history\")."
          ]
        },
        {
          "Time travel in fiction": [
            "Time travel is a common theme in fiction and has been depicted in a variety of media, such as literature, television, film, and advertisements.",
            "The concept of time travel by mechanical means was popularized in H. G. Wells' 1895 story, \"The Time Machine\".",
            "In general, time travel stories focus on the consequences of traveling into the past or the future.",
            "The central premise for these stories oftentimes involves changing history, either intentionally or by accident, and the ways by which altering the past changes the future and creates an altered present or future for the time traveler when they return home."
          ]
        }
      ],
      "retrieved_topics": [
        "Science fiction",
        "Science fiction film",
        "History of science fiction",
        "Time travel",
        "Parallel universes in fiction",
        "Alternate history",
        "Time travel in fiction"
      ]
    },
    {
      "speaker": "0_Wizard",
      "text": "It's not quite sci-fi, but my favorite version of time travel is in Harry Potter and the Prisoner of Azkaban. Breaks zero logical rules.",
      "checked_sentence": {
        "partner_Time_travel_in_fiction_3": "The central premise for these stories oftentimes involves changing history, either intentionally or by accident, and the ways by which altering the past changes the future and creates an altered present or future for the time traveler when they return home."
      },
      "checked_passage": {
        "partner_6_Time_travel_in_fiction": "Time travel in fiction"
      },
      "retrieved_passages": [
        {
          "Magical objects in Harry Potter": [
            "The following is a list of magical objects used in the \"Harry Potter\" series.",
            "In \"Harry Potter and the Order of the Phoenix\", Hermione Granger creates fake, enchanted Galleons that are used for communication between members of Dumbledore's Army.",
            "Like real Galleons, the coins have numerals around the edge; on normal Galleons these serial numbers aren't used the same way the enchanted coins are used, the numbers represent the time and date of the next meeting, and automatically change to match whatever numbers Harry Potter sets on his coin.",
            "Due to the coins being infused with a Protean Charm, once Harry Potter alters his, every coin changes to suit."
          ]
        },
        {
          "List of supporting Harry Potter characters": [
            "The following are supporting characters in the \"Harry Potter\" series written by J. K. Rowling.",
            "For members of the Order of the Phoenix, Dumbledore's Army, Hogwarts staff, Ministry of Magic, or for Death Eaters, see the respective articles.",
            "The Dursley family are Harry Potter's last living relatives.",
            "To ensure Harry's safety, Albus Dumbledore placed him in the Dursleys' care when he was a baby.",
            "The Dursleys live at Number 4, Privet Drive, Little Whinging in Surrey, England.",
            "They are all Muggles, and despise all things related to magic – and anything out of the ordinary in general – and the Wizarding World, especially the Potters."
          ]
        },
        {
          "Harry Potter": [
            "Harry Potter is a series of fantasy novels written by British author J. K. Rowling.",
            "The novels chronicle the life of a young wizard, Harry Potter, and his friends Hermione Granger and Ron Weasley, all of whom are students at Hogwarts School of Witchcraft and Wizardry.",
            "The main story arc concerns Harry's struggle against Lord Voldemort, a dark wizard who intends to become immortal, overthrow the wizard governing body known as the Ministry of Magic, and subjugate all wizards and muggles, a reference term that means non-magical people.",
            "Since the release of the first novel, \"Harry Potter and the Philosopher's Stone\", on 26 June 1997, the books have found immense popularity, critical acclaim, and commercial success worldwide."
          ]
        },
        {
          "Order of the Phoenix (fictional organisation)": [
            "The Order of the Phoenix is a secret organisation in the \"Harry Potter\" series of fiction books written by J. K. Rowling.",
            "Founded by Albus Dumbledore to fight Lord Voldemort and his followers, the Death Eaters, the Order lends its name to the fifth book of the series, \"Harry Potter and the Order of the Phoenix\".",
            "Before the Harry Potter series starts – when the character Lord Voldemort declared war on the wizarding world – Albus Dumbledore, headmaster of Hogwarts School of Witchcraft and Wizardry and an upstanding and powerful citizen of the wizarding world, attempted to take control of the situation by founding the Order of the Phoenix."
          ]
        },
        {
          "Places in Harry Potter": [
            "J. K. Rowling's \"Harry Potter\" universe contains numerous settings for the events in her fantasy novels.",
            "These locations are categorised as a dwelling, school, shopping district, or government-affiliated locale.",
            "The Weasleys' home, known as the Burrow, is located outside the village of Ottery St Catchpole, also near the home of the Lovegoods, the Diggorys and the Fawcetts.",
            "The Burrow was used as the Order of the Phoenix's headquarters, due to the compromised Fidelius Charm placed on 12 Grimmauld Place, in \"Harry Potter and the Deathly Hallows\" until it lost its given protection.",
            "The Weasley house has seven floors."
          ]
        },
        {
          "Ministry of Magic": [
            "The Ministry of Magic is the government of the Magical community of Britain in \"J. K. Rowling's Wizarding World\" .The magical government in Britain is  first mentioned in \"Harry Potter and the Philosopher's Stone,\" the Ministry makes its first proper appearance in \"Harry Potter and the Order of the Phoenix\".",
            "Throughout the books, it is generally depicted as either corrupt, incompetent, or both, with its high officials blind to actual events and dangers.",
            "It reaches a zenith of corruption before being effectively taken over by Lord Voldemort.",
            "At the end of the final book, following Voldemort's death, Kingsley Shacklebolt takes over the ministry, changing it for the better."
          ]
        },
        {
          "Harry Potter (film series)": [
            "Harry Potter is a British-American film series based on the \"Harry Potter\" novels by author J. K. Rowling.",
            "The series is distributed by Warner Bros. and consists of eight fantasy films, beginning with \"Harry Potter and the Philosopher's Stone\" (2001) and culminating with \"Harry Potter and the Deathly Hallows – Part 2\" (2011).",
            "A spin-off prequel series will consist of five films, starting with \"Fantastic Beasts and Where to Find Them\" (2016).",
            "The \"Fantastic Beasts\" films mark the beginning of a shared media franchise known as J. K. Rowling's Wizarding World.",
            "The series was mainly produced by David Heyman, and stars Daniel Radcliffe, Rupert Grint, and Emma Watson as the three leading characters: Harry Potter, Ron Weasley, and Hermione Granger."
          ]
        }
      ],
      "retrieved_topics": [
        "Magical objects in Harry Potter",
        "List of supporting Harry Potter characters",
        "Harry Potter",
        "Order of the Phoenix (fictional organisation)",
        "Places in Harry Potter",
        "Ministry of Magic",
        "Harry Potter (film series)"
      ]
    },
    {
      "speaker": "1_Apprentice",
      "text": "And that's difficult to do when dealing with time travel. I actually haven't seen the latest Harry Potter movies. Guess it's time to check them out!",
      "retrieved_passages": [
        {
          "Politics of Harry Potter": [
            "There are many published theories about the politics of the Harry Potter books by J. K. Rowling, which range from them containing criticism of racism to anti-government sentiments.",
            "According to \"Inside Higher Ed\", doctoral theses have been devoted to the Harry Potter books.",
            "There are also several university courses centred on analysis of the Potter series, including an upper division Political Science course.",
            "\"Time\" magazine noted the political and social aspects of Harry Potter in their 2007 Person of the Year issue where Rowling placed third behind politicians Vladimir Putin and Al Gore.",
            "Harry Potter's potential social and political impact was called similar to the 19th century phenomenon of Harriet Beecher Stowe's popular, but critically maligned book, \"Uncle Tom's Cabin\", which fuelled the abolitionist movement leading up to the American Civil War."
          ]
        },
        {
          "Religious debates over the Harry Potter series": [
            "Religious debates over the \"Harry Potter\" series of books by J. K. Rowling are based on claims that the novels contain occult or Satanic subtexts.",
            "A number of Protestant, Catholic, and Orthodox Christians have argued against the series, as have some Shia and Sunni Muslims.",
            "Supporters of the series have said that the magic in \"Harry Potter\" bears little resemblance to occultism, being more in the vein of fairy tales such as \"Cinderella\" and \"Snow White\", or to the works of C. S. Lewis and J. R. R. Tolkien, both of whom are known for writing fantasy novels with Christian subtexts.",
            "Far from promoting a particular religion, some argue, the \"Harry Potter\" novels go out of their way to avoid discussing religion at all."
          ]
        },
        {
          "Magical objects in Harry Potter": [
            "The following is a list of magical objects used in the \"Harry Potter\" series.",
            "In \"Harry Potter and the Order of the Phoenix\", Hermione Granger creates fake, enchanted Galleons that are used for communication between members of Dumbledore's Army.",
            "Like real Galleons, the coins have numerals around the edge; on normal Galleons these serial numbers aren't used the same way the enchanted coins are used, the numbers represent the time and date of the next meeting, and automatically change to match whatever numbers Harry Potter sets on his coin.",
            "Due to the coins being infused with a Protean Charm, once Harry Potter alters his, every coin changes to suit."
          ]
        },
        {
          "Harry Potter": [
            "Harry Potter is a series of fantasy novels written by British author J. K. Rowling.",
            "The novels chronicle the life of a young wizard, Harry Potter, and his friends Hermione Granger and Ron Weasley, all of whom are students at Hogwarts School of Witchcraft and Wizardry.",
            "The main story arc concerns Harry's struggle against Lord Voldemort, a dark wizard who intends to become immortal, overthrow the wizard governing body known as the Ministry of Magic, and subjugate all wizards and muggles, a reference term that means non-magical people.",
            "Since the release of the first novel, \"Harry Potter and the Philosopher's Stone\", on 26 June 1997, the books have found immense popularity, critical acclaim, and commercial success worldwide."
          ]
        },
        {
          "Harry Potter fandom": [
            "\"\"Harry Potter\" fandom\" refers to the community of fans of the \"Harry Potter\" books and movies who participate in entertainment activities that revolve around the series, such as reading and writing fan fiction, creating and soliciting fan art, engaging in role-playing games, socializing on \"Harry Potter\"-based forums, and more.",
            "The fandom interacts online as well as offline through activities such as fan conventions, tours of iconic landmarks relevant to the books and production of the films, and parties held for the midnight release of each book and film.",
            "By the fourth \"Harry Potter\" book, the legions of fans had grown so large that considerable security measures were taken to ensure that no book was purchased before the official release date."
          ]
        },
        {
          "List of supporting Harry Potter characters": [
            "The following are supporting characters in the \"Harry Potter\" series written by J. K. Rowling.",
            "For members of the Order of the Phoenix, Dumbledore's Army, Hogwarts staff, Ministry of Magic, or for Death Eaters, see the respective articles.",
            "The Dursley family are Harry Potter's last living relatives.",
            "To ensure Harry's safety, Albus Dumbledore placed him in the Dursleys' care when he was a baby.",
            "The Dursleys live at Number 4, Privet Drive, Little Whinging in Surrey, England.",
            "They are all Muggles, and despise all things related to magic – and anything out of the ordinary in general – and the Wizarding World, especially the Potters."
          ]
        },
        {
          "Legal disputes over the Harry Potter series": [
            "Since first coming to wide notice in the late 1990s, the \"Harry Potter\" book series by J. K. Rowling has engendered a number of legal disputes.",
            "Rowling, her various publishers and Time Warner, the owner of the rights to the \"Harry Potter\" films, have taken numerous legal actions to protect their copyrights, and also have fielded accusations of copyright theft themselves.",
            "The worldwide popularity of the \"Harry Potter\" series has led to the appearance of a number of locally produced, unauthorised sequels and other derivative works, sparking efforts to ban or contain them.",
            "While these legal proceedings have countered a number of cases of outright piracy, other attempts have targeted not-for-profit endeavours and have been criticised."
          ]
        }
      ],
      "retrieved_topics": [
        "Politics of Harry Potter",
        "Religious debates over the Harry Potter series",
        "Magical objects in Harry Potter",
        "Harry Potter",
        "Harry Potter fandom",
        "List of supporting Harry Potter characters",
        "Legal disputes over the Harry Potter series"
      ]
    },
    {
      "speaker": "0_Wizard",
      "text": "If you really want a look at the potential negative consequences of scientific innovation, what you should check out is the TV show Fringe. Incredibly well written.",
      "checked_sentence": {
        "chosen_Science_fiction_0": "Science fiction often explores the potential consequences of scientific and other innovations, and has been called a \"literature of ideas\"."
      },
      "checked_passage": {
        "chosen_topic_0_Science_fiction": "Science fiction"
      },
      "retrieved_passages": [
        {
          "Characters of Casualty": [
            "\"Casualty\" is a British medical drama television series that premiered on 6 September 1986 on BBC One.",
            "The series was created by Jeremy Brock and Paul Unwin.",
            "It is set in the fictional Holby City Hospital, in the equally fictitious city of Holby, and features occasional crossovers of characters and plots with spin-off show \"Holby City\".",
            "\"Casualty\" follows the professional and personal lives of the doctors, nurses, paramedics, hospital management and patients at Holby General.",
            "It features an ensemble cast of regular characters, and began with 10 main characters in its first series, all but two – Charlie Fairhead (played by Derek Thompson) and Lisa \"Duffy\" Duffin (played by Cathy Shipton) – have since left the show."
          ]
        },
        {
          "Adolescent sexuality in the United States": [
            "According to the US Centers for Disease Control and Prevention (CDC), in the year 2007, 35% of US high school students were currently sexually active and 47.8% of US high school students reported having had sexual intercourse.",
            "This percentage has decreased slightly since 1991.",
            "According to a 1994 study, every year an estimated one in four sexually active teens contracts a sexually transmitted infection (STI).",
            "Teenage pregnancy is four times as prevalent in the United States as in the European Union.",
            "However, US teen pregnancy rates have been steadily declining for decades, according to the Centers for Disease Control and were at a \"record low\" as of 2012."
          ]
        },
        {
          "Fringe (TV series)": [
            "Fringe is an American science fiction television series created by J. J. Abrams, Alex Kurtzman, and Roberto Orci.",
            "It premiered on the Fox network on September 9, 2008, and concluded on January 18, 2013, after five seasons and 100 episodes.",
            "The series follows Olivia Dunham (Anna Torv), Peter Bishop (Joshua Jackson), and Walter Bishop (John Noble), all members of the fictional Fringe Division of the Federal Bureau of Investigation, based in Boston, Massachusetts, under the supervision of Homeland Security.",
            "The team uses fringe science and FBI investigative techniques to investigate a series of unexplained, often ghastly occurrences, which are related to mysteries surrounding a parallel universe."
          ]
        },
        {
          "List of films considered the worst": [
            "The films listed below have been cited by a variety of notable critics in varying media sources as being among the worst films ever made.",
            "Examples of such sources include Metacritic, Roger Ebert's list of most-hated films, \"The Golden Turkey Awards\", \"Leonard Maltin's Movie Guide\", Rotten Tomatoes, the Stinkers Bad Movie Awards, \"Mystery Science Theater 3000\", and the Golden Raspberry Awards (\"Razzies\").",
            "\"Reefer Madness\" (originally released as \"Tell Your Children\" and sometimes titled or subtitled as \"The Burning Question\", \"Dope Addict\", \"Doped Youth\", and \"Love Madness\") is a 1936 American exploitation film and propaganda work revolving around the melodramatic events that ensue when high school students are lured by pushers to try marijuana—from a hit and run accident, to manslaughter, suicide, attempted rape, and descent into madness."
          ]
        },
        {
          "Days Gone Bye (The Walking Dead)": [
            "\"Days Gone Bye\" is the first episode of the post-apocalyptic horror television series \"The Walking Dead\".",
            "It originally aired on AMC in the United States on October 31, 2010.",
            "The episode was written and directed by Frank Darabont, the series creator.",
            "Robert Kirkman, the creator of the eponymous series of comic books, considered the idea of creating a television show based on the comic series, but did not move forward.",
            "Frank Darabont expressed interest in developing the series for television.",
            "In January 2010, AMC formally announced that it had ordered a pilot for a possible series adapted from \"The Walking Dead\" comic book."
          ]
        },
        {
          "Stigma management": [
            "When a person receives unfair treatment or alienation due to a social stigma, the effects can be detrimental.",
            "Social stigmas are defined as any aspect of an individual's identity that is devalued in a social context.",
            "These stigmas can be categorized as visible or invisible, depending on whether the stigma is readily apparent to others.",
            "Visible stigmas refer to characteristics such as race, age, gender, physical disabilities, or deformities, whereas invisible stigmas refer to characteristics such sexual orientation, gender identity, religious affiliation, early pregnancy, certain diseases, or mental illnesses."
          ]
        },
        {
          "All I Really Want to Do (album)": [
            "All I Really Want to Do is the debut solo studio album by American singer-actress Cher and was released on October 16, 1965, by Imperial Records.",
            "The album was produced for Cher by her then husband and singing partner, Sonny Bono, with contributions from arranger Harold Battiste.",
            "The album is by-and-large a collection of cover versions but does contain three songs written by Bono.",
            "Upon its release, the album was well received by critics and garnered positive reviews.",
            "At the same time that the duo Sonny & Cher were debuting on Atco Records, Sonny Bono arranged a solo deal for Cher on the Imperial label."
          ]
        }
      ],
      "retrieved_topics": [
        "Characters of Casualty",
        "Adolescent sexuality in the United States",
        "Fringe (TV series)",
        "List of films considered the worst",
        "Days Gone Bye (The Walking Dead)",
        "Stigma management",
        "All I Really Want to Do (album)"
      ]
    },
    {
      "speaker": "1_Apprentice",
      "text": "Thank you for the suggestion, I will definitely check it out!",
      "retrieved_passages": [
        {
          "Charles Downing Lay": [
            "Charles Downing Lay (September 3, 1877 – February 15, 1956) was an American landscape architect.",
            "The son of Oliver Ingraham Lay, a professional painter, and Hester Marian Wait Lay, Charles Downing Lay was born in Newburgh, New York.",
            "At age 7, Lay began spending summers with his grandmother in Stratford, Connecticut.",
            "Her house was located at 95 Chapel Street, which is approximately away from the banks of the Housatonic River.",
            "Lay spent much of his childhood in Stratford fishing, sailing, and swimming and developed a great appreciation for nature.",
            "The Housatonic, along with the Long Island Sound, would greatly influence the course of Lay's career."
          ]
        },
        {
          "Pyro-Magnetics Corporation": [
            "Pyro-Magnetics Corporation was a Whitman, Massachusetts based manufacturer of industrial furnaces.",
            "The business produced a processor for disposing hazardous wastes.",
            "The product's technical requirements were approved by the Environmental Protection Agency in June 1982.",
            "In late 1982 the corporation sold its two operating units to pay debts and after the sale few of its employees remained.",
            "The Pyro-Magnetics Corporation filed for Chapter 7 bankruptcy at a federal bankruptcy court in Whitman, in April 1983.",
            "Prior to this the firm embarked on an unsuccessful attempt to raise cash by developing commercial applications for its high-temperature melting technology."
          ]
        },
        {
          "Charles Downing": [
            "Charles Downing (died 1845) was a Delegate to the US House of Representatives from the Florida Territory.",
            "He was born in Virginia, although it is unknown when.",
            "In his life, Downing studied law, and after being admitted to The Florida Bar, practiced in St. Augustine, Florida.",
            "Initially a member of the Legislative Council of the Territory of Florida, Downing was elected to the Twenty-fifth United States Congress, and took office on March 4, 1837.",
            "Two years later, he was re-elected to the Twenty-sixth United States Congress, and his term ended on March 3, 1841.",
            "Charles Downing died St. Augustine, Florida."
          ]
        },
        {
          "Charles Downing (pomologist)": [
            "Charles Downing (July 9, 1802 – January 18, 1885), was an American pomologist, horticulturist, and author.",
            "Although not as well known to the public as his brother Andrew Jackson Downing, Charles established a sound reputation for his creative work in pomology.",
            "Born in Newburgh, New York, his taste for horticultural pursuits was early stimulated by close contact with a nursery owned by his father, Samuel Downing.",
            "Even while attending an academy in the neighborhood he worked a portion of the time in this nursery.",
            "Upon the death of his father in 1822, he succeeded to the entire charge of the establishment."
          ]
        },
        {
          "List of Jimmy Fallon games and sketches": [
            "The following is a list of recurring games, sketches, and other comedy routines from the NBC late night talk show \"The Tonight Show Starring Jimmy Fallon\", and its predecessor, \"Late Night with Jimmy Fallon\".",
            "The sketches feature host Jimmy Fallon, house band The Roots, announcer/sidekick Steve Higgins, the show's writers, celebrity guests, and audience members.",
            "Most of the skits below appeared only on \"Late Night\", while some have carried over to the \"Tonight Show\".",
            "Every Tuesday on the show, Jimmy weighs the pros and cons of a topic that's currently in the news, with the pros being the setups and the cons being the punchlines."
          ]
        },
        {
          "Mobile Orchestra": [
            "Mobile Orchestra is the fifth studio album by American electronica project Owl City, which was released on July 10, 2015.",
            "In 2014, Owl City released an EP called \"Ultraviolet\" and released \"Beautiful Times\" as the lead single.",
            "Following the release, Young stated his intent to release a steady \"series of EPs\" in 2014 rather than one larger recording.",
            "On October 7, 2014, Young released two new songs simultaneously, \"You're Not Alone\" (featuring Britt Nicole) and \"Tokyo\" (featuring Sekai no Owari).",
            "The former would eventually become part of the international edition of the album while the latter would become the fourth track of the Japanese edition."
          ]
        },
        {
          "Slash fiction": [
            "Slash fiction is a genre of fan fiction that focuses on interpersonal attraction and sexual relationships between fictional characters of the same sex.",
            "While the term \"slash\" originally only referred to stories where male characters were involved in an explicit sexual relationship as a primary plot element (also known as \"m/m slash\"), it is now used to refer to any fan story containing a pairing between same-sex characters.",
            "Many fans distinguish female-focused slash as a separate genre, commonly referred to as femslash (also known as \"f/f slash\" or \"femmeslash\").",
            "These fan written stories are not canon, and the characters are usually not engaged in such relationships in their respective fictional universes."
          ]
        }
      ],
      "retrieved_topics": [
        "Charles Downing Lay",
        "Pyro-Magnetics Corporation",
        "Charles Downing",
        "Charles Downing (pomologist)",
        "List of Jimmy Fallon games and sketches",
        "Mobile Orchestra",
        "Slash fiction"
      ]
    },
    {
      "speaker": "0_Wizard",
      "text": "It blends science fiction and paranormal/psychological/MK Ultra type stuff together, but it's science fiction at its core.",
      "checked_sentence": {
        "no_passages_used": "no_passages_used"
      },
      "checked_passage": {
        "no_passages_used": "no_passages_used"
      },
      "retrieved_passages": [
        {
          "Science fiction": [
            "Science fiction (often shortened to SF or sci-fi) is a genre of speculative fiction, typically dealing with imaginative concepts such as futuristic science and technology, space travel, time travel, faster than light travel, parallel universes, and extraterrestrial life.",
            "Science fiction often explores the potential consequences of scientific and other innovations, and has been called a \"literature of ideas\".",
            "It usually avoids the supernatural, unlike the related genre of fantasy.",
            "Historically, science-fiction stories have had a grounding in actual science, but now this is only expected of hard science fiction."
          ]
        },
        {
          "Visionary fiction": [
            "Visionary fiction is a fiction genre with New Age or mind, body, spirit themes and perspectives, including consciousness expansion, spirituality, mysticism, and parapsychology.",
            "It is sometimes classed as a subtype of speculative fiction.",
            "Examples include the novels \"The Celestine Prophecy\" \"The Alchemist\", and \"\".",
            "The Book Industry Study Group's BISAC subject heading FIC039000 is \"FICTION / Visionary & Metaphysical\".",
            "Although similar themes and content occur in the literature of numerous cultures in many ages, the term \"visionary fiction\" was suggested by Renee Weber, professor of philosophy at Rutgers University, and used by John Algeo in a 1982 article describing recent examples and earlier precursors."
          ]
        },
        {
          "History of science fiction": [
            "The literary genre of science fiction is diverse, and its exact definition remains a contested question among both scholars and devotees.",
            "This lack of consensus is reflected in debates about the genre's history, particularly over determining its exact origins.",
            "There are two broad camps of thought, one that identifies the genre's roots in early fantastical works such as the Sumerian \"Epic of Gilgamesh\" (earliest Sumerian text versions c. 2150–2000 BCE).",
            "A second approach argues that science fiction only became possible sometime between the 17th and early 19th centuries, following the scientific revolution and major discoveries in astronomy, physics, and mathematics."
          ]
        },
        {
          "Science fiction film": [
            "Science fiction film (or sci-fi film) is a genre that uses speculative, fictional science-based depictions of phenomena that are not fully accepted by mainstream science, such as extraterrestrial lifeforms, alien worlds, extrasensory perception and time travel, along with futuristic elements such as spacecraft, robots, cyborgs, interstellar travel or other technologies.",
            "Science fiction films have often been used to focus on political or social issues, and to explore philosophical issues like the human condition.",
            "In many cases, tropes derived from written science fiction may be used by filmmakers ignorant of or at best indifferent to the standards of scientific plausibility and plot logic to which written science fiction is traditionally held."
          ]
        },
        {
          "Alien (film)": [
            "Alien is a 1979 science fiction horror film directed by Ridley Scott, and starring Sigourney Weaver, Tom Skerritt, Veronica Cartwright, Harry Dean Stanton, John Hurt, Ian Holm and Yaphet Kotto.",
            "It is the first movie in what became a large \"Alien\" franchise.",
            "The film's title refers to a highly aggressive extraterrestrial creature that stalks and attacks the crew of a spaceship.",
            "Dan O'Bannon, drawing upon previous works of science fiction and horror, wrote the screenplay from a story he co-authored with Ronald Shusett.",
            "The film was produced by Gordon Carroll, David Giler and Walter Hill through their company Brandywine Productions, and was distributed by 20th Century Fox."
          ]
        },
        {
          "Shadow Man (2006 film)": [
            "Shadow Man is a 2006 American thriller film directed by Michael Keusch, and also written and produced by Steven Seagal, who also starred in the film.",
            "The film co-stars Eva Pope, Imelda Staunton and Garrick Hagon.",
            "The film was released on direct-to-DVD in the United States on June 6, 2006.",
            "Widowed former CIA agent Jack Foster (The Shadow Man) is an enigmatic Fortune 500 business owner, and is the father of an 8-year-old daughter named Amanda.",
            "It's the anniversary of the death of Jack's wife, and Jack is taking Amanda to Romania, which is the birthplace of Amanda's mother, who died 5 years ago.",
            "But upon arrival at the airport in Bucharest, Romania, a car bomb blows up his CIA agent father-in-law George's limo, and Amanda is kidnapped."
          ]
        },
        {
          "LGBT themes in speculative fiction": [
            "LGBT themes in speculative fiction refer to the incorporation of lesbian, gay, bisexual, or transgender (LGBT) themes into science fiction, fantasy, horror fiction and related genres.",
            "Such elements may include an LGBT character as the protagonist or a major character, or explorations of sexuality or gender that deviate from the hetero-normative.",
            "Science fiction and fantasy have traditionally been puritanical genres aimed at a male readership, and can be more restricted than non-genre literature by their conventions of characterisation and the effect that these conventions have on depictions of sexuality and gender."
          ]
        }
      ],
      "retrieved_topics": [
        "Science fiction",
        "Visionary fiction",
        "History of science fiction",
        "Science fiction film",
        "Alien (film)",
        "Shadow Man (2006 film)",
        "LGBT themes in speculative fiction"
      ]
    },
    {
      "speaker": "1_Apprentice",
      "text": "Always looking for more science fiction to digest!",
      "retrieved_passages": [
        {
          "History of US science fiction and fantasy magazines to 1950": [
            "Science fiction and fantasy magazines began to be published in the US in the 1920s.",
            "Stories with science fiction themes had been appearing for decades in pulp magazines such as \"Argosy\", but there were no magazines that specialized in a single genre until 1915, when Street & Smith, one of the major pulp publishers, brought out \"Detective Story Magazine\".",
            "The first magazine to focus solely on fantasy and horror was \"Weird Tales\", which was launched in 1923, and established itself as the leading weird fiction magazine over the next two decades; writers such as H.P.",
            "Lovecraft, Clark Ashton Smith and Robert E. Howard became regular contributors."
          ]
        },
        {
          "Amazing Stories": [
            "Amazing Stories is an American science fiction magazine launched in April 1926 by Hugo Gernsback's Experimenter Publishing.",
            "It was the first magazine devoted solely to science fiction.",
            "Science fiction stories had made regular appearances in other magazines, including some published by Gernsback, but \"Amazing\" helped define and launch a new genre of pulp fiction.",
            "\"Amazing\" was published, with some interruptions, for almost eighty years, going through a half-dozen owners and many editors as it struggled to be profitable.",
            "Gernsback was forced into bankruptcy and lost control of the magazine in 1929, and by 1938 it was purchased by Ziff-Davis, who hired Raymond A. Palmer as editor."
          ]
        },
        {
          "Analog Science Fiction and Fact": [
            "Analog Science Fiction and Fact is an American science-fiction magazine published under various titles since 1930.",
            "Originally titled Astounding Stories of Super-Science, the first issue was dated January 1930, published by William Clayton, and edited by Harry Bates.",
            "Clayton went bankrupt in 1933 and the magazine was sold to Street & Smith.",
            "The new editor was F. Orlin Tremaine, who soon made \"Astounding\" the leading magazine in the nascent pulp science fiction field, publishing well-regarded stories such as Jack Williamson's \"Legion of Space\" and John W. Campbell's \"Twilight\".",
            "At the end of 1937, Campbell took over editorial duties under Tremaine's supervision, and the following year Tremaine was let go, giving Campbell more independence."
          ]
        },
        {
          "Future Science Fiction and Science Fiction Stories": [
            "Future Science Fiction and Science Fiction Stories were two American science fiction magazines that were published under various names between 1939 and 1943 and again from 1950 to 1960.",
            "Both publications were edited by Charles Hornig for the first few issues; Robert W. Lowndes took over in late 1941, and remained editor until the end.",
            "The initial launch of the magazines came as part of a boom in science fiction pulp magazine publishing at the end of the 1930s.",
            "In 1941 the two magazines were combined into one, titled \"Future Fiction combined with Science Fiction\", but in 1943 wartime paper shortages ended the magazine's run, as Louis Silberkleit, the publisher, decided to focus his resources on his mystery and western magazine titles."
          ]
        },
        {
          "Science fiction": [
            "Science fiction (often shortened to SF or sci-fi) is a genre of speculative fiction, typically dealing with imaginative concepts such as futuristic science and technology, space travel, time travel, faster than light travel, parallel universes, and extraterrestrial life.",
            "Science fiction often explores the potential consequences of scientific and other innovations, and has been called a \"literature of ideas\".",
            "It usually avoids the supernatural, unlike the related genre of fantasy.",
            "Historically, science-fiction stories have had a grounding in actual science, but now this is only expected of hard science fiction."
          ]
        },
        {
          "Galaxy Science Fiction": [
            "Galaxy Science Fiction was an American digest-size science fiction magazine, published from 1950 to 1980.",
            "It was founded by a French-Italian company, World Editions, which was looking to break into the American market.",
            "World Editions hired as editor H. L. Gold, who rapidly made \"Galaxy\" the leading science fiction (sf) magazine of its time, focusing on stories about social issues rather than technology.",
            "Gold published many notable stories during his tenure, including Ray Bradbury's \"The Fireman\", later expanded as \"Fahrenheit 451\"; Robert A. Heinlein's \"The Puppet Masters\"; and Alfred Bester's \"The Demolished Man\"."
          ]
        },
        {
          "Science fiction magazine": [
            "A science fiction magazine is a publication that offers primarily science fiction, either in a hard copy periodical format or on the Internet.",
            "Science fiction magazines traditionally featured speculative fiction in short story, novelette, novella or (usually serialized) novel form, a format that continues into the present day.",
            "Many also contain editorials, book reviews or articles, and some also include stories in the fantasy and horror genres.",
            "Malcolm Edwards and Peter Nicholls write that early magazines were not known as science fiction: \"if there were any need to differentiate them, the terms scientific romance or 'different stories' might be used, but until the appearance of a magazine specifically devoted to sf there was no need of a label to describe the category."
          ]
        }
      ],
      "retrieved_topics": [
        "History of US science fiction and fantasy magazines to 1950",
        "Amazing Stories",
        "Analog Science Fiction and Fact",
        "Future Science Fiction and Science Fiction Stories",
        "Science fiction",
        "Galaxy Science Fiction",
        "Science fiction magazine"
      ]
    }
  ],
  "chosen_topic_passage": [
    "Science fiction (often shortened to SF or sci-fi) is a genre of speculative fiction, typically dealing with imaginative concepts such as futuristic science and technology, space travel, time travel, faster than light travel, parallel universes, and extraterrestrial life.",
    "Science fiction often explores the potential consequences of scientific and other innovations, and has been called a \"literature of ideas\".",
    "It usually avoids the supernatural, unlike the related genre of fantasy.",
    "Historically, science-fiction stories have had a grounding in actual science, but now this is only expected of hard science fiction.",
    "Science fiction is difficult to define, as it includes a wide range of subgenres and themes.",
    "Hugo Gernsback, who suggested the term \"scientifiction\" for his \"Amazing Stories\" magazine, wrote: \"By 'scientifiction' I mean the Jules Verne, H. G. Wells and Edgar Allan Poe type of story—a charming romance intermingled with scientific fact and prophetic vision... Not only do these amazing tales make tremendously interesting reading—they are always instructive.",
    "They supply knowledge... in a very palatable form... New adventures pictured for us in the scientifiction of today are not at all impossible of realization tomorrow..."
  ]
}

[shashankMadan-designEsthetics]

Thanks @stephenroller !!! I was searching for it all over the internet!

[zorikg]

Does anyone know why the Apprentice has "retrieved_passages" collection? I thought only the Wizard performs the retrieval.

[stephenroller]

@klshuster do you remember?

[klshuster]

ya, passages are retrieved for both previous utterances (wizard, apprentice), however only the wizard can see these utterances. you can think of this like the wizard performing retrieval over it's last utterance AND the apprentice's last utterance

[zorikg]

Ok got it, thanks a lot!

[LeeShiyang]

ya, passages are retrieved for both previous utterances (wizard, apprentice), however only the wizard can see these utterances. you can think of this like the wizard performing retrieval over it's last utterance AND the apprentice's last utterance

I am wondering why in some cases, 'checked_sentence' item of wizard never appears in its 'retrieved_passages' of the same turn or "chosen_topic_passage" of the dialog. In these cases, where 'checked_sentence' comes from? I appreciate your clarification.

[LeeShiyang]

ya, passages are retrieved for both previous utterances (wizard, apprentice), however only the wizard can see these utterances. you can think of this like the wizard performing retrieval over it's last utterance AND the apprentice's last utterance

I am wondering why in some cases, 'checked_sentence' item of wizard never appears in its 'retrieved_passages' of the same turn or "chosen_topic_passage" of the dialog. In these cases, where 'checked_sentence' comes from? I appreciate your clarification.

@stephenroller

[klshuster]

can you please provide an example where this is the case?

[LeeShiyang]

can you please provide an example where this is the case?

I read the paper again and the paper says that We retrieve the top 7 articles (first paragraph only) for the last two turns of dialogue (by wizard and apprentice) and the article (first 10 sentences only) for the original topic, and present these articles to the wizard as knowledge context, along with their titles.

My understanding is that 'checked_sentence' item of wizard in a specific turn may come from either previous 2 turns or "chosen_topic_passage" of the dialog and in each turn, its 'retrieved_passages' is passages that are retrieved from current turn's utterance from apprentice or wizard, which are used for wizard in next turn.

import json
count = 0
total = 0
not_found = []
data = json.load(open("/mnt/raid0/shiyangli/ParlAI/data/wizard_of_wikipedia/data.json"))
for i,dialog_data in enumerate(data):
    passage_list = []
    for j,turn in enumerate(dialog_data["dialog"]):
        turn_passage = []
        for passage in turn["retrieved_passages"]:
            for _,value in passage.items():
                turn_passage += value
        passage_list.append(turn_passage) ## Add current turn's passage
    if("wizard" in turn["speaker"].lower() and turn["checked_sentence"] and (list(turn["checked_sentence"].values())[0] != "no_passages_used")): ## Make sure wizard checked a sentence from given knowledge.
            flag = list(turn["checked_sentence"].values())[0] in dialog_data["chosen_topic_passage"] ## Check if the sentence is from topic retrieval
            if(flag):
                count += 1
            else:
                last_k_passage = []
                ##for passage in passage_list[-4:-1]: ## Check if the sentence is from last 3 turn retrieval
                for passage in passage_list[-3:-1]: ## Check if the sentence is from last 2 turn retrieval
                    last_k_passage += passage
                flag = list(turn["checked_sentence"].values())[0] in last_k_passage
                if(flag):
                    count += 1
            if(not flag):
                not_found.append([i,j])   
            total += 1
print(count/total)

If I check weather the checked sentence by wizard is from last 2 turns retrieval or topic retrieval, the coverage (last print line) is 0.9999680949494305. If I use last 3 turns (I commented this line in the code), the coverage is 1. In this case, there is little mismatch with paper description. Is there anything I do wrong? I appreciate your clarification. Thank you!

[klshuster]

you are correct in your interpretation; we are aware that there are a few instances where, for some reason, the selected sentence does not show up in that set of passages. we believe this may have been from a small bug in the data collection at the time. as you can see, this happened extremely rarely, and also as you have intuited, it looks like this may be solved by looking at the passages from 3 turns ago

[LeeShiyang]

you are correct in your interpretation; we are aware that there are a few instances where, for some reason, the selected sentence does not show up in that set of passages. we believe this may have been from a small bug in the data collection at the time. as you can see, this happened extremely rarely, and also as you have intuited, it looks like this may be solved by looking at the passages from 3 turns ago

Thank you so much. I think authors can add clarification in the readme repo of wizard of Wikipedia dataset, e.g. what each key means in the dictionary object for clearer understanding.

[klshuster]

Yeah, I can do that. The code has an explanation but pulling it into the README seems like a good idea: https://github.com/facebookresearch/ParlAI/blob/master/parlai/tasks/wizard_of_wikipedia/agents.py#L178-L187