Skip to content

Latest commit

 

History

History
47 lines (35 loc) · 26.5 KB

test_compare_prompts_results.md

File metadata and controls

47 lines (35 loc) · 26.5 KB

Generated from test_compare_prompts_results.

Prompt Comparison

Prompt Mean Cosine distance Std Dev
sys_prompt_1 0.0873795 0.0213343
sys_prompt_2 0.0963739 0.0203911

Prompt Comparison

Test Results

test_id prompt article expected_summary output cos_sim
test_summarize_with_sys_prompt_1[0-1-3] SystemMessage('Summarize the article in 30 words.') Children of Time is a 2015 science fiction novel b... more "Children of Time" by Adrian Tchaikovsky, praised for addressing major themes, won the 2016 Arthur C. Clarke Award. It has sequels and might be adapted into a film. The series won the 2023 Hugo Award. "Children of Time" is a praised science fiction novel, winning the Arthur C. Clarke Award in 2016 and the Hugo Award in 2023. It has been optioned for a potential film adaptation. 0.134573
test_summarize_with_sys_prompt_1[0-2-3] SystemMessage('Summarize the article in 30 words.') Children of Time is a 2015 science fiction novel b... more "Children of Time" by Adrian Tchaikovsky, praised for addressing major themes, won the 2016 Arthur C. Clarke Award. It has sequels and might be adapted into a film. The series won the 2023 Hugo Award. "Children of Time," a 2015 sci-fi novel by Adrian Tchaikovsky, won the Arthur C. Clarke Award in 2016. It was praised for its exploration of big themes and later won the Hugo Award. 0.0716579
test_summarize_with_sys_prompt_1[0-3-3] SystemMessage('Summarize the article in 30 words.') Children of Time is a 2015 science fiction novel b... more "Children of Time" by Adrian Tchaikovsky, praised for addressing major themes, won the 2016 Arthur C. Clarke Award. It has sequels and might be adapted into a film. The series won the 2023 Hugo Award. "Children of Time," a 2015 science fiction novel by Adrian Tchaikovsky, was praised for its exploration of big themes and won the Arthur C. Clarke Award in 2016. The series received further recognition, including a film adaptation option and a Hugo Award in 2023. 0.0775352
test_summarize_with_sys_prompt_1[1-1-3] SystemMessage('Summarize the article in 30 words.') Dune Messiah is a science fiction novel by America... more Dune Messiah, by Frank Herbert, is the second book in the Dune series, following the 1965 novel Dune. Serialized in 1969, it continues the saga and was adapted into a 2003 miniseries with its sequel. "Dune Messiah" is a science fiction novel by Frank Herbert, part of his Dune series. Serialized in 1969 and published in 1969, it was adapted into a miniseries titled "Frank Herbert's Children of Dune" in 2003. 0.0981673
test_summarize_with_sys_prompt_1[1-2-3] SystemMessage('Summarize the article in 30 words.') Dune Messiah is a science fiction novel by America... more Dune Messiah, by Frank Herbert, is the second book in the Dune series, following the 1965 novel Dune. Serialized in 1969, it continues the saga and was adapted into a 2003 miniseries with its sequel. "Dune Messiah" by Frank Herbert is a science fiction novel and the second in the Dune series, originally published in 1969 and adapted into a miniseries in 2003. 0.0710162
test_summarize_with_sys_prompt_1[1-3-3] SystemMessage('Summarize the article in 30 words.') Dune Messiah is a science fiction novel by America... more Dune Messiah, by Frank Herbert, is the second book in the Dune series, following the 1965 novel Dune. Serialized in 1969, it continues the saga and was adapted into a 2003 miniseries with its sequel. "Dune Messiah" by Frank Herbert is a science fiction novel and sequel to "Dune," serialized in 1969. It was made into a TV miniseries titled "Frank Herbert's Children of Dune" in 2003. 0.100824
test_summarize_with_sys_prompt_1[2-1-3] SystemMessage('Summarize the article in 30 words.') "Story of Your Life" is a science fiction novella ... more "Story of Your Life" by Ted Chiang explores language and determinism, winning the 2000 Nebula and 1999 Sturgeon Awards. Adapted into the film "Arrival" by Denis Villeneuve in 2016, it received critical acclaim and multiple awards, including an Academy Award for Best Sound Editing. "Story of Your Life" by Ted Chiang is a science fiction novella exploring themes of language and determinism. It won awards and was adapted into the film Arrival in 2016. 0.079789
test_summarize_with_sys_prompt_1[2-2-3] SystemMessage('Summarize the article in 30 words.') "Story of Your Life" is a science fiction novella ... more "Story of Your Life" by Ted Chiang explores language and determinism, winning the 2000 Nebula and 1999 Sturgeon Awards. Adapted into the film "Arrival" by Denis Villeneuve in 2016, it received critical acclaim and multiple awards, including an Academy Award for Best Sound Editing. "Story of Your Life" by Ted Chiang is a science fiction novella focusing on language and determinism. It won awards and was adapted into the film "Arrival" in 2016. 0.0662408
test_summarize_with_sys_prompt_1[2-3-3] SystemMessage('Summarize the article in 30 words.') "Story of Your Life" is a science fiction novella ... more "Story of Your Life" by Ted Chiang explores language and determinism, winning the 2000 Nebula and 1999 Sturgeon Awards. Adapted into the film "Arrival" by Denis Villeneuve in 2016, it received critical acclaim and multiple awards, including an Academy Award for Best Sound Editing. "Story of Your Life" is a science fiction novella by Ted Chiang focusing on language and determinism, winning multiple awards and inspiring a film adaptation titled "Arrival," recognized for its screenplay and sound editing. 0.0866128
test_summarize_with_sys_prompt_2[0-1-3] SystemMessage('Summarize article into concise overview, focuing on the main points and conclusion.') Children of Time is a 2015 science fiction novel b... more "Children of Time" by Adrian Tchaikovsky, praised for addressing major themes, won the 2016 Arthur C. Clarke Award. It has sequels and might be adapted into a film. The series won the 2023 Hugo Award. "Children of Time" by Adrian Tchaikovsky is a 2015 science fiction novel that received praise for its exploration of complex themes like gods, messiahs, artificial intelligence, and alienness. The book won the prestigious Arthur C. Clarke Award for best science fiction in 2016. The series continued with "Children of Ruin" in 2019 and "Children of Memory" in 2022. In 2023, the series was honored with the Hugo Award for Best Series. Additionally, the rights for a potential film adaptation of the first novel were optioned in July 2017. 0.12546
test_summarize_with_sys_prompt_2[0-2-3] SystemMessage('Summarize article into concise overview, focuing on the main points and conclusion.') Children of Time is a 2015 science fiction novel b... more "Children of Time" by Adrian Tchaikovsky, praised for addressing major themes, won the 2016 Arthur C. Clarke Award. It has sequels and might be adapted into a film. The series won the 2023 Hugo Award. "Children of Time" is a science fiction novel by Adrian Tchaikovsky that has been highly acclaimed. It won the Arthur C. Clarke Award for best science fiction in 2016 and was praised for its exploration of big themes like gods, messiahs, artificial intelligence, and alienness. The novel was noted for its universal scale and sense of wonder, reminiscent of Clarke himself. The success of the book also led to the rights being optioned for a potential film adaptation. The series progressed with sequels titled "Children of Ruin" in 2019 and "Children of Memory" in 2022. In 2023, the series was awarded the prestigious Hugo Award for Best Series. 0.110344
test_summarize_with_sys_prompt_2[0-3-3] SystemMessage('Summarize article into concise overview, focuing on the main points and conclusion.') Children of Time is a 2015 science fiction novel b... more "Children of Time" by Adrian Tchaikovsky, praised for addressing major themes, won the 2016 Arthur C. Clarke Award. It has sequels and might be adapted into a film. The series won the 2023 Hugo Award. "Children of Time" is a highly acclaimed science fiction novel by Adrian Tchaikovsky that delves into themes like gods, messiahs, artificial intelligence, and alienness. The book was awarded the prestigious Arthur C. Clarke Award in 2016 and was praised for its universal scale and sense of wonder. The success of the novel led to a potential film adaptation in 2017. The book's sequels, "Children of Ruin" in 2019 and "Children of Memory" in 2022 continued the series. In 2023, the series was honored with the Hugo Award for Best Series. 0.129058
test_summarize_with_sys_prompt_2[1-1-3] SystemMessage('Summarize article into concise overview, focuing on the main points and conclusion.') Dune Messiah is a science fiction novel by America... more Dune Messiah, by Frank Herbert, is the second book in the Dune series, following the 1965 novel Dune. Serialized in 1969, it continues the saga and was adapted into a 2003 miniseries with its sequel. "Dune Messiah" is a science fiction novel that is the second book in Frank Herbert's six-part Dune series. Originally serialized in Galaxy magazine in 1969 and published by Putnam the same year, it continues the story from the first book "Dune" (1965). The sequel "Children of Dune" (1976) further expands on the narrative. Both books were adapted into a miniseries by the Sci-Fi Channel in 2003 titled "Frank Herbert's Children of Dune." 0.0864517
test_summarize_with_sys_prompt_2[1-2-3] SystemMessage('Summarize article into concise overview, focuing on the main points and conclusion.') Dune Messiah is a science fiction novel by America... more Dune Messiah, by Frank Herbert, is the second book in the Dune series, following the 1965 novel Dune. Serialized in 1969, it continues the saga and was adapted into a 2003 miniseries with its sequel. "Dune Messiah" by Frank Herbert is a science fiction novel and the second installment in the Dune series. Originally serialized in Galaxy magazine in 1969, it was published by Putnam the same year. The book, along with its sequel "Children of Dune," was adapted into a miniseries titled "Frank Herbert's Children of Dune" by the Sci-Fi Channel in 2003. 0.0962258
test_summarize_with_sys_prompt_2[1-3-3] SystemMessage('Summarize article into concise overview, focuing on the main points and conclusion.') Dune Messiah is a science fiction novel by America... more Dune Messiah, by Frank Herbert, is the second book in the Dune series, following the 1965 novel Dune. Serialized in 1969, it continues the saga and was adapted into a 2003 miniseries with its sequel. "Dune Messiah" is the second book in Frank Herbert's Dune series, following the original "Dune" published in 1965. It was serialized in Galaxy magazine in 1969 and then published by Putnam the same year. The novel, alongside its sequel "Children of Dune," was adapted into a miniseries called "Frank Herbert's Children of Dune" by the Sci-Fi Channel in 2003. 0.0755048
test_summarize_with_sys_prompt_2[2-1-3] SystemMessage('Summarize article into concise overview, focuing on the main points and conclusion.') "Story of Your Life" is a science fiction novella ... more "Story of Your Life" by Ted Chiang explores language and determinism, winning the 2000 Nebula and 1999 Sturgeon Awards. Adapted into the film "Arrival" by Denis Villeneuve in 2016, it received critical acclaim and multiple awards, including an Academy Award for Best Sound Editing. "Story of Your Life" is a science fiction novella by Ted Chiang, focusing on language and determinism. It won the Nebula Award for Best Novella and the Theodore Sturgeon Award, as well as being nominated for the Hugo Award for Best Novella. The novella has been translated into multiple languages. A film adaptation titled "Arrival," directed by Denis Villeneuve and starring Amy Adams, Jeremy Renner, and Forest Whitaker was released in 2016. The film received critical acclaim, winning several awards including an Academy Award for Best Sound Editing and the Hugo Award for Best Dramatic Presentation. 0.0824336
test_summarize_with_sys_prompt_2[2-2-3] SystemMessage('Summarize article into concise overview, focuing on the main points and conclusion.') "Story of Your Life" is a science fiction novella ... more "Story of Your Life" by Ted Chiang explores language and determinism, winning the 2000 Nebula and 1999 Sturgeon Awards. Adapted into the film "Arrival" by Denis Villeneuve in 2016, it received critical acclaim and multiple awards, including an Academy Award for Best Sound Editing. "Story of Your Life" is a science fiction novella by Ted Chiang, focusing on themes of language and determinism. It won the 2000 Nebula Award for Best Novella and was nominated for the 1999 Hugo Award. The novella has been translated into multiple languages and was adapted into the film Arrival in 2016, directed by Denis Villeneuve and starring Amy Adams, Jeremy Renner, and Forest Whitaker. The film received critical acclaim and multiple award nominations, ultimately winning the Academy Award for Best Sound Editing, the Ray Bradbury Award for Outstanding Dramatic Presentation, and the Hugo Award for Best Dramatic Presentation. 0.0784495
test_summarize_with_sys_prompt_2[2-3-3] SystemMessage('Summarize article into concise overview, focuing on the main points and conclusion.') "Story of Your Life" is a science fiction novella ... more "Story of Your Life" by Ted Chiang explores language and determinism, winning the 2000 Nebula and 1999 Sturgeon Awards. Adapted into the film "Arrival" by Denis Villeneuve in 2016, it received critical acclaim and multiple awards, including an Academy Award for Best Sound Editing. "Story of Your Life" is a science fiction novella by Ted Chiang, exploring themes of language and determinism. The novella won the Nebula Award for Best Novella in 2000 and the Theodore Sturgeon Award in 1999. It was also nominated for the Hugo Award for Best Novella in 1999. Additionally, it has been translated into various languages. A film adaptation titled "Arrival," directed by Denis Villeneuve and starring Amy Adams, Jeremy Renner, and Forest Whitaker, was released in 2016. The film received critical acclaim and won several awards, including an Academy Award for Best Sound Editing, the Ray Bradbury Award for Outstanding Dramatic Presentation, and the Hugo Award for Best Dramatic Presentation. 0.0834381

Article details

Article 0

Children of Time is a 2015 science fiction novel by author Adrian Tchaikovsky. The work was praised by Financial Times for "tackling big themes—gods, messiahs, artificial intelligence, alienness—with brio."[1] It was selected from a shortlist of six works[2] and a total pool of 113 books to be awarded the Arthur C. Clarke Award for best science fiction of the year in August 2016.[3][4] The director of the award program appraised the novel as having "universal scale and sense of wonder reminiscent of Clarke himself."[5] In July 2017, the rights were optioned for a potential film adaptation.[6] The next in the series, Children of Ruin, was published in 2019, followed by Children of Memory in 2022.[7] In 2023 the series was awarded the Hugo Award for Best Series.

Article 1

Dune Messiah is a science fiction novel by American writer Frank Herbert, the second in his Dune series of six novels. A sequel to Dune (1965), it was originally serialized in Galaxy magazine in 1969, and then published by Putnam the same year. Dune Messiah and its own sequel Children of Dune (1976) were collectively adapted by the Sci-Fi Channel in 2003 into a miniseries entitled Frank Herbert's Children of Dune.

Article 2

"Story of Your Life" is a science fiction novella by American writer Ted Chiang, first published in Starlight 2 in 1998, and in 2002 in Chiang's collection of short stories, Stories of Your Life and Others. Its major themes are language and determinism. "Story of Your Life" won the 2000 Nebula Award for Best Novella, as well as the 1999 Theodore Sturgeon Award. It was nominated for the 1999 Hugo Award for Best Novella. The novella has been translated into Italian, Japanese, French and German.[1] A film adaptation of the story, Arrival, was conceived and adapted by Eric Heisserer. Titled and directed by Denis Villeneuve, it was released in 2016. It stars Amy Adams, Jeremy Renner, and Forest Whitaker and was nominated for eight Academy Awards, including Best Picture and Best Adapted Screenplay; it won the award for Best Sound Editing.[2][3][4] The film also won the 2017 Ray Bradbury Award for Outstanding Dramatic Presentation and the Hugo Award for Best Dramatic Presentation.