Skip to content

Latest commit

 

History

History
159 lines (126 loc) · 9.62 KB

COMPARISON.md

File metadata and controls

159 lines (126 loc) · 9.62 KB

Comparison of Model Outputs

This repository contains outputs generated by different models trained on various inputs. Here's a comparison of the outputs from three different models:

  1. Fine-tuned Model with that follows parsable format we require

    This output was generated using a fine-tuned model with a specific prompt and tuning. The generated story is in the format required for our use case, including scenes, dialogues, narrator lines, and descriptions. The narrative structure is coherent and follows the provided prompt seamlessly, making it suitable for further processing and analysis.

    Example Scene:

    Scene 1 - The Journey Begins
    (Newline)
    Narrator: In the heart of the dense and mysterious Eldrador Forest, a group of close friends embarked on a camping trip, seeking solace and adventure in the untamed wilderness. (Insert newline)
    (Enter the group of friends, excited and eager for their adventure)
    Friend 1: Oh man, I can't wait to get away from the city and just relax in nature. This is going to be amazing!
    
  2. Only Prompted, Not Fine-tuned

    This output was generated using a model without fine-tuning, only based on the provided prompt. While it follows the general structure of scenes, dialogues, and descriptions, the narrative lacks coherence and the format is not as consistent as the fine-tuned model output. Some parts may require manual editing or processing to fit the desired format.

    Example Scene:

    Scene 1 - Intro:
    (The camera pans over a dense and mysterious forest, before landing on a group of friends hiking through the underbrush.)
    Friend 1: (excitedly) I've been wanting to do this for ages! A camping trip in Eldrador Forest. It's like the ultimate adventure.
    
  3. No Fine-tune

    This output was generated without a prompt or fine-tuning, resulting in a narrative that lacks structure and coherence. While it includes scenes, dialogues, and descriptions, the story's flow is disjointed, making it challenging to parse or use directly for our intended purpose without significant manual editing or post-processing.

    Example Scene:

    Scene 1 - The Discovery
    (Newline)
    Narrator: In the heart of a dense forest, a group of friends stumbled upon an abandoned village, shrouded in mystery and cursed by vengeful spirits. (Insert newline)
    (Enter the group of friends, cautiously approaching the village)
    Friend 1 : (excited) Wow, this place is creepy. Let's check it out. (Insert newline)
    

Overall, the fine-tuned model with a specific prompt and tuning produces the most suitable output for our use case, providing a structured narrative that aligns well with our project requirements.

  1. Full scripts(if you want a peek) -- Fine-tuned/tweaked Model

Scene 1 - The Journey Begins (Newline) Narrator: In the heart of the dense and mysterious Eldrador Forest, a group of close friends embarked on a camping trip, seeking solace and adventure in the untamed wilderness. (Insert newline) (Enter the group of friends, excited and eager for their adventure) Friend 1: Oh man, I can't wait to get away from the city and just relax in nature. This is going to be amazing! Friend 2: I know, right? I've heard so many stories about this forest, I can't wait to explore it. Friend 3: And to think, we have the whole place to ourselves. It's like our own little paradise. (They continue walking, chatting and laughing, until they come across an old, abandoned village)

Scene 2 - The Discovery (Newline) Narrator: As they ventured deeper into the forest, they stumbled upon an abandoned village, shrouded in an aura of dark secrets and vengeful spirits. (Insert newline) (Enter the group, cautiously approaching the village) Friend 1: Whoa, what is this place? It's like something out of a horror movie. Friend 2: Yeah, let's keep moving. I don't like this. Friend 3: But think of all the cool stories we could tell with this as a backdrop. It's too good to pass up. (They enter the village, exploring the abandoned homes and structures)

Scene 3 - The Vengeful Spirits (Newline) Narrator: As they ventured deeper into the village, they were suddenly trapped and hunted by unseen forces, forced to confront their deepest fears and unravel the chilling truths about the village's past. (Insert newline) (Enter the vengeful spirits, appearing to the group as dark shadows) Spirit 1: You should not have come here. Friend 1: What do you want from us? Spirit 2: You have disturbed the peace of the village. You must pay the price. Friend 2: Please, we didn't mean to disturb anything. We'll leave at once. Spirit 3: It's too late for that. You have seen too much. You must be punished. (The spirits begin to close in on the group, their moods dark and foreboding)

Scene 4 - The Haunting History (Newline) Narrator: As the group navigates the treacherous terrain, they uncover the haunting history of the village, filled with tragic events and horrific betrayals. (Insert newline) (Enter the group, discovering a hidden journal in one of the abandoned homes) Friend 1: What's this? A journal? Friend 2: Let me see. (Begins to read) "The village was cursed by a powerful sorcerer seeking revenge against the village's people." (Pauses) "The vengeful spirits, now unleashed upon the world, will stop at nothing to claim the lives of the intruders, determined to protect the village's dark secrets at all costs." Friend 3: Whoa, this is heavy. (They continue reading, learning more about the village's tragic past)

Scene 5 - The True Terror (Newline) Narrator: With each step, the group discovers that the line between life and death is thin, and that the curse is not just a supernatural phenomenon, but a reflection of their own inner demons. (Insert newline) (Enter the group, their moods dark and foreboding) Friend 1: I don't know if we can do this. The curse is too strong. Friend 2: We have to try. We can't just give up. Friend 3: I know, but I can feel it. The curse is inside us, eating away at our souls. (They continue their journey, but their moods grow darker and more desperate)

-- Purely prompted base model, with extra context info

Scene 1 - Intro: (The camera pans over a dense and mysterious forest, before landing on a group of friends hiking through the underbrush.) Friend 1: (excitedly) I've been wanting to do this for ages! A camping trip in Eldrador Forest. It's like the ultimate adventure. Friend 2: (skeptically) Are you sure that's a good idea? This forest has a reputation for being creepy and dangerous. Friend 3: (calmly) Don't worry, we'll be fine. We're with each other, and we have our tents and supplies. What could go wrong? (The group continues hiking, their footsteps echoing through the forest.)

Scene 2 - Exploration: (The group cautiously explores the village, their flashlights casting eerie shadows on the walls of the buildings.) Friend 3: (whispering) This place gives me the chills. Let's keep moving and find a safe spot to set up camp. (Suddenly, they hear strange noises coming from within one of the buildings. They quickly move towards it, their hearts racing.)

Scene 3 - Discovery: (As they continue exploring, they come across a hidden room deep within the building.) Friend 3: (excitedly) Guys! Come check this out! (They enter the room, their flashlights revealing a chilling discovery.)

Scene 4 - Confrontation: (Suddenly, they hear footsteps coming from outside the room.) Friend 3: (nervously) Guys...I think we should get out of here. Now. (They quickly leave the room and find themselves face to face with a supernatural force.)

Scene 5 - Escape: (The group manages to escape the village, but they are not out of danger yet.) Friend 3: (excitedly) We did it! We actually broke the curse! Friend 1: (relieved) But at what cost? That was some serious stuff back there. (They continue on their journey, their footsteps echoing through the forest as they try to put the horrors of the village behind them.)

-- No Prompt, Base llama2:7b model

Scene 1 - The Discovery (Newline) Narrator: In the heart of a dense forest, a group of friends stumbled upon an abandoned village, shrouded in mystery and cursed by vengeful spirits. (Insert newline) (Enter the group of friends, cautiously approaching the village) Friend 1 : (excited) Wow, this place is creepy. Let's check it out. (Insert newline)

Scene 2 - The Vengeful Spirits (Newline) Narrator: As they explored the village, the group of friends were suddenly trapped and hunted by unseen forces, determined to protect the village's dark secrets at all costs. (Insert newline) (Enter the vengeful spirits, appearing to the group as dark shadows) Spirit 1 : (menacingly) You should not have come here. (Insert newline)

Scene 3 - The True Terror (Newline) Narrator: As the group of friends tries to escape the village, they begin to realize that the true terror lies within themselves. (Insert newline) (Enter the group, their faces contorted in pain and fear) Friend 1 : (desperately) We have to get out of here. The spirits are too strong. (Insert newline)

Scene 4 - The Ritual (Newline) Narrator: With their hearts filled with determination and their minds filled with the secrets of the village, the group of friends embarks on the most crucial part of their journey: the ritual to break the curse. (Insert newline) (Enter the group, their voices chanting in unison as they perform the ritual) Friend 1 : (urgently) Come, spirits of the forest. Hear our plea. (Insert newline)

Scene 5 - Escape (Newline) Narrator: The group manages to escape the village, but they are not out of danger yet. (Insert newline) (Enter the group, their faces reflecting relief and exhaustion) Friend 1: (relieved) We made it out alive. But we'll never forget what happened here. (Insert newline)