Write a Novel with AI - NovelWriter

Introduction

The creative capabilities of large language models (LLMs) have fascinated humans for a while now. This intrigue stems from how closely LLM outputs can resemble human creativity. Consequently, people leverage these models for various purposes such as writing stories and novels, which include experimentation, acting as writing assistants, idea generation, world-building, collaboration, and, simply put, entertainment.

When new models emerge that promise enhanced long-context capabilities, interest surges. These LLMs are engineered to handle and process significantly longer input sequences, typically ranging between 1,000 to 10,000 tokens. They can maintain context, track storylines, and create coherent text across extended narratives, making them distinct from traditional LLMs with limited context windows. Consequently, long-context LLMs are perfect for novel writing, as they provide consistent, engaging content that maintains a narrative focus which is ideal for crafting entire novels or long-form offerings.

This has led many enthusiasts to test out new open-source models designed specifically for novel writing. However, while some open-source LLMs excel in story creation, several notable names struggle with maintaining long contexts. Regardless of the claims made, the most effective long-context models for coherent storytelling remain API-based, including tools like OpenAI's GPT-4, Anthropic's models like Claude, and Google's Gemini, among others.

In today’s article, I’ll introduce an open-source tool called NovelWriter, which is essentially a collection of Python scripts. This tool enables users to utilize these powerful API-based models to write novels effectively. It offers the flexibility to work with several models, including OpenAI's, Anthropic's Claude, and others.

Before we dive into the installation steps, I'd like to extend a big thank you to M Compute, our sponsor for this video. If you’re seeking to rent a GPU at affordable rates, check out their website in the description below. You'll also find a coupon code offering a 50% discount on a selection of GPUs.

Now, let's focus on installation without requiring a powerful GPU. We'll create a virtual environment to keep our dependencies organized:

## Introduction
python3 -m venv novelwriter-env

## Introduction
source novelwriter-env/bin/activate

## Introduction
git clone [repository_url]

## Introduction
cd novelwriter

## Introduction
pip install -r requirements.txt

Upon encountering some dependency issues, we can adjust the requirements to use the latest versions instead of specific ones.

Once everything is installed, we can open the project in a code editor, such as VS Code, and make modifications in two files: writers.py and settings.py. The API key you’ll need should be placed in writers.py. You can retrieve this key by registering on platforms like AI Studio or Google Gemini.

The next file to edit is settings.py, which contains the prompt for novel writing. If you’re using a different model (e.g., Mistral), ensure to swap the necessary lines accordingly.

After completing these modifications, we can execute the program to begin outlining a novel:

python3 outline.py

Prompted to write a novel, I opted for a historical fiction tale centered on George B. Bod, a 19th-century financial magnate. After choosing narrative elements and detailing characters, the tool began generating content.

In conclusion, NovelWriter offers a robust open-source solution for writing novels using advanced API-based models. While it provides an excellent resource for aspiring writers, be cautious of associated costs when utilizing these APIs extensively.

Keyword

• Large Language Models
• Novel Writing
• Long Context
• API-based Models
• Open Source
• NovelWriter
• Python Scripts
• Installation
• George B. Bod
• Historical Fiction

FAQ

What is NovelWriter?
NovelWriter is an open-source tool made up of Python scripts that allow users to write novels using advanced API-based language models.

Why are long-context LLMs important for novel writing?
Long-context LLMs can handle and maintain coherence and context over extended narratives, making them ideal for creating complex stories and novels.

Which models does NovelWriter support?
NovelWriter supports a variety of models, including OpenAI's GPT-4, Anthropic's Claude, and others, providing flexibility for writers.

How can I install NovelWriter?
You can install NovelWriter by creating a virtual environment, cloning the Git repository, and installing the necessary dependencies following specific commands.

Are there any costs associated with using NovelWriter?
While NovelWriter is open source, using API-based models often has usage costs. It’s advisable to monitor the usage to avoid unexpected charges while writing longer stories.