I only play with offline AI stuff, but I usually use a model that is way more powerful than the average in the offline LLM space (Lama 2 70B). I have tried building a Leto II character from God Emperor of Dune, and I did several LoRA training layers on various data including the entire GEoD book. The book itself had very little value. It lacks the right context scope and detail needed to do anything relevant. It becomes possible to question some high level plot or character info, but I remember more than the model could accurately pull out.

The really cool cutting edge thing of the future will be authors embracing AI for their own creative inspiration and whomever is the first to fully integrate with AI. Train yourself and your characters so that a screen can generate images of characters and locations as they develop page by page. The identity of each character can build with a random seed with a persistent token so that every read has a different accompanied look and feel. In the future I’m sure it will be possible to limit a character’s context to the information read by the user, (this is a major key to individualized learning - probably the biggest future application of LLMs). A character/user matched scope would make interaction and direct questioning next level cool. Forget book clubs, now you converse with a circle of characters, or the author as a digitized character.

AI is the framework. All the hype and BS is because of stupid greedy people trying to make AI a product. This is next level privacy invasive nonsense. Proprietary AI must die. The future is offline AI as a simple tool unitized to create a richer or accessible future experience.