Building and Fine-Tuning a Personalized Conversational LLM from Scratch
This paper records the process of creating and fine-tuning a conversational large language model (LLM) with the purpose of replicating an individual’s texting style and shares insights on model capacity ceilings, data format design, parameter-efficient fine-tuning, and the cost of manual preference labeling.