loading page

Earnings call scripts generation with large language models: A study of few-shot prompting and fine-tuning methods
  • Sovik Kumar Nath,
  • Yanyan Zhang,
  • Jia (Vivian) Li
Sovik Kumar Nath
Amazon Web Services Inc

Corresponding Author:sovikn@amazon.com

Author Profile
Yanyan Zhang
Amazon Web Services Inc
Author Profile
Jia (Vivian) Li
Amazon Web Services Inc
Author Profile

Abstract

Company earnings calls are crucial events that provide transparency into a company’s financial health and prospects. Large language models (LLMs) offer a promising approach to automatically generate the first draft of earnings call scripts from financial data and past examples. We evaluate two methods: 1) Few-shot prompt engineering with a state-of-the-art model, and 2) Fine-tuning a language model on earnings call transcript data. Our results indicate both approaches can produce coherent scripts covering key metrics, updates, and guidance. However, there are trade-offs in comprehensiveness, hallucinations, writing style, ease of use, and cost. We discuss the pros and cons of each method to guide practitioners on effectively leveraging large language models for this financial communication task.
19 Aug 2024Submitted to Applied AI Letters
21 Aug 2024Submission Checks Completed
21 Aug 2024Assigned to Editor
06 Sep 2024Reviewer(s) Assigned
08 Oct 2024Review(s) Completed, Editorial Evaluation Pending
08 Oct 2024Editorial Decision: Revise Major
01 Nov 20241st Revision Received
04 Nov 2024Submission Checks Completed
04 Nov 2024Assigned to Editor
11 Nov 2024Reviewer(s) Assigned
07 Dec 2024Review(s) Completed, Editorial Evaluation Pending
07 Dec 2024Editorial Decision: Revise Minor