Cache segment data calculations

Problem/Motivation

Prompt segments may sometimes perform more expensive calculations (such as fetching external resources, or deriving values), so it is good for prompt to save/stash/cache calculation result for reuse.

Proposed resolution

Remaining tasks

User interface changes

API changes

Data model changes