This section is at https://rollingedition.com/evaluating-llm-applications/keep-the-evaluation-running#flaky-cases.