Hoi! 👋 Sunday notes from Heerlen 🇳🇱
How do you pick a confidence threshold for an AI feature? Not by "0.8 feels safe" 😹
For changelog-bot, John and I grew our WHY eval set from 14 to 50 cases (incl. multilingual ones) and swept thresholds by precision/recall/F1.
