You must have an expert or experts. That expert will then make decisions, and use metrics and surveys and intuition to drive their new world view, but it's the expert that is always at the top of the stack.
If you then take that model and try to use them in a new domain, that is never going to work out. The environment adapts to the incentives that the current system produces, and will instantly make your pre-created model worthless[0]. The only way to work out long-term is by having an expert stay ahead of the pack creating what they think are systems with better signal to the noise.
I'd recommend reading The Community Engagement Trap[0] by Rosie Sherry (which should also be shared here on HN), she talks about Community Discovery as the process for getting these deeper understandings.
If you then take that model and try to use them in a new domain, that is never going to work out. The environment adapts to the incentives that the current system produces, and will instantly make your pre-created model worthless[0]. The only way to work out long-term is by having an expert stay ahead of the pack creating what they think are systems with better signal to the noise.
[0]: https://dilbert.com/strip/1995-11-13