Discussion about this post

User's avatar
Daniel Rubio's avatar

This is a bit of a nerdy quibble, but worth bringing up: our qualitative idea of an "independent" expert and an "independent" test aren't the same thing as probabilistic independence. We think of an independent expert as something like: an expert who examines the evidence without consulting the opinions/notes of other experts before forming their opinion. But that doesn't guarantee probabilistic independence. In fact, most expert judgments will be probabilistically related when looking at similar evidence sets or when operating in the same "universe of discourse," where e.g. "Martian Fish" is never going to be the correct answer.

That doesn't undermine most of your point here, which I think is more right than wrong (especially about the value of counter reliable sources; there are specific people whose social media I check because I knew they tend to be anti-correlated to the truth). But while Condorect gives some conditions under which diversifying your evidential influences can improve things, they're not conditions we often find ourselves in.

Expand full comment
Joseph Rahi's avatar

I think I have a weird extension of this logic. I sometimes deliberately keep myself ignorant of a topic, in order to leave more space for originality and potential new insights and avoid just adopting others opinions (and it's also more satisfying to figure things out for myself). I suppose I'm choosing to be less informed, in order to (hopefully) be more informative. I guess effectively trying to be the less reliable "independent expert".

It's counterintuitive that the less reliable expert might be more informative, but it's even weirder to think it might be worth choosing to be less reliable/informed yourself.

Although I tend to only do this temporarily and then try to learn what others have found after.

Expand full comment
10 more comments...

No posts