Comments on “An exercise: meta-rational phenomena”

psychological meta-flexibility literature

lyfe 2019-10-01

https://journals.sagepub.com/doi/full/10.1177/2043808718779431

let me know if you need the pdf.

you might find it interesting - they talk about meta-flexibility.

in my research i’m struggling with meta-rationality / rigidity, so this type of psychological research can help

Meta-flexibility

David Chapman 2019-10-02

Thank you very much—that does look interesting!

Identical apparatus do not yield identical results

Whirl 2019-10-03

My lab has multiple, ostensibly identical pieces of equipment. Constructed to the same specifications, wired using the same circuit diagrams, attached to instruments sold by reliable, well established vendors. Yet any reader with any lab experience at all will not be shocked to learn that only one of these experiment setups is considered to be ‘the good one’, the others have performance ranging from merely fine to outright bad. The differences between them are profound, yet extremely subtle and have stubbornly resisted debugging. It has taken months of careful, boring work to bring them into alignment.

Taken at face value, the results from experiments performed across all of the setups would be totally incoherent. We couldn’t possibly come to any conclusions about the phenomena were interrogating. But, since reliable results conform to a certain pattern, weird results from the bad apparatus are intuitively obvious and subject to greater scrutiny.

Such intuition is learned, of course, by regular re-calibration and benchmarking of our equipment, so that new members of the lab can form a picture of what correct operation looks like.

What it's like to do experimental science

David Chapman 2019-10-03

Thanks, this is great!

It prompted a series of twitter reflections on my part, starting here: https://twitter.com/Meaningness/status/1179765242651381761

Epistemic Cultures

Whirl 2019-10-04

That’s an interesting thread! I’m definitely going to pick up Karin Knorr Cetina’s book, as it looks extremely interesting. I had no idea, until finding your blog, that anyone seriously thought about or studied this stuff.