So true, and the writing rings clear as a bell. I am reminded of Malcolm Gladwell's ideas on how statistical randomness, or basically, luck, will sometimes skew the odds in our favor (or out of it).
> “In other words, we can easily deceive ourselves into thinking we understand why something rose to the top, even though in reality chaotic happenstance played a large role.”
Ah yes, the oneiric effect. Certainly does help with crafting an analogous understanding of how some LLMs work.
I’ll be interested to see how you address the primacy effect and how it connects to recall testing for long-context LLMs in your next post.
So true, and the writing rings clear as a bell. I am reminded of Malcolm Gladwell's ideas on how statistical randomness, or basically, luck, will sometimes skew the odds in our favor (or out of it).
> “In other words, we can easily deceive ourselves into thinking we understand why something rose to the top, even though in reality chaotic happenstance played a large role.”
Ah yes, the oneiric effect. Certainly does help with crafting an analogous understanding of how some LLMs work.
I’ll be interested to see how you address the primacy effect and how it connects to recall testing for long-context LLMs in your next post.