I don't think those experiences are at all comparable. I'm a compulsive scanner, I can usually impress people by my ability to quickly scan pages of text without really processing any of it while finding a specific word or phrase. Infinite scrolling is nothing like that experience for me. For one thing it is impossible to involve peripheral vision with any type of web page scrolling and peripheral vision is absolutely essential to that type of scanning. And moving your eyes to scan something that is fixed vs. keeping your eyes still to scan something moving are also vastly different experiences in my opinion, not really at all alike.
Sure, this is a anecdote based argument levied against the hypothesis. Its a fairly weak way to make final decisions though. Again the point was that there was intuitive reason to believe this concept may be fruitful, the problem was we devised too large of an experiment and spent too much time to get to a point to validate the core hypothesis.
To be perfectly honest opinions like yours provide guidance of what to focus on but in general this type of intuition usually turns out to only capture part of the dynamics when something is actually used by millions of people, and in many cases intuition turns out to be the polar opposite of the reality the data tells you.