Saturday, March 15, 2025

Deep Research Tools from OpenAI & Google

These tools can basically synthesize the information from 100s of websites into nice and tidy cited literature reviews. And that's great for many basic science & technology topics where there is enough information available out there on reputable online sources.

But the notion that this can replace a classic scientific literture review of meta-analysis is incorrect. First, these AIs do not have access to the actual scientific literature (which tends to sit behind paywalls). Second, there is a difference between a summary, a review, and a synthesis. Sure, a competent & trained amateur such as an AI can summarize, but reviewing & synthesizing requires a familiarity with the subject matter that can only be gained by years and years of deep immersion (aka. 10,000 hours...).

No comments:

Post a Comment