Marginal revolution analysis
- Category: Script
- Project date: July, 2024
- Project URL (Code): I do not share the link to the project because I'm unaware of how copyright might apply when I retrieve information from a site.
Description
I felt that the inertia from the AI-boom after chatGPT was decreasing a bit, and in order to corroborate that hypothesis I took Marginal Revolution website written by Tyler Cowen as an indicator. By fetching all posts through all years, I estimated whether some keywords that refer to AI were written within the post. This way I could do simple statistics about the amount of AI related posts that were published on the site. This was all done via a python notebook, the whole contents were extracted into a pickle file.
This approach isn't perfectly precise, as for example, posts related that had used some AI related keywords or acronyms may not refer to AI topics (for example if the acronym is used to designate another concept). Also, on the "assorted links" posts I didn't make a distinction, so the overall weight of AI is somewhat overestimated. However, I believe this to be a good estimator for general trend of AI (more AI posts, AI is being more "boomey").
There is also an indicator of when ChatGPT was released as since then there was a media boom for AI topics and applications. As I stated above, I don't include a link to the project, since I don't know if there are copyright issues when retrieving data from a site, but anyone interested can contact with me.