We web-scraped 450000+ comments from New York Times, applied a LDA model to analyze their topic distribution, and manually marked these topics. We then derived a Random Decision Tree Forest of 100 regression trees, with more than 1100 nodes in each tree, in order to infer audience engagement (indicated by comment length) from topic distribution for each comment. The visualization of the tree helped us determine the importance of each topic in terms of how it affects audience's attention.
Use this login method if you
don't
have an
@illinois.edu
email address.
(Oops, I do have one)
IDEALS migrated to a new platform on June 23, 2022. If you created
your account prior to this date, you will have to reset your password
using the forgot-password link below.