How the Extension Works and Came to Be
Creating the My Gospel Buddy extension all started with one question: “What is the most quoted scripture in General Conference Talks”. Asking this question led to the creation of a project titled Can a Prophet Inspire Change? This project required a data set of the text and footnotes of all General Conference talks. The initial collections process was slow as we manually copied the text and footnotes of all talks from 1970 to today.
However, the data for the My Gospel Buddy extension was collected in a slightly different way. To learn what this collection process entails, see the section below. So, if we know what scriptures are referenced in General Conference talks how can we make this information useful to the average person? What if users could see the number of times a scripture has been referenced in General Conference talks along with links to the specific talks? That is the question that finalized the idea for the My Gospel Buddy extension.
the My Gospel Buddy extension is meant to be of much more use than a simple report. The extension is intended to be a cross-reference tool between General Conference talks and the scriptures. Conference talks include many footnotes - both in the paragraphs and the reference tab - to create links to scriptures that are related to what the speaker has said. However, when users read scriptures there are no links to going the other way. the My Gospel Buddy extension is meant to bridge that gap. But the question remains, “How does it know what Conference talks to display?”
Through a process called web-scraping a script is run every 6 months that updates our footnote data. The code will search through publicly available General Conference talks on the Church’s website and identify any links to scriptures. The script will then extract the links and run a process to clean and organize the data. The result is a data set that contains each scripture listed as a footnote on every Conference Talk. Using this information we can bridge the gap between scriptures and General Conference.