Unlocking Insights: How to Extract Topics from Survey Data using Embeddings and Large Language Models
Embarking on a new job journey has allowed me to delve deeper into my passion projects, one of them being a survey analysis tool. This tool has proven to be invaluable for extracting actionable insights from voluminous survey responses.
With the success of this tool within my company, I’ve put together a comprehensive guide to help you build a similar tool and revolutionize your data analysis process.
Utilizing a dataframe with survey responses as input (leveraging pandas), we focus on the key columns containing user comments. While additional fields like department and job title can be analyzed, simplicity is key for the initial version of the tool.
The survey data used in this project was collected online and is kept confidential. For the sake of this article, we’ll visualize the analysis based on a smaller dataset…