Magpie-crawler indexes web content and social media posts for Brandwatch's social media monitoring and consumer intelligence platform to analyze brand mentions.