Twitterbot crawls web pages to generate Twitter Cards, fetching metadata like titles, descriptions, and images for link previews when URLs are shared on X (formerly Twitter).