Social media has been broadly applied in many applications in sales, marketing, event detection, etc. With high-volume and real-time data, social media has also been used for disaster responses. However, distinguishing between rumors and reliable information can be challenging, since social media, a user-generated content system, has a great number of users who update massive information every second. Furthermore, the rich information is not only included in the short text content but also

more »

... ded in the images, videos. In this paper, to address the emerging challenge of disaster response, we introduce a reliable framework for disaster information understanding and response with a practice on Twitter. The framework integrates both textual and imagery content from tweets in hope to fully utilize the information. The text classifier is built to remove noises, which can achieve 0.92 F1-score in classifying individual tweet. The image classifier is constructed by fine-tuning pre-trained VGG-F network, which can achieve 90\% accuracy. The image classifier serves as a verifier in the pipeline to reject or confirm the detected events. The evaluation indicates that the verifier can significantly reduce false positive events. We also explore Twitter-based drought management system and infrastructure monitoring system to further study the impacts of imagery content on event detection systems and we are able to pinpoint additional benefits which can be gained from social media imagery content.