1. Use scrapy The crawler crawls the information of the website ( Find the website yourself )
2. Store the crawled information in mysql Database table , And the output csv file
3. Use Django Present crawling information , And display in pages _
4. Use spark Analyze the crawled data , Statistical rules are defined by themselves .
5. Use echarts or pyecharts The histogram of 、 Pie chart 、 Clouds of words 、 Charts such as line charts present the results of the analysis .
