国产探花免费观看_亚洲丰满少妇自慰呻吟_97日韩有码在线_资源在线日韩欧美_一区二区精品毛片,辰东完美世界有声小说,欢乐颂第一季,yy玄幻小说排行榜完本

首頁 > 編程 > Python > 正文

python爬取足球直播吧五大聯(lián)賽積分榜

2020-02-15 21:48:36
字體:
供稿:網(wǎng)友

本文實(shí)例為大家分享了python爬取足球聯(lián)賽積分榜的具體代碼,供大家參考,具體內(nèi)容如下

使用BeautifulSoup4解析爬取足球直播吧五大聯(lián)賽積分榜信息;

#! /usr/bin/python3 # -*- coding:utf-8 -*- from urllib.request import urlopen from urllib.request import quote from bs4 import BeautifulSoup import time import re import json import pymysql  url="https://data.zhibo8.cc/pc_main_data/#/dejia/index1" response = urlopen(url) bs = BeautifulSoup(response,"html.parser")  # print(bs) liansai_s = bs.select("ul.data_nav > li")  # print(liansai_lists)  # <li ng-class="{current:current==0}" ng-click="selcuptype(0,'NBA')"> #  <a data-index="nba" href="#/team_nba/nba" rel="external nofollow" name="NBA"> #    <div class="data_item" ng-class="{current2:current==0}">NBA</div> #    <div class="data_item_logo"><img src="images/nba.png"/></div> #  </a> # </li>  liansai_lists = [] for liansai in liansai_s:   # print(liansai)   ls = []   href = liansai.select("a")[0].get("href")   # print(href)   lsName = liansai.select("a > div.data_item")[0].text   ls.append(href)   ls.append(lsName)   liansai_lists.append(ls)  # print(liansai_lists)  #{ # '排名': '1', # 'teamId': '565', # '球隊(duì)': '巴塞羅那', # '場(chǎng)次': '29', # '勝': '23', # '平': '6', # '負(fù)': '0', # '進(jìn)/失球': '74/13', # '凈勝球': '61', # '積分': '75', # '球隊(duì)圖標(biāo)': 'http://duihui.qiumibao.com/zuqiu/basailuona.png', # '字體顏色': '#e62e2e', # '夜間字體顏色': '#af2d2d', # '背景顏色': '#ffffff', # '球隊(duì)名稱': '巴塞羅那' # },  location = '' def insert_into_db(lists):   #將數(shù)據(jù)寫入到數(shù)據(jù)庫中   con = pymysql.connect(host="localhost", user="root", password="root", database="zhi_bo_ba", charset='utf8', port=3306)   # 游標(biāo)。 作用 就等同于 JDBC 中的 Statement   cursor = con.cursor()   for record in lists:     print(record)     sql_insert = "insert into jifenbang (liansai, paiming, qiudui, changci, sheng,ping,fu,jinqiu_shiqu,jingsheng,jifen) values (%s, %s, %s, %s, %s, %s, %s, %s, %s, %s)"     cursor.execute(sql_insert, record)    con.commit()   cursor.close()   con.close()   def jifenbang(str):   # print(str)   datas = urlopen(str)   #加載json類型的數(shù)據(jù)   datas = json.load(datas)   jifen_list = []   for info in datas['data']:     j_f = []     j_f.append(location)     j_f.append(info['排名'])     j_f.append(info['球隊(duì)'])     j_f.append(info['場(chǎng)次'])     j_f.append(info['勝'])     j_f.append(info['平'])     j_f.append(info['負(fù)'])     j_f.append(info['進(jìn)/失球'])     j_f.append(info['凈勝球'])     j_f.append(info['積分'])     jifen_list.append(j_f)   print(jifen_list)   insert_into_db(jifen_list)    # https://dc.qiumibao.com/shuju/public/index.php?_url=/data/index&league=聯(lián)賽&tab=%積分榜&year=[year] # https://dc.qiumibao.com/shuju/public/index.php?_url=/data/index&league=聯(lián)賽&tab=球員榜&type=射手榜&year=[year] urls="https://dc.qiumibao.com/shuju/public/index.php?_url=/data/index&league=" list = ['西甲','英超','意甲','德甲','法甲','中超','中甲'] for aa in liansai_lists:    if aa[1] in list:     location = aa[1]     new_url = '%s%s&tab=%s&year=[year]' % (urls,quote(aa[1]),quote('積分榜'))     jifenbang(new_url)             
發(fā)表評(píng)論 共有條評(píng)論
用戶名: 密碼:
驗(yàn)證碼: 匿名發(fā)表
主站蜘蛛池模板: 缙云县| 礼泉县| 阿拉善右旗| 清水河县| 廊坊市| 武威市| 安化县| 咸阳市| 榆树市| 繁昌县| 大宁县| 和平区| 萝北县| 新津县| 呼玛县| 崇阳县| 巴林左旗| 宣化县| 内江市| 镇赉县| 泸西县| 裕民县| 峨眉山市| 农安县| 喀喇沁旗| 张家口市| 浦北县| 古蔺县| 西峡县| 西昌市| 桃江县| 普兰店市| 三穗县| 文水县| 许昌市| 临泽县| 晋州市| 阿坝县| 龙海市| 龙海市| 深泽县|