国产成人精品久久免费动漫-国产成人精品天堂-国产成人精品区在线观看-国产成人精品日本-a级毛片无码免费真人-a级毛片毛片免费观看久潮喷

您的位置:首頁技術文章
文章詳情頁

python - 多線程中mysql插入出錯

瀏覽:104日期:2022-06-28 16:07:14

問題描述

在寫爬蟲中,我要把爬取到的數據存到數據庫中.每一個頁面里邊有很多條目,比如一個人的訪客可能有很多個,于是插入卸載循環中,

try: sql_visitor=’INSERT INTO visitor (ownername,owneruid,visitorname,visitoruid,visittime) VALUE ('%s',%d,'%s',%d,'%s')’%(ownername,owneruid,visitorname,visitoruid,visitortime) print sql_visitor self.cursor.execute(sql_visitor) self.connect.commit()except Exception as e: print e

一個頁面一個線程,嫌棄慢的我開了5個

max_threads=5while uid < 8000000 or threadlist: for thread1 in threadlist:if not thread1.is_alive(): threadlist.remove(thread1) while len(threadlist) < max_threads and uid < 8000000:uid+=1thread2=threading.Thread(target=run,args=(uid,))thread2.setDaemon(True)thread2.start()threadlist.append(thread2) time.sleep(5)

運行很順利:

INSERT INTO visitor (ownername,owneruid,visitorname,visitoruid,visittime) VALUE ('huosai7',4893,'Liang2017',7252799,'2017-5-22 21:06')INSERT INTO personalinfo (ownername,owneruid,jifen,huajiao,xiaomijiao,jinbi,haoyou,zhuti,rizhi,xiangce,fenxiang,kongjianfangwenliang,youxiangyanzheng,shipinrenzheng,juzhudi,chushengdi,shangcifabiaoshijian,shangcihuodongshijian,zuihoufangwen,zhuceshijian,zaixianshijian,shengri,xingbie) VALUE('huosai7',4893,0,0,0,0,0,0,0,0,0,0,0,0,'','','2100-01-01 12:00','2100-01-01 12:00','2100-01-01 12:00','2004-1-3 19:28',0,'2100-01-01 12:00',0)INSERT INTO visitor (ownername,owneruid,visitorname,visitoruid,visittime) VALUE ('龍樂',4894,'Liang2017',7252799,'2017-5-22 21:06')(1062, 'Duplicate entry ’4894-7252799-2017-05-22 21:06:00’ for key ’PRIMARY’')INSERT INTO personalinfo (ownername,owneruid,jifen,huajiao,xiaomijiao,jinbi,haoyou,zhuti,rizhi,xiangce,fenxiang,kongjianfangwenliang,youxiangyanzheng,shipinrenzheng,juzhudi,chushengdi,shangcifabiaoshijian,shangcihuodongshijian,zuihoufangwen,zhuceshijian,zaixianshijian,shengri,xingbie) VALUE('龍樂',4894,0,0,0,0,0,0,0,0,0,0,0,0,'','','2100-01-01 12:00','2100-01-01 12:00','2100-01-01 12:00','2004-1-3 20:21',0,'2100-01-01 12:00',0).......

于是我將max_thread設置成10,于是結果如下:

INSERT INTO visitor (ownername,owneruid,visitorname,visitoruid,visittime) VALUE ('xiao61',4889,'Liang2017',7252799,'2017-5-22 21:06')

(2006, ’MySQL server has gone away’)

INSERT INTO personalinfo (ownername,owneruid,jifen,huajiao,xiaomijiao,jinbi,haoyou,zhuti,rizhi,xiangce,fenxiang,kongjianfangwenliang,youxiangyanzheng,shipinrenzheng,juzhudi,chushengdi,shangcifabiaoshijian,shangcihuodongshijian,zuihoufangwen,zhuceshijian,zaixianshijian,shengri,xingbie) VALUE('xiao61',4889,0,0,0,0,0,0,0,0,0,0,0,0,'','','2100-01-01 12:00','2100-01-01 12:00','2100-01-01 12:00','2004-1-3 15:56',0,'2100-01-01 12:00',0)

(2006, ’MySQL server has gone away’)

INSERT INTO visitor (ownername,owneruid,visitorname,visitoruid,visittime) VALUE ('糊涂酷酷熊',4897,'Liang2017',7252799,'2017-5-22 21:06')

(2006, ’MySQL server has gone away’)

INSERT INTO personalinfo (ownername,owneruid,jifen,huajiao,xiaomijiao,jinbi,haoyou,zhuti,rizhi,xiangce,fenxiang,kongjianfangwenliang,youxiangyanzheng,shipinrenzheng,juzhudi,chushengdi,shangcifabiaoshijian,shangcihuodongshijian,zuihoufangwen,zhuceshijian,zaixianshijian,shengri,xingbie) VALUE('糊涂酷酷熊',4897,611,0,1655,0,0,2,0,0,0,34,0,0,'','','2007-3-27 00:37','2007-3-27 00:37','2007-3-27 00:37','2004-1-3 21:08',0,'2100-01-01 12:00',1)

(2006, ’MySQL server has gone away’).......

可以看出2006出來了,然后我將max_thread設置成30,然后結果如下:

python - 多線程中mysql插入出錯

就將,夠詳細嗎?不夠詳細還需要什么只管說!

問題解答

回答1:

看這里,我猜你是用的是pymysql,它的線程安全描述為1,對應的pep249里面做了詳細的描述:

Threads may share the module, but not connections.

線程可以共享模塊但不能共享連接。這也就是說你可能得在每個線程中創建一個連接。

吶~為什么不用orm來做呢?

標簽: Python 編程
相關文章:
主站蜘蛛池模板: 无圣光福利视频 | 亚洲精品视频观看 | 日韩欧美一区二区三区不卡在线 | 成人伊人青草久久综合网 | 欧美一级毛片在线 | 国产成人久久一区二区三区 | 亚洲高清成人欧美动作片 | 亚洲成人黄色在线 | 成年人www| 性感美女视频黄.免费网站 性高湖久久久久久久久 | 亚洲精品视频免费观看 | 男人的天堂久久精品激情 | 久久精品国产精品亚洲艾 | 日韩在线高清 | 久久99精品久久久久久秒播 | 久久精品久久精品国产大片 | 国产亚洲精品久久麻豆 | 久久久国产99久久国产久 | 99九九成人免费视频精品 | 久久3 | 91精品国产91久久久久青草 | 午夜手机福利 | 欧美一区二区三区日韩免费播 | 91看片淫黄大片.在线天堂 | 国产不卡一区二区三区免费视 | 热热涩热热狠狠色香蕉综合 | 国产精品免费看 | 日韩在线观看视频网站 | 99久99久6久热在线播放 | 成人高清在线观看播放 | 网站在线看| 欧美性欲视频 | 成人免费午间影院在线观看 | 欧美一级特黄aa大片在线观看免费 | 最近韩国日本免费免费版 | 日韩毛片免费在线观看 | 一级做a爰片久久毛片 | 国产一级a毛片高清 | 天天se天天cao综合网蜜芽 | 富二代精品视频 | a在线观看欧美在线观看 |