糗事百科
@@ -59,18 +59,18 @@ Although it is selenium when logging in, for efficiency, we can maintain the coo
|
||||
|
||||
### Bilibili automatic login test is normal, the success rate is 98%
|
||||
|
||||

|
||||

|
||||
|
||||
### web Weichat
|
||||
|
||||
|
||||

|
||||

|
||||
|
||||
### 图虫spider
|
||||
|
||||

|
||||

|
||||
|
||||

|
||||

|
||||
|
||||
### TaoBaoweb
|
||||
- taobao.py为模拟登录
|
||||
@@ -78,7 +78,7 @@ Although it is selenium when logging in, for efficiency, we can maintain the coo
|
||||
|
||||
### Github
|
||||
|
||||

|
||||

|
||||
|
||||
```
|
||||
1. Climb the sub-labels of Taobao, rank the product information by sales, and save to MongoDB by category.
|
||||
@@ -125,4 +125,4 @@ Although it is selenium when logging in, for efficiency, we can maintain the coo
|
||||
|
||||
## Written at the end
|
||||
- I need your support.
|
||||
- And I think you can give me a 🌟``star``!
|
||||
- And I think you can give me a 🌟``star``!s
|
||||
@@ -39,16 +39,9 @@
|
||||
|
||||
****
|
||||
|
||||
# 🌟Website_login_mode
|
||||
# 💕Website login model
|
||||
🌟收集了一些各大网站登陆方式, 和一些网站的爬虫程序,有的是通过selenium登录,有的是通过抓包直接模拟登录,有的是利用scrapy,希望对小白有所帮助,本项目用于研究和分享各大网站的模拟登陆方式,和爬虫程序,会持续更新。。。
|
||||
|
||||
|
||||
## Have something to say❗️❗️(Important)
|
||||
- 今天有人给我说了一些东西,他说:”你今天开源这些东西会让别人容易的反爬虫“。对,我知道,当然我很清楚这些,但是人生总是需要一些挑战不是吗?兄弟?我认为当我攻破他们防守的时刻,才是最刺激的,不是吗?如果没人反抗,我做这些才是真的毫无意义,只有真正的攻与守,才能促使我们进步,时代在变兄弟,科技也在变,安于现状,才是错误的根本原因!我今年才21岁,我还有大把的时间,我会持续维护此网站,接受所有的挑战!当然我也需要一份稳定的工作!
|
||||
- 希望你们不要安于现状,生活处处是惊喜!
|
||||
|
||||
## 🎉Life is fantastic🥳! bro💪~
|
||||
|
||||
## About
|
||||
|
||||
模拟登陆基本采用的是直接登录或者使用selenium+webdriver的方式,有的网站直接登录难度很大,比如qq空间,bilibili等如果采用selenium就相对轻松一些。
|
||||
@@ -77,23 +70,28 @@
|
||||
- [x] [微信网页版登录并获取好友列表](https://wx.qq.com/)
|
||||
- [x] [Github](https://github.com/)
|
||||
- [x] [爬取图虫相应的图片](https://tuchong.com/)
|
||||
- [x] [网易云音乐](https://music.163.com/)
|
||||
- [x] [糗事百科](https://www.qiushibaike.com/)
|
||||
|
||||
## show
|
||||
|
||||
### Bilibili自动登录测试正常,成功率98%
|
||||
|
||||

|
||||

|
||||
|
||||

|
||||
|
||||
### web微信
|
||||
|
||||

|
||||
|
||||

|
||||

|
||||
|
||||
### 图虫爬虫
|
||||
### 图虫Spider
|
||||
|
||||

|
||||

|
||||
|
||||

|
||||

|
||||
|
||||
### 淘宝web
|
||||
- taobao.py为模拟登录
|
||||
@@ -101,11 +99,11 @@
|
||||
|
||||
### Github
|
||||
|
||||

|
||||

|
||||
|
||||
### 新增链家Spider
|
||||
|
||||

|
||||

|
||||
|
||||
```
|
||||
1. 爬取淘宝各子标签,按销量排名商品信息,按分类保存至MongoDB
|
||||
@@ -132,9 +130,15 @@
|
||||
- 知乎登录没有问题,不过要手动输入验证码
|
||||
|
||||
|
||||

|
||||

|
||||
|
||||
|
||||
### 糗事百科
|
||||
|
||||

|
||||
|
||||

|
||||
|
||||
## tips of pull request
|
||||
|
||||
- 欢迎大家一起来 pull request 💗
|
||||
@@ -154,14 +158,18 @@
|
||||
2. 如果你觉得某个网站的登录很有代表性,欢迎在 issue 中提出
|
||||
3. 如果网站的登录很有意思,我会在后面的更新中加入
|
||||
4. 网站的登录机制有可能经常的变动,所以当现在的模拟的登录的规则不能使用的时候,请在 issue 中提出
|
||||
- 如果关注量大的话,我还是会不断维护此仓库带来更多的东西,并且重构代码,
|
||||
5. 如果关注量大的话,我还是会不断维护此仓库带来更多的东西,并且重构代码,
|
||||
6. 欢迎向我提PR
|
||||
|
||||
## Acknowledgments
|
||||
### Thanks for all!
|
||||
|
||||

|
||||
- Thanks for all 🎉
|
||||
|
||||
### 再次感谢所有支持我的人---
|
||||
## Have something to say❗️❗️(Important)
|
||||
- 今天有人给我说了一些东西,他说:”你今天开源这些东西会让别人容易的反爬虫“。对,我知道,当然我很清楚这些,但是人生总是需要一些挑战不是吗?兄弟?我认为当我攻破他们防守的时刻,才是最刺激的,不是吗?如果没人反抗,我做这些才是真的毫无意义,只有真正的攻与守,才能促使我们进步,时代在变兄弟,科技也在变,安于现状,才是错误的根本原因!我今年才21岁,我还有大把的时间,我会持续维护此网站,接受所有的挑战!当然我也需要一份稳定的工作!
|
||||
- 希望你们不要安于现状,生活处处是惊喜!
|
||||
|
||||
## 🎉Life is fantastic🥳! bro💪~
|
||||
|
||||
## Written at the end
|
||||
- I need your support.
|
||||
|
||||
@@ -19,7 +19,7 @@ update_time:2019-3-7
|
||||
|
||||
class BiliBili():
|
||||
"""
|
||||
登陆B站, 处理极验验证码
|
||||
登陆B站, 处理验证码
|
||||
电脑的缩放比例需要为100%, 否则验证码图片的获取会出现问题
|
||||
"""
|
||||
|
||||
@@ -114,8 +114,8 @@ class BiliBili():
|
||||
:param y: 像素点的y坐标
|
||||
:return: 像素是否相同
|
||||
"""
|
||||
pixel1 = img1.load()[x, y]
|
||||
pixel2 = img2.load()[x, y]
|
||||
pixel1 = img1.load()[x-1, y]
|
||||
pixel2 = img2.load()[x-1, y]
|
||||
threshold = 100
|
||||
if abs(pixel1[0] - pixel2[0]) < threshold and abs(pixel1[1] - pixel2[1]) < threshold and abs(
|
||||
pixel1[2] - pixel2[2]) < threshold:
|
||||
|
||||
|
Before Width: | Height: | Size: 90 KiB |
|
Before Width: | Height: | Size: 208 KiB |
|
Before Width: | Height: | Size: 31 KiB |
|
Before Width: | Height: | Size: 324 KiB |
|
Before Width: | Height: | Size: 54 KiB |
|
Before Width: | Height: | Size: 21 KiB |
|
After Width: | Height: | Size: 676 KiB |
|
After Width: | Height: | Size: 143 KiB |
|
After Width: | Height: | Size: 44 KiB |
|
After Width: | Height: | Size: 2.4 MiB |
|
After Width: | Height: | Size: 1.6 MiB |
|
After Width: | Height: | Size: 9.2 KiB |
|
After Width: | Height: | Size: 514 KiB |
|
Before Width: | Height: | Size: 31 KiB After Width: | Height: | Size: 31 KiB |
|
After Width: | Height: | Size: 43 KiB |
|
After Width: | Height: | Size: 152 KiB |
|
Before Width: | Height: | Size: 7.8 KiB After Width: | Height: | Size: 7.8 KiB |
|
After Width: | Height: | Size: 22 KiB |
|
Before Width: | Height: | Size: 96 KiB After Width: | Height: | Size: 96 KiB |
|
After Width: | Height: | Size: 238 KiB |
|
After Width: | Height: | Size: 255 KiB |