diff --git a/.DS_Store b/.DS_Store index ffaa6ab..6e20b50 100644 Binary files a/.DS_Store and b/.DS_Store differ diff --git a/README-en-us.md b/README-en-us.md index 6b2dbd4..ff80c62 100644 --- a/README-en-us.md +++ b/README-en-us.md @@ -59,18 +59,18 @@ Although it is selenium when logging in, for efficiency, we can maintain the coo ### Bilibili automatic login test is normal, the success rate is 98% -![](./image/bilibili.jpg) +![](./images/bilibili.jpg) ### web Weichat -![Alt text](./image/weixin.jpg) +![Alt text](./images/weixin.jpg) ### 图虫spider -![](./image/Jietu20190306-232224.jpg) +![](./images/Jietu20190306-232224.jpg) -![](./image/Jietu20190306-232303.jpg) +![](./images/Jietu20190306-232303.jpg) ### TaoBaoweb - taobao.py为模拟登录 @@ -78,7 +78,7 @@ Although it is selenium when logging in, for efficiency, we can maintain the coo ### Github -![](./image/github.jpg) +![](./images/github.jpg) ``` 1. Climb the sub-labels of Taobao, rank the product information by sales, and save to MongoDB by category. @@ -125,4 +125,4 @@ Although it is selenium when logging in, for efficiency, we can maintain the coo ## Written at the end - I need your support. -- And I think you can give me a 🌟``star``! \ No newline at end of file +- And I think you can give me a 🌟``star``!s \ No newline at end of file diff --git a/README.md b/README.md index 83d1c43..a2da90c 100644 --- a/README.md +++ b/README.md @@ -39,16 +39,9 @@ **** -# 🌟Website_login_mode +# 💕Website login model 🌟收集了一些各大网站登陆方式， 和一些网站的爬虫程序，有的是通过selenium登录，有的是通过抓包直接模拟登录，有的是利用scrapy,希望对小白有所帮助,本项目用于研究和分享各大网站的模拟登陆方式，和爬虫程序，会持续更新。。。 - -## Have something to say❗️❗️(Important) -- 今天有人给我说了一些东西，他说：”你今天开源这些东西会让别人容易的反爬虫“。对，我知道，当然我很清楚这些，但是人生总是需要一些挑战不是吗？兄弟？我认为当我攻破他们防守的时刻，才是最刺激的，不是吗？如果没人反抗，我做这些才是真的毫无意义，只有真正的攻与守，才能促使我们进步，时代在变兄弟，科技也在变，安于现状，才是错误的根本原因！我今年才21岁，我还有大把的时间，我会持续维护此网站，接受所有的挑战！当然我也需要一份稳定的工作！ -- 希望你们不要安于现状，生活处处是惊喜！ - -## 🎉Life is fantastic🥳! bro💪~ - ## About 模拟登陆基本采用的是直接登录或者使用selenium+webdriver的方式，有的网站直接登录难度很大，比如qq空间，bilibili等如果采用selenium就相对轻松一些。 @@ -77,23 +70,28 @@ - [x] [微信网页版登录并获取好友列表](https://wx.qq.com/) - [x] [Github](https://github.com/) - [x] [爬取图虫相应的图片](https://tuchong.com/) +- [x] [网易云音乐](https://music.163.com/) +- [x] [糗事百科](https://www.qiushibaike.com/) ## show ### Bilibili自动登录测试正常，成功率98% -![](./image/bilibili.jpg) +![](./images/bilibili.gif) + +![](./images/bilibili.jpg) ### web微信 +![](./images/weixin.gif) -![Alt text](./image/weixin.jpg) +![Alt text](./images/weixin.jpg) -### 图虫爬虫 +### 图虫Spider -![](./image/Jietu20190306-232224.jpg) +![](./images/tuchong.gif) -![](./image/Jietu20190306-232303.jpg) +![](./images/tuchong.jpg) ### 淘宝web - taobao.py为模拟登录 @@ -101,11 +99,11 @@ ### Github -![](./image/github.jpg) +![](./images/github.jpg) ### 新增链家Spider -![](./image/lianjia.jpg) +![](./images/lianjia.gif) ``` 1. 爬取淘宝各子标签，按销量排名商品信息，按分类保存至MongoDB @@ -132,9 +130,15 @@ - 知乎登录没有问题，不过要手动输入验证码 -![](./image/zhihulogin.jpg) +![](./images/zhihulogin.jpg) +### 糗事百科 + +![](./images/qiushibaike.gif) + +![](./images/qiushibaike.jpg) + ## tips of pull request - 欢迎大家一起来 pull request 💗 @@ -154,14 +158,18 @@ 2. 如果你觉得某个网站的登录很有代表性，欢迎在 issue 中提出 3. 如果网站的登录很有意思，我会在后面的更新中加入 4. 网站的登录机制有可能经常的变动，所以当现在的模拟的登录的规则不能使用的时候，请在 issue 中提出 -- 如果关注量大的话，我还是会不断维护此仓库带来更多的东西，并且重构代码， +5. 如果关注量大的话，我还是会不断维护此仓库带来更多的东西，并且重构代码， +6. 欢迎向我提PR ## Acknowledgments -### Thanks for all! -![](./image/yanjing.png) +- Thanks for all 🎉 -### 再次感谢所有支持我的人--- +## Have something to say❗️❗️(Important) +- 今天有人给我说了一些东西，他说：”你今天开源这些东西会让别人容易的反爬虫“。对，我知道，当然我很清楚这些，但是人生总是需要一些挑战不是吗？兄弟？我认为当我攻破他们防守的时刻，才是最刺激的，不是吗？如果没人反抗，我做这些才是真的毫无意义，只有真正的攻与守，才能促使我们进步，时代在变兄弟，科技也在变，安于现状，才是错误的根本原因！我今年才21岁，我还有大把的时间，我会持续维护此网站，接受所有的挑战！当然我也需要一份稳定的工作！ +- 希望你们不要安于现状，生活处处是惊喜！ + +## 🎉Life is fantastic🥳! bro💪~ ## Written at the end - I need your support. diff --git a/bilibili/bilibili.py b/bilibili/bilibili.py index dc20836..73e60cd 100644 --- a/bilibili/bilibili.py +++ b/bilibili/bilibili.py @@ -19,7 +19,7 @@ update_time:2019-3-7 class BiliBili(): """ - 登陆B站, 处理极验验证码 + 登陆B站, 处理验证码 电脑的缩放比例需要为100%, 否则验证码图片的获取会出现问题 """ @@ -114,8 +114,8 @@ class BiliBili(): :param y: 像素点的y坐标 :return: 像素是否相同 """ - pixel1 = img1.load()[x, y] - pixel2 = img2.load()[x, y] + pixel1 = img1.load()[x-1, y] + pixel2 = img2.load()[x-1, y] threshold = 100 if abs(pixel1[0] - pixel2[0]) < threshold and abs(pixel1[1] - pixel2[1]) < threshold and abs( pixel1[2] - pixel2[2]) < threshold: diff --git a/image/.DS_Store b/image/.DS_Store deleted file mode 100644 index f81301a..0000000 Binary files a/image/.DS_Store and /dev/null differ diff --git a/image/Jietu20190306-232224.jpg b/image/Jietu20190306-232224.jpg deleted file mode 100644 index 7a2c40e..0000000 Binary files a/image/Jietu20190306-232224.jpg and /dev/null differ diff --git a/image/bilibili.jpg b/image/bilibili.jpg deleted file mode 100644 index 9f26a91..0000000 Binary files a/image/bilibili.jpg and /dev/null differ diff --git a/image/github.jpg b/image/github.jpg deleted file mode 100644 index 0d784e9..0000000 Binary files a/image/github.jpg and /dev/null differ diff --git a/image/lianjia.jpg b/image/lianjia.jpg deleted file mode 100644 index 21f41bc..0000000 Binary files a/image/lianjia.jpg and /dev/null differ diff --git a/image/weixin.jpg b/image/weixin.jpg deleted file mode 100644 index 838c354..0000000 Binary files a/image/weixin.jpg and /dev/null differ diff --git a/image/zhihu.jpg b/image/zhihu.jpg deleted file mode 100644 index a524310..0000000 Binary files a/image/zhihu.jpg and /dev/null differ diff --git a/images/bilibili.gif b/images/bilibili.gif new file mode 100644 index 0000000..2f4e5b6 Binary files /dev/null and b/images/bilibili.gif differ diff --git a/images/bilibili.jpg b/images/bilibili.jpg new file mode 100644 index 0000000..8315a80 Binary files /dev/null and b/images/bilibili.jpg differ diff --git a/images/github.jpg b/images/github.jpg new file mode 100644 index 0000000..b7d499f Binary files /dev/null and b/images/github.jpg differ diff --git a/images/lianjia.gif b/images/lianjia.gif new file mode 100644 index 0000000..2a51e37 Binary files /dev/null and b/images/lianjia.gif differ diff --git a/images/qiushibaike.gif b/images/qiushibaike.gif new file mode 100644 index 0000000..30fcebc Binary files /dev/null and b/images/qiushibaike.gif differ diff --git a/images/qiushibaike.jpg b/images/qiushibaike.jpg new file mode 100644 index 0000000..33d3ec0 Binary files /dev/null and b/images/qiushibaike.jpg differ diff --git a/images/tuchong.gif b/images/tuchong.gif new file mode 100644 index 0000000..a066ad5 Binary files /dev/null and b/images/tuchong.gif differ diff --git a/image/Jietu20190306-232303.jpg b/images/tuchong.jpg similarity index 100% rename from image/Jietu20190306-232303.jpg rename to images/tuchong.jpg diff --git a/images/weixin.gif b/images/weixin.gif new file mode 100644 index 0000000..9a12f22 Binary files /dev/null and b/images/weixin.gif differ diff --git a/images/weixin.jpg b/images/weixin.jpg new file mode 100644 index 0000000..6ac6792 Binary files /dev/null and b/images/weixin.jpg differ diff --git a/image/yanjing.png b/images/yanjing.png similarity index 100% rename from image/yanjing.png rename to images/yanjing.png diff --git a/images/zhihu.jpg b/images/zhihu.jpg new file mode 100644 index 0000000..eb6e48d Binary files /dev/null and b/images/zhihu.jpg differ diff --git a/image/zhihulogin.jpg b/images/zhihulogin.jpg similarity index 100% rename from image/zhihulogin.jpg rename to images/zhihulogin.jpg diff --git a/qiushibaike b/qiushibaike new file mode 160000 index 0000000..b148a54 --- /dev/null +++ b/qiushibaike @@ -0,0 +1 @@ +Subproject commit b148a54720258155553e3bd92b722a65b1380e00 diff --git a/tuchong/6471469e24f22995890ae70e413c5309.jpg b/tuchong/6471469e24f22995890ae70e413c5309.jpg new file mode 100644 index 0000000..161bd45 Binary files /dev/null and b/tuchong/6471469e24f22995890ae70e413c5309.jpg differ diff --git a/tuchong/87ec742182e138c1c9f6794077e7ef3f.jpg b/tuchong/87ec742182e138c1c9f6794077e7ef3f.jpg new file mode 100644 index 0000000..c75e8b7 Binary files /dev/null and b/tuchong/87ec742182e138c1c9f6794077e7ef3f.jpg differ