Skip to content

Commit

Permalink
Merge pull request #331 from orukaz/master
Browse files Browse the repository at this point in the history
Add "worldping-api"
  • Loading branch information
JayBizzle authored Jun 4, 2019
2 parents 48522d4 + 756b7fb commit f951e8f
Show file tree
Hide file tree
Showing 4 changed files with 14 additions and 11 deletions.
2 changes: 1 addition & 1 deletion raw/Crawlers.json

Large diffs are not rendered by default.

19 changes: 10 additions & 9 deletions raw/Crawlers.txt
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
.*Java.*outbrain
YLT
^b0t$
^bluefish
^bluefish
^Calypso v\/
^COMODO DCV
^DangDang
^DavClnt
^FDM
^FDM
^git\/
^Goose\/
^Grabber
Expand Down Expand Up @@ -469,7 +469,7 @@ httpunit
HttpUrlConnection
httrack
huaweisymantec
HubSpot
HubSpot
Humanlinks
i2kconnect\/
Iblog
Expand Down Expand Up @@ -626,7 +626,7 @@ Metaspinner
MetaURI
MFC_Tear_Sample
Microsearch
Microsoft Office
Microsoft Office
Microsoft Outlook
Microsoft Windows Network Diagnostics
Microsoft-WebDAV-MiniRedir
Expand Down Expand Up @@ -810,7 +810,7 @@ ProWebWalker
proximic
PRTG Network Monitor
pshtt, https scanning
PTST
PTST
PTST\/[0-9]+
Pulsepoint XT3 web scraper
Pump
Expand Down Expand Up @@ -965,7 +965,7 @@ speedy
SPEng
Spinn3r
spray-can
Sprinklr
Sprinklr
spyonweb
sqlmap
Sqlworm
Expand Down Expand Up @@ -1132,7 +1132,7 @@ WebIndex
webkit2png
WebLeacher
webmastercoffee
webmon
webmon
WebPix
WebReaper
WebSauger
Expand Down Expand Up @@ -1173,6 +1173,7 @@ woorankreview
Word\/
WordPress\/
WordupinfoSearch
worldping-api
wotbox
WP Engine Install Performance API
wpif
Expand Down Expand Up @@ -1219,10 +1220,10 @@ Zemanta Aggregator
Zend_Http_Client
Zend\\Http\\Client
Zermelo
Zeus
Zeus
zgrab
ZnajdzFoto
Zombie\.js
Zoom\.Mac
ZyBorg
[a-z0-9\-_]*(bot|crawl|archiver|transcoder|spider|uptime|validator|fetcher|cron|checker|reader|extractor|monitoring|analyzer)
[a-z0-9\-_]*(bot|crawl|archiver|transcoder|spider|uptime|validator|fetcher|cron|checker|reader|extractor|monitoring|analyzer)
1 change: 1 addition & 0 deletions src/Fixtures/Crawlers.php
Original file line number Diff line number Diff line change
Expand Up @@ -1193,6 +1193,7 @@ class Crawlers extends AbstractProvider
'woorankreview',
'Word\/',
'WordPress\/',
'worldping-api',
'WordupinfoSearch',
'wotbox',
'WP Engine Install Performance API',
Expand Down
3 changes: 2 additions & 1 deletion tests/crawlers.txt
Original file line number Diff line number Diff line change
Expand Up @@ -3449,4 +3449,5 @@ AutomaticWPTester/1 CFNetwork/975.0.3 Darwin/17.7.0
CSSCheck/1.2.2
dBpoweramp
Thumbor/6.4.1
Reeder/1000.02.01 CFNetwork/454.11.5 Darwin/10.5.0 (i386) (Macmini2)
Reeder/1000.02.01 CFNetwork/454.11.5 Darwin/10.5.0 (i386) (Macmini2)
worldping-api

0 comments on commit f951e8f

Please # to comment.