OpenSource/telegram-crawler
OpenSource/telegram-crawler
1
0
Fork 0
mirror of https://github.com/MarshalX/telegram-crawler.git synced 2025-03-15 13:22:43 +01:00
Code Issues Projects Releases Packages Wiki Activity

disable crawling of bugs.telegram.org

Browse source
This commit is contained in:
Il'ya (Marshal) 2021-04-24 14:43:01 +02:00
parent 3bd6888cbd
commit e927373229
1 changed files with 2 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
make_tracked_links_list.py
View file

@ -42,7 +42,8 @@ CRAWL_RULES = {
},
'bugs.telegram.org': { # crawl first page of cards sorted by rating
'deny': {
r'/c/[0-9]+/[0-9]+', # disable comments
# r'/c/[0-9]+/[0-9]+', # disable comments
'',
},
},
'instantview.telegram.org': {