OpenSource/telegram-crawler
OpenSource/telegram-crawler
1
0
Fork 0
mirror of https://github.com/MarshalX/telegram-crawler.git synced 2024-11-22 07:19:34 +01:00
Code Issues Projects Releases Packages Wiki Activity

fix set operation

Browse source
This commit is contained in:
Il'ya (Marshal) 2021-04-23 20:44:17 +02:00
parent e405720ce6
commit b053015289
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
make_tracked_links_list.py
View file

@ -157,7 +157,7 @@ async def main(url: str):
absolute_links = cleanup_links(find_absolute_links(html))
relative_links = cleanup_links(find_relative_links(html, url))
sub_links = absolute_links + relative_links
sub_links = absolute_links | relative_links
for link in sub_links:
await asyncio.create_task(main(link))
elif 'application/javascript' in content_type: