OpenSource/telegram-crawler
OpenSource/telegram-crawler
1
0
Fork 0
mirror of https://github.com/MarshalX/telegram-crawler.git synced 2024-11-23 07:49:20 +01:00
Code Issues Projects Releases Packages Wiki Activity
539 commits 3 branches 0 tags 779 MiB
Commit graph

22 commits

Author SHA1 Message Date
Il'ya (Marshal)
998cd9832b enable periodically runs of workflows 2022-05-13 12:49:33 +02:00
Il'ya (Marshal)
c79a2f95d4 separate a workflow for 4 parallels jobs 2022-05-13 12:42:48 +02:00
Il'ya (Marshal)
9cab070822 reorganise structure of data folder; separate the "making files tree" workflow on 2 part (should be separated by 4 later) 2022-05-13 11:57:11 +02:00
Il'ya (Marshal)
b9fc0ea79f temp disable workflows 2022-05-13 11:27:26 +02:00
Il'ya (Marshal)
c6e13dc54d stel dev layer, headers, loop instead of rec; workflow timeout; aiohttp limit increase. 2022-05-11 11:10:08 +02:00
Il'ya (Marshal)
e3cada6e2a remote timeout for making files tree 2022-05-10 21:45:11 +02:00
Il'ya (Marshal)
e738f59aa9 fix env; set job timeout for crawler of links. 2022-05-10 20:32:58 +02:00
Il'ya (Marshal)
f3aae58a6a remove pycache attempt 2 2022-05-09 12:31:55 +02:00
Il'ya (Marshal)
fa14282533 update ios version; set timeout for workflow; delete pycache dir. 2022-05-09 12:26:51 +02:00
Il'ya (Marshal)
27e16f48dc add tracking of configs from mtproto 2022-04-24 13:33:25 +02:00
Il'ya (Marshal)
e217c3f5ec update readme 2022-04-10 15:28:51 +02:00
Il'ya (Marshal)
0afa3e61e6 run link crawler as often as possible; update readme; fix workflows 2021-04-26 22:27:57 +02:00
Il'ya (Marshal)
37b6aa2490 cleanup workflows 2021-04-25 18:00:32 +02:00
Il'ya (Marshal)
c933ba5932 move send alert from step to workflow 2021-04-25 17:06:05 +02:00
Il'ya (Marshal)
cf1d491005 add alerts to telegram channel 2021-04-25 16:35:16 +02:00
Il'ya (Marshal)
92f76232b5 add ability to rerun workflow with new tracked links 2021-04-24 22:46:43 +02:00
Il'ya (Marshal)
e45fa2c2c2 sub dynamic api hash from html 2021-04-24 15:01:53 +02:00
Il'ya (Marshal)
3bd6888cbd delete dynamic part of html 2021-04-24 14:39:21 +02:00
Il'ya (Marshal)
b04697d045 fix cron 2021-04-24 14:33:10 +02:00
Il'ya (Marshal)
8ca0e3e859 retrack urls every 5 min 2021-04-24 14:32:08 +02:00
Il'ya (Marshal)
0fefb193c3 enable workflow 2021-04-24 14:28:06 +02:00
Il'ya (Marshal)
6ceb897e33 move tracked links list to main branch; 
add generation of content tree;
add workflow for tree generation;
add new tg hidden link.
 2021-04-24 14:19:01 +02:00