OpenSource/telegram-crawler
OpenSource/telegram-crawler
1
0
Fork 0
mirror of https://github.com/MarshalX/telegram-crawler.git synced 2024-11-23 07:49:20 +01:00
Code Issues Projects Releases Packages Wiki Activity
1207 commits 3 branches 0 tags 779 MiB
Commit graph

32 commits

Author SHA1 Message Date
Ilya (Marshal)
bee93276f0
return back web to macOS 2024-06-02 22:13:27 +02:00
Ilya (Marshal)
c0646b8023
use ubuntu for all web crawls 2024-06-02 14:23:36 +02:00
Ilya (Marshal)
af8fb4e80b
Revert "try self-hosted runner for static IP" 
This reverts commit 0d92386e5b.
 2024-06-02 14:22:41 +02:00
Ilya (Marshal)
0d92386e5b
try self-hosted runner for static IP 2024-06-02 14:10:02 +02:00
Ilya (Marshal)
3726d67b54
welcome to web 13.37; add tracking of wallet mini app 2023-09-15 11:57:25 +02:00
Il'ya
0b06dcd4ad
change OS of macOS runner from 10 to 12 2022-07-28 01:13:22 +02:00
Il'ya (Marshal)
35c5ca8773 separate web and translations to web_tr 2022-06-18 17:36:39 +02:00
Il'ya (Marshal)
f0ce4fe1dc add dispatching of workflows 2022-06-09 14:02:22 +02:00
Il'ya (Marshal)
3d081cea99 move web mode to macOS 2022-06-09 14:00:27 +02:00
Il'ya (Marshal)
138018442f migrate OS independent jobs from macOS to linux runners 2022-06-09 13:24:04 +02:00
Il'ya (Marshal)
998cd9832b enable periodically runs of workflows 2022-05-13 12:49:33 +02:00
Il'ya (Marshal)
c79a2f95d4 separate a workflow for 4 parallels jobs 2022-05-13 12:42:48 +02:00
Il'ya (Marshal)
9cab070822 reorganise structure of data folder; separate the "making files tree" workflow on 2 part (should be separated by 4 later) 2022-05-13 11:57:11 +02:00
Il'ya (Marshal)
b9fc0ea79f temp disable workflows 2022-05-13 11:27:26 +02:00
Il'ya (Marshal)
c6e13dc54d stel dev layer, headers, loop instead of rec; workflow timeout; aiohttp limit increase. 2022-05-11 11:10:08 +02:00
Il'ya (Marshal)
e3cada6e2a remote timeout for making files tree 2022-05-10 21:45:11 +02:00
Il'ya (Marshal)
e738f59aa9 fix env; set job timeout for crawler of links. 2022-05-10 20:32:58 +02:00
Il'ya (Marshal)
f3aae58a6a remove pycache attempt 2 2022-05-09 12:31:55 +02:00
Il'ya (Marshal)
fa14282533 update ios version; set timeout for workflow; delete pycache dir. 2022-05-09 12:26:51 +02:00
Il'ya (Marshal)
27e16f48dc add tracking of configs from mtproto 2022-04-24 13:33:25 +02:00
Il'ya (Marshal)
e217c3f5ec update readme 2022-04-10 15:28:51 +02:00
Il'ya (Marshal)
0afa3e61e6 run link crawler as often as possible; update readme; fix workflows 2021-04-26 22:27:57 +02:00
Il'ya (Marshal)
37b6aa2490 cleanup workflows 2021-04-25 18:00:32 +02:00
Il'ya (Marshal)
c933ba5932 move send alert from step to workflow 2021-04-25 17:06:05 +02:00
Il'ya (Marshal)
cf1d491005 add alerts to telegram channel 2021-04-25 16:35:16 +02:00
Il'ya (Marshal)
92f76232b5 add ability to rerun workflow with new tracked links 2021-04-24 22:46:43 +02:00
Il'ya (Marshal)
e45fa2c2c2 sub dynamic api hash from html 2021-04-24 15:01:53 +02:00
Il'ya (Marshal)
3bd6888cbd delete dynamic part of html 2021-04-24 14:39:21 +02:00
Il'ya (Marshal)
b04697d045 fix cron 2021-04-24 14:33:10 +02:00
Il'ya (Marshal)
8ca0e3e859 retrack urls every 5 min 2021-04-24 14:32:08 +02:00
Il'ya (Marshal)
0fefb193c3 enable workflow 2021-04-24 14:28:06 +02:00
Il'ya (Marshal)
6ceb897e33 move tracked links list to main branch; 
add generation of content tree;
add workflow for tree generation;
add new tg hidden link.
 2021-04-24 14:19:01 +02:00