OpenSource/telegram-crawler
OpenSource/telegram-crawler
1
0
Fork 0
mirror of https://github.com/MarshalX/telegram-crawler.git synced 2024-11-23 07:49:20 +01:00
Code Issues Projects Releases Packages Wiki Activity
1206 commits 3 branches 0 tags 779 MiB
Commit graph

67 commits

Author SHA1 Message Date
Ilya (Marshal)
1f8a2678ba
control concurrent requests; a little optimization; upgrade python and deps 2024-06-02 16:06:24 +02:00
Ilya (Marshal)
c0646b8023
use ubuntu for all web crawls 2024-06-02 14:23:36 +02:00
Ilya (Marshal)
af8fb4e80b
Revert "try self-hosted runner for static IP" 
This reverts commit 0d92386e5b.
 2024-06-02 14:22:41 +02:00
Ilya (Marshal)
0d92386e5b
try self-hosted runner for static IP 2024-06-02 14:10:02 +02:00
Ilya (Marshal)
3726d67b54
welcome to web 13.37; add tracking of wallet mini app 2023-09-15 11:57:25 +02:00
Ilya (Marshal)
379f979ebe Revert "disable scheduled workflow" 
This reverts commit f0b336ea41.
 2022-11-03 19:32:50 +01:00
Ilya (Marshal)
f0b336ea41 disable scheduled workflow 2022-11-02 09:32:05 +01:00
Il'ya
0b97d0fae1
change OS of macOS runner from 10 to 12 (2) 2022-07-28 01:17:48 +02:00
Il'ya
0b06dcd4ad
change OS of macOS runner from 10 to 12 2022-07-28 01:13:22 +02:00
Il'ya (Marshal)
35c5ca8773 separate web and translations to web_tr 2022-06-18 17:36:39 +02:00
Il'ya (Marshal)
f0ce4fe1dc add dispatching of workflows 2022-06-09 14:02:22 +02:00
Il'ya (Marshal)
3d081cea99 move web mode to macOS 2022-06-09 14:00:27 +02:00
Il'ya (Marshal)
52870ffc6c Revert "migrate db link generation from macOS to Linux" 
This reverts commit d3eb583071.
 2022-06-09 13:56:58 +02:00
Il'ya (Marshal)
d3eb583071 migrate db link generation from macOS to Linux 2022-06-09 13:30:39 +02:00
Il'ya (Marshal)
138018442f migrate OS independent jobs from macOS to linux runners 2022-06-09 13:24:04 +02:00
Il'ya (Marshal)
998cd9832b enable periodically runs of workflows 2022-05-13 12:49:33 +02:00
Il'ya (Marshal)
c79a2f95d4 separate a workflow for 4 parallels jobs 2022-05-13 12:42:48 +02:00
Il'ya (Marshal)
9cab070822 reorganise structure of data folder; separate the "making files tree" workflow on 2 part (should be separated by 4 later) 2022-05-13 11:57:11 +02:00
Il'ya (Marshal)
b9fc0ea79f temp disable workflows 2022-05-13 11:27:26 +02:00
Il'ya (Marshal)
c6e13dc54d stel dev layer, headers, loop instead of rec; workflow timeout; aiohttp limit increase. 2022-05-11 11:10:08 +02:00
Il'ya (Marshal)
e3cada6e2a remote timeout for making files tree 2022-05-10 21:45:11 +02:00
Il'ya (Marshal)
e738f59aa9 fix env; set job timeout for crawler of links. 2022-05-10 20:32:58 +02:00
Il'ya (Marshal)
f3aae58a6a remove pycache attempt 2 2022-05-09 12:31:55 +02:00
Il'ya (Marshal)
fa14282533 update ios version; set timeout for workflow; delete pycache dir. 2022-05-09 12:26:51 +02:00
Il'ya (Marshal)
27e16f48dc add tracking of configs from mtproto 2022-04-24 13:33:25 +02:00
Il'ya (Marshal)
e217c3f5ec update readme 2022-04-10 15:28:51 +02:00
Il'ya (Marshal)
1961b658a8 add comparing output to github ci logs 2021-06-27 23:06:29 +02:00
Il'ya (Marshal)
12a5d4dff9 fix workflow trigger 2 2021-05-01 15:16:58 +02:00
Il'ya (Marshal)
4a69b5f141 fix workflow trigger 2021-05-01 15:14:59 +02:00
Il'ya (Marshal)
af69ce04f1 disable notifications for libbase update 2021-04-26 22:41:28 +02:00
Il'ya (Marshal)
0afa3e61e6 run link crawler as often as possible; update readme; fix workflows 2021-04-26 22:27:57 +02:00
Il'ya (Marshal)
fab866946c fix if condition in workflow 3.0 or mb 4.0 2021-04-25 18:55:12 +02:00
Il'ya (Marshal)
7c2c3d2520 fix if condition in workflow 3.0 2021-04-25 18:51:46 +02:00
Il'ya (Marshal)
e904ca0da6 fix if condition in workflow 2.0 2021-04-25 18:41:37 +02:00
Il'ya (Marshal)
f98f2c090b fix if condition in workflow 2021-04-25 18:36:22 +02:00
Il'ya (Marshal)
294826fcda echo github context 2021-04-25 18:08:37 +02:00
Il'ya (Marshal)
37b6aa2490 cleanup workflows 2021-04-25 18:00:32 +02:00
Il'ya (Marshal)
00e47d80ce action does not trigger another on push action (https://github.community/t/push-from-action-even-with-pat-does-not-trigger-action/17622/5) 2021-04-25 17:36:33 +02:00
Il'ya (Marshal)
ef27bc5ece action does not trigger another on push action (https://github.community/t/action-does-not-trigger-another-on-push-tag-action/17148) 2021-04-25 17:27:29 +02:00
Il'ya (Marshal)
ecdb04c23e fix syntax of workflow 2 2021-04-25 17:14:54 +02:00
Il'ya (Marshal)
b527c2df79 fix syntax of workflow 2021-04-25 17:07:54 +02:00
Il'ya (Marshal)
c933ba5932 move send alert from step to workflow 2021-04-25 17:06:05 +02:00
Il'ya (Marshal)
cf1d491005 add alerts to telegram channel 2021-04-25 16:35:16 +02:00
Il'ya (Marshal)
ae43e9e442 cleanup readme file; disable tests of link crawler. 2021-04-25 14:13:52 +02:00
Il'ya (Marshal)
2dffddeaae fix resending of requests; 
fix timeout settings;
fix handling of invalid urls;
edit schedule of generation list to test.
 2021-04-25 08:18:06 +02:00
Il'ya (Marshal)
45be20d715 return list generation every 1h 2021-04-24 23:41:54 +02:00
Il'ya (Marshal)
9a4a6e55ac temporary remove /apps page with easter egg from Telegram (random order web clients); update links list as often as possible for tests 2021-04-24 23:06:56 +02:00
Il'ya (Marshal)
92f76232b5 add ability to rerun workflow with new tracked links 2021-04-24 22:46:43 +02:00
Il'ya (Marshal)
e45fa2c2c2 sub dynamic api hash from html 2021-04-24 15:01:53 +02:00
Il'ya (Marshal)
3bd6888cbd delete dynamic part of html 2021-04-24 14:39:21 +02:00