OpenSource/telegram-crawler
OpenSource/telegram-crawler
1
0
Fork 0
mirror of https://github.com/MarshalX/telegram-crawler.git synced 2024-10-23 17:47:21 +02:00
Code Issues Projects Releases Packages Wiki Activity
1369 commits 3 branches 0 tags 742 MiB
Commit graph

1369 commits

This branch
This branch
All branches
Author SHA1 Message Date
Il'ya (Marshal)
2dffddeaae fix resending of requests; 
fix timeout settings;
fix handling of invalid urls;
edit schedule of generation list to test.
 2021-04-25 08:18:06 +02:00
GitHub Action
eb723304ce Update tracked links 2021-04-25 06:09:14 +00:00
GitHub Action
8a3cafb025 Update tracked links 2021-04-25 05:13:23 +00:00
GitHub Action
a82ac8730c Update tracked links 2021-04-25 04:11:06 +00:00
GitHub Action
e15ee8a3d8 Update tracked links 2021-04-25 03:15:59 +00:00
GitHub Action
e65cf582a0 Update tracked links 2021-04-25 01:29:36 +00:00
GitHub Action
c81a574f7b Update tracked links 2021-04-25 00:17:10 +00:00
GitHub Action
3d01970606 Update tracked links 2021-04-24 22:03:29 +00:00
GitHub Action
6f3ec5334b Update tracked links 2021-04-24 21:47:27 +00:00
Il'ya (Marshal)
45be20d715 return list generation every 1h 2021-04-24 23:41:54 +02:00
GitHub Action
189506f77e Update tracked links 2021-04-24 21:39:41 +00:00
GitHub Action
693c7a2787 Update tracked links 2021-04-24 21:07:34 +00:00
Il'ya (Marshal)
9a4a6e55ac temporary remove /apps page with easter egg from Telegram (random order web clients); update links list as often as possible for tests 2021-04-24 23:06:56 +02:00
Il'ya (Marshal)
92f76232b5 add ability to rerun workflow with new tracked links 2021-04-24 22:46:43 +02:00
GitHub Action
8570df37ee Update tracked links 2021-04-24 20:41:12 +00:00
Il'ya (Marshal)
dcd5adc08a fix, improve and cleanup links crawler; add diff or files 2021-04-24 22:40:39 +02:00
GitHub Action
b944e999cb Update tracked links 2021-04-24 20:09:05 +00:00
GitHub Action
6d5efa7ee4 Update tracked links 2021-04-24 17:21:24 +00:00
GitHub Action
80b427f437 Update tracked links 2021-04-24 16:11:13 +00:00
GitHub Action
786a1ae14c Update tracked links 2021-04-24 15:57:27 +00:00
GitHub Action
cb9f0613e0 Update tracked links 2021-04-24 15:53:30 +00:00
Il'ya (Marshal)
b4986f06e9 add screenshot 2021-04-24 17:51:52 +02:00
GitHub Action
139c8c3ca0 Update tracked links 2021-04-24 15:51:09 +00:00
Il'ya (Marshal)
0477f5f3a3 add link to stored websites data 2021-04-24 17:47:57 +02:00
Il'ya (Marshal)
6735842149 add status desc 2021-04-24 17:45:33 +02:00
Il'ya (Marshal)
3279341ed3 extend readme 2021-04-24 17:44:14 +02:00
Il'ya (Marshal)
98590aa3f2 add readme and license file 2021-04-24 17:34:55 +02:00
GitHub Action
9ce7311818 Update tracked links 2021-04-24 15:04:10 +00:00
GitHub Action
46bd741b3a Update tracked links 2021-04-24 14:48:26 +00:00
Il'ya (Marshal)
56ac82d615 sub passport ssid and nonce 2021-04-24 16:42:51 +02:00
GitHub Action
63bb6e51d3 Update tracked links 2021-04-24 13:16:57 +00:00
Il'ya (Marshal)
9125dbc22c fix regex for sub hash 2021-04-24 15:16:21 +02:00
GitHub Action
9fedcf25f5 Update tracked links 2021-04-24 13:16:06 +00:00
Il'ya (Marshal)
f510b8454d sub dynamic hash from html 2021-04-24 15:05:44 +02:00
Il'ya (Marshal)
e45fa2c2c2 sub dynamic api hash from html 2021-04-24 15:01:53 +02:00
GitHub Action
ac628bb231 Update tracked links 2021-04-24 12:43:36 +00:00
Il'ya (Marshal)
e927373229 disable crawling of bugs.telegram.org 2021-04-24 14:43:01 +02:00
Il'ya (Marshal)
3bd6888cbd delete dynamic part of html 2021-04-24 14:39:21 +02:00
GitHub Action
e5f7c10f58 Update tracked links 2021-04-24 12:38:47 +00:00
GitHub Action
14949d7466 Update tracked links 2021-04-24 12:33:39 +00:00
Il'ya (Marshal)
b04697d045 fix cron 2021-04-24 14:33:10 +02:00
Il'ya (Marshal)
8ca0e3e859 retrack urls every 5 min 2021-04-24 14:32:08 +02:00
Il'ya (Marshal)
0fefb193c3 enable workflow 2021-04-24 14:28:06 +02:00
GitHub Action
a2dd9bbfcd Update tracked links 2021-04-24 12:24:37 +00:00
Il'ya (Marshal)
6ceb897e33 move tracked links list to main branch; 
add generation of content tree;
add workflow for tree generation;
add new tg hidden link.
 2021-04-24 14:19:01 +02:00
Il'ya (Marshal)
5f29beda73 handle timeout and retry 2021-04-24 11:38:33 +02:00
Il'ya (Marshal)
cd5653605f rewrite logic of rules system (not its uses regex); 
fix trailing slash;
many attempt to send request;
 2021-04-24 11:29:19 +02:00
Il'ya (Marshal)
b2afbd72fc rework exclude system; add exclude by count of slashes; add translations.telegram.org 2021-04-24 00:06:50 +02:00
Il'ya (Marshal)
e385f45da6 print lead time 2021-04-23 22:49:21 +02:00
Il'ya (Marshal)
415a9e9b6c use macos for ci 2021-04-23 22:41:55 +02:00