OpenSource/telegram-crawler
OpenSource/telegram-crawler
1
0
Fork 0
mirror of https://github.com/MarshalX/telegram-crawler.git synced 2024-11-21 14:56:46 +01:00
Code Issues Projects Releases Packages Wiki Activity
43 commits 3 branches 0 tags 778 MiB
Commit graph

43 commits

This branch
This branch
All branches
Author SHA1 Message Date
Il'ya (Marshal)
98590aa3f2 add readme and license file 2021-04-24 17:34:55 +02:00
GitHub Action
9ce7311818 Update tracked links 2021-04-24 15:04:10 +00:00
GitHub Action
46bd741b3a Update tracked links 2021-04-24 14:48:26 +00:00
Il'ya (Marshal)
56ac82d615 sub passport ssid and nonce 2021-04-24 16:42:51 +02:00
GitHub Action
63bb6e51d3 Update tracked links 2021-04-24 13:16:57 +00:00
Il'ya (Marshal)
9125dbc22c fix regex for sub hash 2021-04-24 15:16:21 +02:00
GitHub Action
9fedcf25f5 Update tracked links 2021-04-24 13:16:06 +00:00
Il'ya (Marshal)
f510b8454d sub dynamic hash from html 2021-04-24 15:05:44 +02:00
Il'ya (Marshal)
e45fa2c2c2 sub dynamic api hash from html 2021-04-24 15:01:53 +02:00
GitHub Action
ac628bb231 Update tracked links 2021-04-24 12:43:36 +00:00
Il'ya (Marshal)
e927373229 disable crawling of bugs.telegram.org 2021-04-24 14:43:01 +02:00
Il'ya (Marshal)
3bd6888cbd delete dynamic part of html 2021-04-24 14:39:21 +02:00
GitHub Action
e5f7c10f58 Update tracked links 2021-04-24 12:38:47 +00:00
GitHub Action
14949d7466 Update tracked links 2021-04-24 12:33:39 +00:00
Il'ya (Marshal)
b04697d045 fix cron 2021-04-24 14:33:10 +02:00
Il'ya (Marshal)
8ca0e3e859 retrack urls every 5 min 2021-04-24 14:32:08 +02:00
Il'ya (Marshal)
0fefb193c3 enable workflow 2021-04-24 14:28:06 +02:00
GitHub Action
a2dd9bbfcd Update tracked links 2021-04-24 12:24:37 +00:00
Il'ya (Marshal)
6ceb897e33 move tracked links list to main branch; 
add generation of content tree;
add workflow for tree generation;
add new tg hidden link.
 2021-04-24 14:19:01 +02:00
Il'ya (Marshal)
5f29beda73 handle timeout and retry 2021-04-24 11:38:33 +02:00
Il'ya (Marshal)
cd5653605f rewrite logic of rules system (not its uses regex); 
fix trailing slash;
many attempt to send request;
 2021-04-24 11:29:19 +02:00
Il'ya (Marshal)
b2afbd72fc rework exclude system; add exclude by count of slashes; add translations.telegram.org 2021-04-24 00:06:50 +02:00
Il'ya (Marshal)
e385f45da6 print lead time 2021-04-23 22:49:21 +02:00
Il'ya (Marshal)
415a9e9b6c use macos for ci 2021-04-23 22:41:55 +02:00
Il'ya (Marshal)
246a0087e1 fix performance and memory issues 2021-04-23 22:38:54 +02:00
Il'ya (Marshal)
d449290dfb add ability to set hidden urls 2021-04-23 22:31:23 +02:00
Il'ya (Marshal)
fba0bd1d64 return api section of tg core 2021-04-23 22:05:00 +02:00
Il'ya (Marshal)
5c7857423e run link generator every hour 2021-04-23 22:02:47 +02:00
Il'ya (Marshal)
f383ee59f8 test there is no change 2021-04-23 21:55:13 +02:00
Il'ya (Marshal)
c118a32a2a test correct diff 2021-04-23 21:52:14 +02:00
Il'ya (Marshal)
abf3cf860e the end 2. 2021-04-23 21:49:19 +02:00
Il'ya (Marshal)
4a422db809 the end. 2021-04-23 21:47:15 +02:00
Il'ya (Marshal)
5ddd778e2e ;d 2021-04-23 21:33:11 +02:00
Il'ya (Marshal)
66e48534a7 git stash 2021-04-23 21:26:04 +02:00
Il'ya (Marshal)
ea3bfaf71f fix overwriting 2021-04-23 21:19:08 +02:00
Il'ya (Marshal)
ea18746c3c move fetch to one step upper 2021-04-23 21:12:27 +02:00
Il'ya (Marshal)
e4e0137767 uncomment script 2021-04-23 21:09:24 +02:00
Il'ya (Marshal)
83abd28a1f another way to track files 2021-04-23 21:05:55 +02:00
Il'ya (Marshal)
85b5e632c9 set user for git 2021-04-23 21:01:32 +02:00
Il'ya (Marshal)
381a6bdaf4 add git fetch 2021-04-23 20:59:36 +02:00
Il'ya (Marshal)
b053015289 fix set operation 2021-04-23 20:44:17 +02:00
Il'ya (Marshal)
e405720ce6 Add GitHub workflow 2021-04-23 20:39:08 +02:00
Il'ya (Marshal)
80934fecaa Initial commit 2021-04-23 20:34:42 +02:00