Commit graph

38 commits

Author SHA1 Message Date
Vincent Cloutier
62caf7e956 don't send full backlog of tweets on first sync 2023-03-19 11:35:30 -04:00
Vincent Cloutier
71dfe4b019 tweak checkpointing of twitter fetches 2 2023-03-17 22:02:34 -04:00
Vincent Cloutier
66e2ba9b06 tweak checkpointing of twitter fetches 2023-03-17 19:45:51 -04:00
Vincent Cloutier
3a47655671 made SaveProgression a SubTask 2023-02-22 11:30:02 -05:00
Vincent Cloutier
e9f3631985 various simplifications 2023-02-03 10:24:50 -05:00
Vincent Cloutier
bd46afa350 fix crash 2023-01-20 14:17:32 -05:00
Vincent Cloutier
714e66e284 added parameter for twitter request parallelism 2023-01-20 12:53:30 -05:00
Vincent Cloutier
48d521b757 removed unused nbrTweets 2023-01-20 09:28:32 -05:00
Vincent Cloutier
08f5aef7fc tweak twitter queries parallelism 2 2023-01-15 12:53:04 -05:00
Vincent Cloutier
014dee23a3 tweak twitter queries parallelism 2023-01-15 09:24:30 -05:00
Vincent Cloutier
9026273f45 made tweet fetching concurrent instead 2023-01-10 21:00:21 -05:00
Vincent Cloutier
d1018881ec now fetching twitter feed in parallel 2023-01-10 20:30:07 -05:00
Vincent Cloutier
97d40b21fb switched to vanilla npgsql for more queries 4 2023-01-01 11:58:36 -05:00
Vincent Cloutier
8551763f77 small changes all over the place 2023-01-01 11:27:00 -05:00
Vincent Cloutier
f2c0d55916 version updates 2023-01-01 11:09:40 -05:00
Vincent Cloutier
b1b8b676b9 changed some magic 2022-12-29 13:02:38 -05:00
Vincent Cloutier
f8c3b5cac7 added twitter user tests 2022-12-28 14:49:49 -05:00
Vincent Cloutier
5fafb1f568 delay tweaking 2022-12-28 13:32:08 -05:00
Vincent Cloutier
7f772ca125 Various optimisations 2022-12-27 12:15:10 -05:00
Vincent Cloutier
dfdcb77924 some rollbacks 2022-12-26 15:19:46 -05:00
Vincent Cloutier
5e0cb44c8e more logging 2022-12-26 15:05:46 -05:00
Vincent Cloutier
94f8d40256 more tweaks 2022-12-26 11:48:13 -05:00
Vincent Cloutier
e21381bee8 made twitter service more async 2022-12-26 11:13:00 -05:00
Vincent Cloutier
e7438057d1 reduced batch size 2022-12-25 14:41:28 -05:00
Vincent Cloutier
2290c2a121 some rate limiting 2022-12-18 16:12:16 -05:00
Vincent Cloutier
fca3193074 more logging 2022-05-07 18:35:35 -04:00
Nicolas Constant
b28532b5bd
removal of old user analysis 2021-09-05 14:00:18 -04:00
Nicolas Constant
71f6d3f3f4
added pipeline processor to analyse user state 2021-09-05 13:58:33 -04:00
Nicolas Constant
5f480b4baa
don't retrieve TL if user is protected 2021-02-10 01:35:29 -05:00
Nicolas Constant
2e8313301b
better DI 2021-02-02 22:49:37 -05:00
Nicolas Constant
ec420346b6
purge cache when TL retrieval fails, fix #79 2021-02-01 20:07:53 -05:00
Nicolas Constant
c048786b96
fix account sync update issue 2021-01-23 18:20:13 -05:00
Nicolas Constant
89c041f332
added limit to user retrieval 2021-01-22 21:23:27 -05:00
Nicolas Constant
639ad3ae14
user twitter service to retrieve timelines 2021-01-18 02:07:09 -05:00
Nicolas Constant
c7e1a4e5e1
added tests 2020-10-10 18:35:23 -04:00
Nicolas Constant
fffc9af534
extract only needed info from tweets 2020-07-22 20:19:40 -04:00
Nicolas Constant
d91ddd4204
starting pipeline implementation 2020-07-18 23:35:19 -04:00
Nicolas Constant
d13f60ec3c
init pipeline 2020-07-16 01:19:41 -04:00