Commit graph

26 commits

Author SHA1 Message Date
Vincent Cloutier
1daec5577d tweak logging 2023-03-19 11:04:03 -04:00
Vincent Cloutier
12273abdd1 magic numbers update & some cleanups 2023-03-03 10:37:42 -05:00
Vincent Cloutier
edec988e05 update some magic numbers 2023-01-27 13:55:19 -05:00
Vincent Cloutier
714e66e284 added parameter for twitter request parallelism 2023-01-20 12:53:30 -05:00
Vincent Cloutier
4a7373ec07 removed max users 2023-01-20 11:13:00 -05:00
Vincent Cloutier
d1018881ec now fetching twitter feed in parallel 2023-01-10 20:30:07 -05:00
Vincent Cloutier
55b8244d13 magic numbers update 2023-01-05 15:02:24 -05:00
Vincent Cloutier
43fb42727e bigger user batch 2023-01-01 15:55:05 -05:00
Vincent Cloutier
3e5b01a923 remove dead code 2023-01-01 15:18:54 -05:00
Vincent Cloutier
97d40b21fb switched to vanilla npgsql for more queries 4 2023-01-01 11:58:36 -05:00
Vincent Cloutier
d6cf46f0c6 removed unneccesary delay 2 2022-12-28 11:05:03 -05:00
Vincent Cloutier
7f772ca125 Various optimisations 2022-12-27 12:15:10 -05:00
Vincent Cloutier
999e0c2ba2 fixed tests 2022-12-26 14:14:25 -05:00
Vincent Cloutier
94f8d40256 more tweaks 2022-12-26 11:48:13 -05:00
Vincent Cloutier
29d8091997 further pipeline changes 2022-12-26 10:47:26 -05:00
Vincent Cloutier
e7438057d1 reduced batch size 2022-12-25 14:41:28 -05:00
Nicolas Constant
5121f6c7c2
disabling extra awaiter on user retrieval 2021-09-10 01:21:40 -04:00
Nicolas Constant
66e1e84da2
added waiting time to fit 100.000 rate limit 2021-09-05 01:03:01 -04:00
Nicolas Constant
34cb33160a
refactoring warm up logic and tests 2021-01-22 23:38:35 -05:00
Nicolas Constant
3e7a136902
added test coverage and warmup strategy 2021-01-22 23:07:25 -05:00
Nicolas Constant
89c041f332
added limit to user retrieval 2021-01-22 21:23:27 -05:00
Nicolas Constant
7e3d7b7c4f
dispatch users batch progressively, fix #55 2021-01-19 02:37:24 -05:00
Nicolas Constant
3af2ef05d9
added better logging 2021-01-16 00:34:09 -05:00
Nicolas Constant
532b87f719
clean up 2021-01-15 02:00:10 -05:00
Nicolas Constant
01337a63ec
dont feed pipeline if no elements 2020-11-18 22:49:44 -05:00
Nicolas Constant
c7e1a4e5e1
added tests 2020-10-10 18:35:23 -04:00
Renamed from src/BirdsiteLive.Pipeline/Processors/RetrieveTwitterAccountsProcessor.cs (Browse further)