Commit graph

51 commits

Author SHA1 Message Date
95eda4a842 finished off spider search 2025-06-17 20:38:12 -04:00
0cf0b315df initial symbols done, not liking the outcome, gonna switch to queue based approach 2025-06-16 22:59:39 -04:00
174346ea2f got symbols and exchanges working with sessions 2025-06-16 22:19:56 -04:00
f05d26d703 starting to add qm sessions and symbols 2025-06-16 22:07:40 -04:00
660a2a1ec2 initial masterExchanges 2025-06-15 12:26:38 -04:00
98d5f43eb8 fixed batcher for proxy 2025-06-15 09:08:28 -04:00
e8c90532d5 thing im pretty much done with extracting the queue and making it reususable, maybe just a few more change to be able to making the batch names a bit more specific 2025-06-14 18:22:28 -04:00
e5170b1c78 switching to generic queue lib 2025-06-14 15:28:51 -04:00
d686a72591 work on ib and cleanup 2025-06-14 09:17:48 -04:00
a20a11c1aa work on postgress / will prob remove and work on ib exchanges and symbols 2025-06-13 19:59:35 -04:00
09c97df1a8 refactor of data-service 2025-06-13 13:38:02 -04:00
6fb98c69f2 fixed batching and waiting priority plus cleanup 2025-06-13 13:38:02 -04:00
e4d5dba73a testing 2025-06-13 13:38:02 -04:00
8b5e06954a linting 2025-06-13 13:38:02 -04:00
597c6efc9b eslint 2025-06-13 13:38:02 -04:00
d85cd58acd running prettier for cleanup 2025-06-13 13:38:02 -04:00
fe7733aeb5 working on queue 2025-06-13 13:38:02 -04:00
58c5ba1200 fixed up delay time 2025-06-13 13:38:02 -04:00
7f592fe628 simplifid queue service 2025-06-13 13:38:02 -04:00
eca0396293 simplified providers a bit 2025-06-13 13:38:02 -04:00
26eaaa6d61 moved proxy redis init to app start 2025-06-13 13:38:02 -04:00
716c90060a still trying 2025-06-13 13:38:02 -04:00
682b50d3b2 trying to get simpler batcher working 2025-06-13 13:38:02 -04:00
4883daa3e2 added routes and simplified batch processor 2025-06-13 13:38:02 -04:00
9825e99540 fixes 2025-06-10 15:07:37 -04:00
32d0eaac2d trying to fix startup 2025-06-10 14:48:46 -04:00
00b21a57d7 test 2025-06-10 14:12:24 -04:00
a86367bec5 switched proxy and batch to new redis 2025-06-10 13:52:06 -04:00
ee57b66391 added redis connections script 2025-06-10 12:56:22 -04:00
f52e3332df made a mess 2025-06-10 12:34:12 -04:00
34fa4b8e26 test 2025-06-10 09:07:12 -04:00
35df03d00b added id to source 2025-06-09 23:25:21 -04:00
0b7846fe67 linxus fs fixes 2025-06-09 22:55:51 -04:00
ac23b70146 fixing stuff 2025-06-09 22:00:41 -04:00
c66889889e removed drain 2025-06-09 19:08:28 -04:00
b896d3f698 changed some stuff 2025-06-09 18:12:41 -04:00
8a588816c4 fixed error and made batch timings a little more dynamic depending on batch total instead of 15 min spread 2025-06-09 09:07:44 -04:00
b2817656b3 finished proxy-provider - need to test 2025-06-09 08:07:45 -04:00
8b6f6008e4 working 2025-06-09 00:01:16 -04:00
22992cd393 added batching mess 2025-06-08 23:30:46 -04:00
2aaeba2f6c updated loggers to getLogger 2025-06-08 19:52:11 -04:00
1ccdbddb71 added initial jobs for proxies, will prob have to be optimized 2025-06-08 19:32:53 -04:00
9b8a7bdd4b work on queue 2025-06-08 18:56:52 -04:00
bf2fa003b9 moved proxy.service to proxy.tasks 2025-06-08 17:29:10 -04:00
52c2f08db2 moved jobs to provider config 2025-06-08 15:03:30 -04:00
f9c2860ff4 initial setup, its a mess 2025-06-08 14:49:52 -04:00
f68e620c76 initial data-service started 2025-06-08 13:46:03 -04:00
c10a524aa8 removed deprecated createLogger and replaced with getLogger 2025-06-08 12:31:29 -04:00
d0bb4db042 fixed up logger error to make it better to handle in code 2025-06-07 11:58:24 -04:00
d0e8fd9e3f added cache and started fixing data-service 2025-06-05 08:27:06 -04:00