Commit graph

69 commits

Author SHA1 Message Date
Alexander Zavorotynskiy
2c0880a161 feat(backend): add user's timestamp to ender logic, removed some messages from db batches 2022-06-24 10:10:35 +02:00
Alexander Zavorotynskiy
caf66b305a fix(backend): fixed bug when ender triggered on sessionEnd message 2022-06-21 16:19:22 +02:00
Alexander
623e241afb
feat(backend): moved recording sessionStart to db into http service and sessionEnd into ender service (#545)
Co-authored-by: Alexander Zavorotynskiy <alexander@openreplay.com>
2022-06-20 09:26:05 +02:00
Alexander Zavorotynskiy
a153547575 feat(backend/db): send metadata directly to db (removed from batches) 2022-06-17 09:34:58 +02:00
Alexander Zavorotynskiy
d837c14be4 feat(backend): start using analytics topic for heuristics and trigger topic only for sessionEnd between sink and storage 2022-06-16 14:00:50 +02:00
Alexander Zavorotynskiy
5ea482d4c2 feat(backend/http): removed second unnecessary request body read 2022-06-15 15:50:55 +02:00
Alexander
3c6bd9613c
feat(backend): control batch size and number of sql requests in db service to more accurate management data inserts (#540)
Co-authored-by: Alexander Zavorotynskiy <alexander@openreplay.com>
2022-06-15 12:57:09 +02:00
Alexander
6b5d9d3799
feat(backend): added new trigger which sink should send to storage after session end received (#539)
Co-authored-by: Alexander Zavorotynskiy <alexander@openreplay.com>
2022-06-15 11:45:52 +02:00
Alexander
883a6f6909
Improved ender (#537)
* feat(backend/ender): using producer timestamp for session end detection

* feat(backend/ender): added timeControl module

Co-authored-by: Alexander Zavorotynskiy <alexander@openreplay.com>
2022-06-15 10:49:32 +02:00
Alexander Zavorotynskiy
2dccb2142b fix(backend/assets): return back cache checks in s3 2022-06-08 15:05:02 +02:00
Alexander Zavorotynskiy
404f6204e1 fix(backend/assets): copy ts and index in assets convert method 2022-06-08 14:44:16 +02:00
Alexander Zavorotynskiy
c4081ce78a feat(backend/assets): disabled cache checks 2022-06-08 12:38:38 +02:00
Alexander Zavorotynskiy
9292d315c4 feat(backend/ender): removed debug log 2022-06-07 13:48:10 +02:00
Alexander Zavorotynskiy
4f8c4358f8 fix(backend/storage): fixed panic in storage service 2022-06-07 13:30:48 +02:00
Alexander Zavorotynskiy
78cf538b6b feat(backend): added metrics to storage and sink services 2022-06-07 10:12:42 +02:00
Alexander Zavorotynskiy
a6db2cb602 feat(backend): added metrics to http service 2022-06-06 16:46:14 +02:00
Alexander Zavorotynskiy
c963b74cbf feat(backend): cleaned up in internal dir 2022-06-06 14:13:24 +02:00
Alexander Zavorotynskiy
d358747caf fix(backend): several fixes in backend services 2022-06-03 16:01:14 +02:00
Alexander Zavorotynskiy
d68ac74731 feat(backend/http): added OPTIONS method for all paths 2022-06-03 11:13:56 +02:00
Alexander Zavorotynskiy
d4e5fce12a feat(backend/http): added prefix hack 2022-06-03 10:52:12 +02:00
Alex Kaminskii
7395688831 fix(backend/http): check if order of declaring gets influence 2022-06-02 19:04:48 +02:00
Alexander Zavorotynskiy
1a8c076b41 fix(backend/http): added prefligt headers to root 2022-06-02 17:39:38 +02:00
Alexander Zavorotynskiy
2cadf12f88 feat(backend/storage): added counter and last session timestamp for storage service 2022-06-02 10:13:18 +02:00
Alexander Zavorotynskiy
3a4d5f6796 feat(backend/sink): added additional log on producer write operation 2022-05-31 14:43:56 +02:00
Alexander Zavorotynskiy
6e92ba2e79 feat(backend/ender): added additional log for ender service 2022-05-31 10:40:44 +02:00
Alexander Zavorotynskiy
df18e7dd7d feat(backend/storage): additional log and memory improvements in storage service 2022-05-31 10:02:31 +02:00
Alexander Zavorotynskiy
d871558390 fix(backend/storage): fixed bug with large session files 2022-05-30 16:59:41 +02:00
Alexander Zavorotynskiy
24fdb5e18c fix(backend/http): fixed bug with aws health checks 2022-05-30 16:39:05 +02:00
Alexander Zavorotynskiy
0fe1b0c3a8 fix(backend/storage): fixed panic in storage service 2022-05-27 10:22:19 +02:00
Alexander Zavorotynskiy
a32ac65f35 feat(backend): additional logs in messageHandler 2022-05-24 16:27:35 +02:00
Alexander Zavorotynskiy
c941cb872a feat(backend/messages): added timestamp for SessionStart and moved RawErrorEvent to db datasaver 2022-05-24 10:33:16 +02:00
Alexander Zavorotynskiy
d685ad4cb3 feat(backend/ender): implemented metrics module and added to ender service 2022-05-23 17:48:24 +02:00
Alexander Zavorotynskiy
d29416fd48 fix(backend): fixed bug with group name in heuristics service 2022-05-23 17:42:28 +02:00
Alexander Zavorotynskiy
8d0d05c2cf fix(backend/heuristics): fixed panic in performanceAggr message encoding 2022-05-18 13:28:00 +02:00
Alex Kaminskii
76d9d41ed8 refactor(backend/storage): pass FileSplitSize as env var 2022-05-16 15:31:37 +02:00
Alexander Zavorotynskiy
3511534cbb feat(backend/integrations): service refactoring 2022-05-16 14:41:12 +02:00
Alexander Zavorotynskiy
3449440de3 feat(backend/assets): service refactoring 2022-05-16 14:12:37 +02:00
Alexander Zavorotynskiy
24f64af95a feat(backend/storage): service refactoring 2022-05-16 12:52:43 +02:00
Alexander Zavorotynskiy
44dae11886 feat(backend/db): fixed ee version 2022-05-13 17:00:09 +02:00
Alexander
4ac3da241e
Merge branch 'dev' into ender_refactoring 2022-05-12 17:16:45 +02:00
Alex K
4f1a686787
Merge pull request #453 from openreplay/sink_refactor
Sink refactor

* structure -> go standarts
* move URLrewrite to sink (free http from encoding-decoding)
2022-05-12 15:03:32 +02:00
Alex Kaminskii
88bec7ab60 refactor(): separate ieBuilder, peBuilder & networkIssueDeterctor from EventMapper 2022-05-11 21:27:18 +02:00
Alex Kaminskii
6d2bfc0e77 fix(backend/internals): builder codefix 2022-05-11 21:25:41 +02:00
Alex Kaminskii
85b87e17df refactor(backend/internals): builder: message order & timestamps check 2022-05-11 21:14:23 +02:00
Alex Kaminskii
a6f8857b89 refactor-fix(backend-heuristics/db): create handlers for each session separately 2022-05-11 19:04:14 +02:00
Alex Kaminskii
e65fa58ab5 refactor(backend-internal): dry builder 2022-05-11 18:51:55 +02:00
Alex Kaminskii
396f1a16af refactor(backend-sink): producer close timeout value to config 2022-05-11 17:36:35 +02:00
Alexander Zavorotynskiy
c77966a789 feat(backend/handlers): removed unix timestamp from header builders 2022-05-11 16:45:31 +02:00
Alex Kaminskii
6456520587 style(backend-http): use UnixMilli 2022-05-11 16:36:31 +02:00
Alex Kaminskii
a241830e71 refactor(backend-sink/http): move URLrewriter to sink 2022-05-11 16:32:27 +02:00