Commit graph

256 commits

Author SHA1 Message Date
Alexander Zavorotynskiy
9ff555cc64 feat(backend): set seek pointer at the end of batch for avoiding memory leaks 2022-09-19 10:59:00 +02:00
Alexander Zavorotynskiy
71d0696862 feat(backend): updated aws sdk lib version 2022-09-15 13:33:10 +02:00
Alexander Zavorotynskiy
3b045fa864 feat(backend): call sessions table optimise method only in one db service 2022-09-13 15:48:23 +02:00
sylenien
f360d8416d feat(tracker): add zustand support 2022-09-09 11:55:31 +02:00
Alexander Zavorotynskiy
0eed5b58d4 feat(backend): extra checks to avoid nil cast panic 2022-09-08 16:21:41 +02:00
Alexander Zavorotynskiy
bef74d5284 feat(backend): skip corrupted batch 2022-09-06 14:35:16 +02:00
Alexander Zavorotynskiy
348a323a41 feat(backend): added extra checks for urlMethod and resourceType in CH connector 2022-09-02 22:28:57 +02:00
Alexander Zavorotynskiy
c526d611f5 fix(backend): fixed some issues in db service 2022-09-02 18:16:10 +02:00
Alexander Zavorotynskiy
a621dd39b4 feat(backend): added message_id to events table in CH 2022-09-02 11:59:13 +02:00
Alexander Zavorotynskiy
d5f3d5713e feat(backend): removed commented code in heuristics 2022-09-02 09:30:56 +02:00
Alexander
3904509f18
ClickHouse bugs fix (#707)
* fix(backend): fixed issues in CH connector
2022-09-01 17:45:28 +02:00
Alex K
f699b03117
fix(backend/assets): once-a-day versioning; once-a-day re-uploading (#699) 2022-09-01 10:52:13 +02:00
Alexander Zavorotynskiy
6a956da100 fix(backend): fixed import error in db pg connector 2022-08-31 19:13:47 +02:00
Alexander
7421154939
Ch improvements (#705)
* feat(backend): in-memory batches for click house
* feat(backend): new scheme for ClickHouse tables
2022-08-31 19:00:26 +02:00
Taha Yassine Kraiem
1ace32b0b2 Merge remote-tracking branch 'origin/api-v1.8.0' into dev 2022-08-30 20:11:55 +01:00
Taha Yassine Kraiem
bedf526891 feat(backend): changed build script 2022-08-30 14:34:39 +01:00
Alexander
b9c30e256d
FTS support (quickwit) (#703)
* feat(backend): sending fetch, page and graphQL events to quickwit topic
2022-08-30 14:13:55 +02:00
Alexander Zavorotynskiy
750f98645f feat(backend/http): added projectID to start handler response 2022-08-30 11:41:59 +02:00
Alexander Zavorotynskiy
513aa89267 fix(backend/sink): fixed messages types 2022-08-30 10:43:33 +02:00
Alex Kaminskii
15c6370153 fix(backend): fix rewrite-message filter 2022-08-29 10:19:06 +02:00
Alex K
f19a7df354
Merge pull request #694 from openreplay/adopted-style-sheets
Tracker 3.6.0 and message schema update
* feat (tracker, backend, player): Adopted Style Sheets maintenance
* refactor(tracker,player): compact messages representation (as array)
* feat (tracker,backend): Use real sessionStart timestamp decoded from token on start
* fix (frontend/assist): Fix activity timeouts logic in assist
* fix (tracker): maintain scroll, mousemove, mouseclick, exceptions inside iFrames
* fix (tracker): img module url resolving
* fix (tracker): critical bug in observer (missing nodes)
* feat (tracker): sessionHash returned on stop can be used for continuing session on start
2022-08-26 16:00:31 +02:00
Alexander Zavorotynskiy
be9b21bec4 fix(backend): removed debug log in db service 2022-08-25 09:50:56 +02:00
Alexander Zavorotynskiy
95cff55e6c feat(backend): skip raw batch when get incorrect batch version 2022-08-24 15:25:16 +02:00
Alex Kaminskii
c4b3310c58 fix(backend): library use in message template 2022-08-24 10:49:46 +02:00
Alex Kaminskii
0445d2d9bc fix(backend): messages-rewriting code 2022-08-23 16:30:40 +02:00
Alex Kaminskii
6fa68e7990 Merge branch 'dev' into adopted-style-sheets 2022-08-23 16:27:18 +02:00
Alexander Zavorotynskiy
d955efe429 fix(backend): fixed bug in sessionStart handler 2022-08-22 14:30:21 +02:00
Alexander
5887ab5ddb
Message protocol update (message size) (#663)
* feat(tracker): update message schema with BatchMetadata; separate message-related responsibilities; add message size
* chore(docker): removing edge busybox, as the main repo updated
* feat(backend): updated message protocol templates
* feat(backend): added support of message size
* feat(backend): implemented iterator for new message protocol (with message size)

Co-authored-by: Alex Kaminskii <alex@openreplay.com>
2022-08-22 12:32:48 +02:00
Alex Kaminskii
fe11fb06dc feat(backend):rewrite adoptedStyleSheet style messages 2022-08-17 20:05:35 +02:00
Alex Kaminskii
02255f0380 feat(backend): return startTimestamp on /start 2022-08-17 19:34:09 +02:00
Alexander Zavorotynskiy
27806054e0 fix(backend): removed redundant files 2022-08-08 15:49:49 +02:00
Alexander Zavorotynskiy
e86ce25382 fix(backend): removed ch files from pkg 2022-08-08 13:29:33 +02:00
Alexander Zavorotynskiy
f3b431d64b feat(backend): implemented iterator for new message protocol (with message size) 2022-08-05 19:49:18 +02:00
Alexander Zavorotynskiy
d06bd8769f feat(backend): added support of message size 2022-08-04 16:33:51 +02:00
Alex Kaminskii
44d176f977 fixup! feat(backend): AWS_SKIP_SSL_VALIDATION env var 2022-08-03 20:22:27 +02:00
Alex Kaminskii
5a32244db0 feat(backend): AWS_SKIP_SSL_VALIDATION env var 2022-08-03 19:53:00 +02:00
rjshrjndrn
d10b29b876 chore(docker): removing edge busybox, as the main repo udpated
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-08-03 17:09:26 +02:00
rjshrjndrn
54d7c1a72c chore(docker): removing edge busybox, as the main repo udpated
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-08-03 17:03:37 +02:00
Alex Kaminskii
820994b55f feat(mobs,backend):PartitionedMessage & BatchMetadata messages 2022-08-01 10:20:30 +02:00
Alex Kaminskii
d0e486233a fix(backend): no breaking changes to dev 2022-07-29 19:18:44 +02:00
Alex Kaminskii
2088d16c79 feat(backend&mobs):new batch metadata + PartitionedMessage service msg 2022-07-29 18:27:17 +02:00
Alexander
0d82d7feac
DB improvements (#647)
* feat(backend/db): updated ClickHouse library version from 1.5.4 to 2.2.0
* feat(backend/db): refactored ClickHouse connector
* feat(backend/db): rewritten batch implementation for ClickHouse inserts
* feat(backend/db): found and fix memory leak in db service
2022-07-28 16:34:44 +02:00
rjshrjndrn
bea850b9de chore(http): Changing http port to 8080
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-07-21 12:31:16 +02:00
Alexander
1997d326d6
Fix duplicates (#628)
* feat(backend/ender): added check for sessionEnd duplicates
2022-07-21 10:55:20 +02:00
rjshrjndrn
3afb72c037 fix(helm): updated non-root path for backend services
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-07-21 09:00:07 +02:00
rjshrjndrn
41c80c12ea chore(docker): Run non root users for containers
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-07-20 22:15:12 +02:00
rjshrjndrn
a94b3f4410 chore(docker): Updated docker base image
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-07-20 13:51:40 +02:00
Alexander Zavorotynskiy
56f68273d5 fix(backend/db): fixed arguments order for autocomplete inserts 2022-07-19 17:45:22 +02:00
Alexander Zavorotynskiy
8f54247a29 feat(backend/storage): added new reading_duration metric for storage service 2022-07-19 16:16:01 +02:00
Alexander
4dc82294e9
feat(backend/db): implemented bulk inserts for db service (#619) 2022-07-19 15:02:15 +02:00