jan/openreplay
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
5261 commits 228 branches 50 tags 289 MiB
Commit graph

52 commits

Author SHA1 Message Date
Alexander
a40ce7c376
[DB] async db inserts for PG and CH (#967) 
* feat(backend): added async workers for db service
 2023-02-13 13:58:03 +01:00
Kraiem Taha Yassine
767d2f6f0c
V1.8.2 workers app name (#772) 
* feat(backend): added application name to postgres connection

Co-authored-by: Alexander Zavorotynskiy <zavorotynskiy@pm.me>
 2023-01-23 09:08:14 +01:00
Alexander
bfe14db353
[DB] added last quickwit changes (#950) 
* feat(backend): added last quickwit changes
 2023-01-20 16:18:00 +01:00
Alexander
43b042aef8
[Sink] new message iterator (#945) 
* feat(backend): implemented new version of sink message iterator
 2023-01-20 09:49:49 +01:00
Alexander
861302bba7
[Ender] new message iterator (#929) 
* feat(backend): added new message iterator especially for ender
 2023-01-18 14:43:24 +01:00
Alexander Zavorotynskiy
efe1ae1dd7 feat(backend): removed old queue logger 2022-12-20 13:51:53 +01:00
Alexander
09adccf4be
feat(backend): added env variable for enabling pprof (#880) 2022-12-13 17:48:00 +01:00
Alexander Zavorotynskiy
19b6c896b9 feat(backend): fixed big file log in storage 2022-12-13 17:28:52 +01:00
Alex K
b3cbf74deb
Merge branch 'dev' into network-request-messahe 2022-12-13 17:12:15 +01:00
Alexander
bab5a81959
[Storage] added workers perf improvements (#877) 
* feat(backend): added workers for storage service
 2022-12-13 14:35:41 +01:00
Alex Kaminskii
ff80386aff feat(backend,mobs):replace Fetch with NetworkRequest 2022-12-09 15:48:47 +01:00
Alex K
e861bd9641
refactor(backend):remove legacy message wrapping (#854) 
* refactor(backend):remove legacy message wrapping & few backend-only messages
 2022-12-06 11:54:36 +01:00
Alexander Zavorotynskiy
065ecf9e03 feat(backend/ender): logs improvements 2022-12-01 12:47:08 +01:00
Alexander Zavorotynskiy
37c31db69d feat(backend/ender): logs clean up 2022-12-01 12:33:28 +01:00
Alexander Zavorotynskiy
2dc8af998c feat(backend/ender): remove from memory sessions with wrong duration 2022-11-30 17:44:35 +01:00
Alexander Zavorotynskiy
5e8111e5d4 feat(backend): added rebalancing handler to all services 2022-11-29 13:21:16 +01:00
Alexander Zavorotynskiy
90f88abdb4 feat(backend): fix vulnerability in /x/net 2022-11-29 11:44:58 +01:00
Alexander
8a8cf4d938
feat(backend/sink): manually sync all files on partitions rebalanced event (#847) 2022-11-29 11:34:39 +01:00
Alexander
9e319ed27c
[Sink] Improved files sync algo (#831) 
* feat(backend): use channel of changed sessions instead of sync.Map

* feat(backend): avoid memory alloc for message body in message iterator

* feat(backend): removed unnecessary locks in file syncer

* feat(backend): sync.Map with prev updates

* feat(backend): improved write algorith (added bufio.Writer)

* feat(backend): session writer refactoring

* feat(backend): removed unnecessary type definition

* feat(backend): added write retrier to avoid data losing

* feat(backend): refactoring

* feat(backend): added session file implementation
 2022-11-25 17:25:55 +01:00
Rajesh Rajendran
4698075aa0
Make helm installation namespaces customizable (#836) 
* chore(helm): Better configurability.

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* chore(init): Adding sleep 10 for resources to be up

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(helm): Updated env vars

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* chore(helm): Derive namespace from minio endpoint

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(helm): Update namespace for chalice env vars

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* chore(init): random secret for assist jwt secret

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* chore(backend): Removing unnecessary files

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
 2022-11-25 10:27:12 +00:00
Alexander
e67c3ec876
[Sink] Zombie session killer feature (#829) 
* feat(backend): added zombie session killer feature
 2022-11-22 11:53:21 +01:00
Alexander
5a1cd27ebc
[Sink] Async session writer (#826) 
* feat(backend): implemented async session writer module
 2022-11-21 19:22:10 +01:00
Alexander
91709ac909
[Sink] splitting mob files without folders (#824) 
* feat(backend): split mob file into 2 without folders
 2022-11-17 16:15:25 +01:00
Alexander
9afc95d894
Mob file backward compatibility (#804) 
* feat(backend): added mob file backward compatibility
 2022-11-09 10:52:47 +01:00
Alexander Zavorotynskiy
df8aed3464 feat(backend): get fresh session from db only on SessionEnd message 2022-11-04 09:40:11 +01:00
Alexander Zavorotynskiy
920c2523d6 fix(backend): fixed bug in sessions cache layer and in sessionEnd handler 2022-11-03 17:41:43 +01:00
Alexander
2abf063ba2
Sessions cache layer (#789) 
* feat(backend/db): cache layer for sessions with auto deleting logic
 2022-11-02 17:00:41 +01:00
Alexander
c4f0252677
feat(backend/sink): added cache layer for assets url rewriter (#785) 2022-10-25 12:16:45 +02:00
Alex K
974afa454b
feat(backend): insert error tags+ (#768) 
* feat(backend): transform legacy messages

* refactor(backend/postgres):remove seqIndex transformation

* feat(backend/db): parse & insert errors_tags

* chore(backend): remove building folder after build

* fix(backend/db):remove message types from filter that do not go through kafka 

* fix(backend/assets):use JSException instead of ErrorEvent

* refactor(backend/db):ErrorEvent is no longer a message

* feat(backend/db):insert error tags in clickhouse

* refactor(backend):remove unused LongTask code
 2022-10-19 10:31:13 +02:00
Alexander
a166482227
Session mod files encryption (#766) 
* feat(backend): added session mod files encryption
 2022-10-18 12:50:36 +02:00
Alex K
c3fcda45d4
Devtools separation (#752) 
* feat (backend+frontend/player): writing  devtools-related messages into a separate file
 2022-10-07 16:20:48 +02:00
Alexander
8bf1dcba18
Workers pool for assets (#763) 
* feat(backend): added workers pool to assets
 2022-10-06 14:10:25 +02:00
Alexander
617c78f224
Speed up Ender (#762) 
* feat(backend): process only Timestamp messages in ender's messageHandler

* feat(backend): moved stats logger to session ender
 2022-10-05 13:30:43 +02:00
Alexander Zavorotynskiy
a04ff25381 feat(backend): removed unnecessary file from assets 2022-10-03 11:40:47 +02:00
Alexander Zavorotynskiy
43434f892a feat(backend): fixes for graceful shutdown in services 2022-09-28 17:29:09 +02:00
Alexander
56ed06ed17
Message processing refactoring (#743) 
* feat(backend): refactored message processing logic and cleaned up previous changes
 2022-09-28 13:41:50 +02:00
Alexander Zavorotynskiy
9ff555cc64 feat(backend): set seek pointer at the end of batch for avoiding memory leaks 2022-09-19 10:59:00 +02:00
Alexander Zavorotynskiy
3b045fa864 feat(backend): call sessions table optimise method only in one db service 2022-09-13 15:48:23 +02:00
Alexander Zavorotynskiy
0eed5b58d4 feat(backend): extra checks to avoid nil cast panic 2022-09-08 16:21:41 +02:00
Alexander Zavorotynskiy
bef74d5284 feat(backend): skip corrupted batch 2022-09-06 14:35:16 +02:00
Alexander Zavorotynskiy
d5f3d5713e feat(backend): removed commented code in heuristics 2022-09-02 09:30:56 +02:00
Alexander
b9c30e256d
FTS support (quickwit) (#703) 
* feat(backend): sending fetch, page and graphQL events to quickwit topic
 2022-08-30 14:13:55 +02:00
Alexander Zavorotynskiy
513aa89267 fix(backend/sink): fixed messages types 2022-08-30 10:43:33 +02:00
Alex Kaminskii
15c6370153 fix(backend): fix rewrite-message filter 2022-08-29 10:19:06 +02:00
Alex K
f19a7df354
Merge pull request #694 from openreplay/adopted-style-sheets 
Tracker 3.6.0 and message schema update
* feat (tracker, backend, player): Adopted Style Sheets maintenance
* refactor(tracker,player): compact messages representation (as array)
* feat (tracker,backend): Use real sessionStart timestamp decoded from token on start
* fix (frontend/assist): Fix activity timeouts logic in assist
* fix (tracker): maintain scroll, mousemove, mouseclick, exceptions inside iFrames
* fix (tracker): img module url resolving
* fix (tracker): critical bug in observer (missing nodes)
* feat (tracker): sessionHash returned on stop can be used for continuing session on start
 2022-08-26 16:00:31 +02:00
Alexander Zavorotynskiy
be9b21bec4 fix(backend): removed debug log in db service 2022-08-25 09:50:56 +02:00
Alex Kaminskii
6fa68e7990 Merge branch 'dev' into adopted-style-sheets 2022-08-23 16:27:18 +02:00
Alexander
5887ab5ddb
Message protocol update (message size) (#663) 
* feat(tracker): update message schema with BatchMetadata; separate message-related responsibilities; add message size
* chore(docker): removing edge busybox, as the main repo updated
* feat(backend): updated message protocol templates
* feat(backend): added support of message size
* feat(backend): implemented iterator for new message protocol (with message size)

Co-authored-by: Alex Kaminskii <alex@openreplay.com>
 2022-08-22 12:32:48 +02:00
Alexander Zavorotynskiy
f3b431d64b feat(backend): implemented iterator for new message protocol (with message size) 2022-08-05 19:49:18 +02:00
Alexander
0d82d7feac
DB improvements (#647) 
* feat(backend/db): updated ClickHouse library version from 1.5.4 to 2.2.0
* feat(backend/db): refactored ClickHouse connector
* feat(backend/db): rewritten batch implementation for ClickHouse inserts
* feat(backend/db): found and fix memory leak in db service
 2022-07-28 16:34:44 +02:00