Commit graph

364 commits

Author SHA1 Message Date
Alexander
861302bba7
[Ender] new message iterator (#929)
* feat(backend): added new message iterator especially for ender
2023-01-18 14:43:24 +01:00
Alexander
da7d2038ef
[DB] added url field for click rage issues (#925)
* feat(backend): added url field for click rage issues
2023-01-18 13:38:10 +01:00
Alexander
a6e4779652
[HTTP] added custom project beacon size (#926)
* feat(backend): added project beacon size select on each sessionStart request
2023-01-18 12:36:34 +01:00
Alex Kaminskii
50b2bd17f4 fix(backend/assets):add asp.NET extension for caching; strip #fragment suffix on baseURL when resolving 2023-01-13 12:58:52 +01:00
Alexander
44f9e4c120
[Storage] added sort operation for session messages (#921)
* feat(backend): added sort operation for session messages
2023-01-11 16:23:10 +01:00
Alexander Zavorotynskiy
22fac6d5ea feat(backend): added pg limits for some columns 2022-12-30 10:52:15 +01:00
Alexander Zavorotynskiy
ee64d91a7e feat(backend): added metrics for postgres bulks (size and insert duration) 2022-12-27 18:58:46 +01:00
Alexander Zavorotynskiy
d151c20ed8 feat(backend): new metrics for storage (uploading_duration) 2022-12-27 17:03:48 +01:00
Alexander
f1d852abb4
[DB] moved click events to bulks (#892)
* feat(backend): moved click events to bulks
* feat(backend): insert click event with host + path
2022-12-26 15:59:32 +01:00
Alexander Zavorotynskiy
efe1ae1dd7 feat(backend): removed old queue logger 2022-12-20 13:51:53 +01:00
Alexander
c54e23386a
[DB] removed pg transactions (#889)
* feat(backend): removed pg transactions for webErrors and issueEvents
2022-12-20 13:32:32 +01:00
Alex Kaminskii
e6ad085f2e refactor(mobs/backend):write ResourceTiming to devtools.mob 2022-12-12 15:47:11 +01:00
Alex Kaminskii
ff80386aff feat(backend,mobs):replace Fetch with NetworkRequest 2022-12-09 15:48:47 +01:00
Alex K
e861bd9641
refactor(backend):remove legacy message wrapping (#854)
* refactor(backend):remove legacy message wrapping & few backend-only messages
2022-12-06 11:54:36 +01:00
Alexander
17d9a4a116
[Iterator] batch pre-decoding (#852)
* feat(backend): batch pre-decoding implementation
2022-12-05 11:21:26 +01:00
Alexander
08b47991aa
feat(backend/mobs): clean up ruby templates and final generated code (#851) 2022-11-29 17:17:01 +01:00
Alexander
8a8cf4d938
feat(backend/sink): manually sync all files on partitions rebalanced event (#847) 2022-11-29 11:34:39 +01:00
Jorgen Evens
e0a88666af feat(redis): add suppport for credentials and TLS
By using `ParseURL` it is now possible to
- Supply login credentials for the redis instance
- Use an encrypted TLS connection by setting the scheme to `rediss://`
2022-11-25 19:16:01 +01:00
Alexander
9e319ed27c
[Sink] Improved files sync algo (#831)
* feat(backend): use channel of changed sessions instead of sync.Map

* feat(backend): avoid memory alloc for message body in message iterator

* feat(backend): removed unnecessary locks in file syncer

* feat(backend): sync.Map with prev updates

* feat(backend): improved write algorith (added bufio.Writer)

* feat(backend): session writer refactoring

* feat(backend): removed unnecessary type definition

* feat(backend): added write retrier to avoid data losing

* feat(backend): refactoring

* feat(backend): added session file implementation
2022-11-25 17:25:55 +01:00
Alex Kaminskii
1e17c5d2f9 fix(backend):hash payload to ID only in js-sourced errors 2022-11-17 16:48:15 +01:00
Alex K
822ca53980
Dev aleksk (#795)
*feat(tracker;backend;frontend/player): focus in elem
*feat(tracker;frontend/player): FontFace load
2022-11-04 11:33:29 +01:00
Alexander Zavorotynskiy
df8aed3464 feat(backend): get fresh session from db only on SessionEnd message 2022-11-04 09:40:11 +01:00
Alexander Zavorotynskiy
920c2523d6 fix(backend): fixed bug in sessions cache layer and in sessionEnd handler 2022-11-03 17:41:43 +01:00
Alexander
2abf063ba2
Sessions cache layer (#789)
* feat(backend/db): cache layer for sessions with auto deleting logic
2022-11-02 17:00:41 +01:00
Alexander Zavorotynskiy
7a299fabc0 fix(backend): fixed possible panic in parseTags method 2022-11-02 12:45:38 +01:00
Alex Kaminskii
e1cd349cb9 fix(backend/db): truncate messageIndex to Int32 before insertion 2022-10-31 11:12:27 +01:00
Alex K
c7520166f3
fix(backend): use first frame for error identification (#790) 2022-10-27 16:29:48 +02:00
Alexander Zavorotynskiy
7e53bcf17c feat(backend/db): removed unnecessary logs 2022-10-26 11:52:36 +02:00
Alexander Zavorotynskiy
a286b0b2d2 fix(backend): fixed method call in redis consumer 2022-10-25 18:52:34 +02:00
Alexander
51b6414cb6
feat(backend): added convertor for old sessionEnd message (#786) 2022-10-25 14:50:02 +02:00
Alexander
c4f0252677
feat(backend/sink): added cache layer for assets url rewriter (#785) 2022-10-25 12:16:45 +02:00
Alex Kaminskii
0a8ece3573 feat(backend/http):store Delay in sess-token 2022-10-19 16:21:58 +02:00
Alex K
974afa454b
feat(backend): insert error tags+ (#768)
* feat(backend): transform legacy messages

* refactor(backend/postgres):remove seqIndex transformation

* feat(backend/db): parse & insert errors_tags

* chore(backend): remove building folder after build

* fix(backend/db):remove message types from filter that do not go through kafka 

* fix(backend/assets):use JSException instead of ErrorEvent

* refactor(backend/db):ErrorEvent is no longer a message

* feat(backend/db):insert error tags in clickhouse

* refactor(backend):remove unused LongTask code
2022-10-19 10:31:13 +02:00
Alexander Zavorotynskiy
35a58edec2 feat(backend): removed context from issue event 2022-10-18 14:12:19 +02:00
Alexander
a166482227
Session mod files encryption (#766)
* feat(backend): added session mod files encryption
2022-10-18 12:50:36 +02:00
Alex Kaminskii
d48a580d62 feat(mobs;backend): negative filtering for mob-file messages (no backend involved in plugin creation) 2022-10-17 10:29:47 +02:00
sylenien
117b1aca96 change(tracker/backend): change msg format for exceptions 2022-10-12 12:44:05 +02:00
sylenien
55abe72412 change: fix message format 2022-10-11 12:20:33 +02:00
sylenien
c7fa1e7fa5 feat(tracker): remove tags key 2022-10-11 12:20:33 +02:00
sylenien
d7e01e21af feat(backend/tracker): fix error type 2022-10-11 12:20:33 +02:00
sylenien
6e3e03dd46 feat(backend/tracker): add error messages 2022-10-11 12:20:33 +02:00
Alex K
c3fcda45d4
Devtools separation (#752)
* feat (backend+frontend/player): writing  devtools-related messages into a separate file
2022-10-07 16:20:48 +02:00
Alexander
617c78f224
Speed up Ender (#762)
* feat(backend): process only Timestamp messages in ender's messageHandler

* feat(backend): moved stats logger to session ender
2022-10-05 13:30:43 +02:00
Alexander
56ed06ed17
Message processing refactoring (#743)
* feat(backend): refactored message processing logic and cleaned up previous changes
2022-09-28 13:41:50 +02:00
Alexander Zavorotynskiy
9ff555cc64 feat(backend): set seek pointer at the end of batch for avoiding memory leaks 2022-09-19 10:59:00 +02:00
Alexander Zavorotynskiy
3b045fa864 feat(backend): call sessions table optimise method only in one db service 2022-09-13 15:48:23 +02:00
sylenien
f360d8416d feat(tracker): add zustand support 2022-09-09 11:55:31 +02:00
Alexander Zavorotynskiy
0eed5b58d4 feat(backend): extra checks to avoid nil cast panic 2022-09-08 16:21:41 +02:00
Alexander Zavorotynskiy
bef74d5284 feat(backend): skip corrupted batch 2022-09-06 14:35:16 +02:00
Alexander Zavorotynskiy
348a323a41 feat(backend): added extra checks for urlMethod and resourceType in CH connector 2022-09-02 22:28:57 +02:00