Commit graph

222 commits

Author SHA1 Message Date
Alexander Zavorotynskiy
73a4339db2 fix(backend): added toUpper() method for network requests to avoid ignoring http methods in low case 2023-06-12 11:45:26 +02:00
Alexander
8e58c367dd
Fixed issue with wrong expiration timeout for projects (#1300)
* fix(backend): fixed issue with wrong expiration timeout for projects in cache layer

* fix(backend): removed direct call db.GetProject()

* feat(backend): set default PROJECT_EXPIRATION to 10 minutes
2023-06-08 18:08:53 +02:00
Alexander
f89d84232a
[DB] Added support for city/state autocomplete (#1317)
* feat(backend): added support for city/state autocomplete

* fix(backend): removed unused http handlers
2023-06-08 15:59:53 +02:00
Alexander
111d6a1b54
Azure support (#1270)
* feat(backend): implemented azure blob storage support

* feat(backend): added azure implementation to backend services

* feat(backend): added azure blob storage support to chalice service

* fix(backend): removed prev version of s3

* feat(backend): moved azure support to ee subfolder

* feat(backend): prepared ee code for new utils.objects package

* feat(backend): added missed modules to go.mod

* feat(backend): added missed modules to go.sum

* feat(backend): go mod tidy

* feat(backend): temporary made s3 vars are not required

* feat(backend): added azure lib to ee chalice

* feat(api): changed azure env var name

* feat(api): added new object store and extra methods to chalice ee

* fix(api): added azure blob lib to alerts

* fix(api): fixed incorrect call in sessions_devtool

* fix(crons): added azure blob storage library to requirements list

* chore(build): Error message for not providing flag.

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(backend): removed ios headers and object store for ios messages

* feat(backend): object config refactoring

* chore(helm): Update BUCKET_NAME

* fix(backend): removed object storage usage in http

* feat(backend): added debug logs to azure upload method

* fix(backend): fixed empty folder issue

* fix(backend): removed extra debug log

* chore(helm): Adding global variables for crons

* chore(helm): Remove clickhouse resource limit

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(backend): removed assets debug log

* feat(api): use ABC class instead of empty interface

* feat(api): renamed helpers to generators

* feat(api): changed prep/clean dev scripts

* feat(api): changed name obj_store -> StorageClient

* feat(api): some changes after code review

* fix(api): removed unnecesery packages in oss api

* feat(backend): moved azure implementation to ee folder

---------

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
Co-authored-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-06-08 13:31:54 +02:00
Alexander
691c84d5f4
[HTTP] added city and state support for geo extractor (#1312)
* feat(backend/http): added city and state support for geo extractor

* feat(backend): use new GeoLite db in Dockerfile

* feat(backend/http): added unit test
2023-06-08 09:07:08 +02:00
Delirium
2ed4bba33e
feat(tracker/ui): support for multi tab sessions (#1236)
* feat(tracker): add support for multi tab sessions

* feat(backend): added support of multitabs

* fix(backend): added support of deprecated batch meta message to pre-decoder

* fix(backend): fixed nil meta issue for TabData messages in sink

* feat(player): add tabmanager

* feat(player): basic tabchange event support

* feat(player): pick tabstate for console panel and timeline

* fix(player): only display tabs that are created

* feat(player): connect performance, xray and events to tab state

* feat(player): merge all tabs data for overview

* feat(backend/tracker): extract tabdata into separate message from batchmeta

* fix(tracker): fix new session check

* fix(backend): remove batchmetadeprecated

* fix(backend): fix switch case

* fix(player): fix for tab message size

* feat(tracker): check for active tabs with broadcast channel

* feat(tracker): prevent multiple messages

* fix(tracker): ignore beacons from same tab, only ask if token isnt present yet, add small delay before start to wait for answer

* feat(player): support new msg struct in assist player

* fix(player): fix some livepl components for multi tab states

* feat(tracker): add option to disable multitab

* feat(tracker): add multitab to assist plugin

* feat(player): back compat for tab id

* fix(ui): fix missing list in controls

* fix(ui): optional list update

* feat(ui): fix visuals for multitab; use window focus event for tabs

* fix(tracker): fix for dying tests (added tabid to writer, refactored other tests)

* feat(ui): update LivePlayerSubHeader.tsx to support tabs

* feat(backend): added tabs support to devtools mob files

* feat(ui): connect state to current tab properly

* feat(backend): added multitab support to assits

* feat(backend): removed data check in agent message

* feat(backend): debug on

* fix(backend): fixed typo in message broadcast

* feat(backend): fixed issue in connect method

* fix(assist): fixed typo

* feat(assist): added more debug logs

* feat(assist): removed one log

* feat(assist): more logs

* feat(assist): use query.peerId

* feat(assist): more logs

* feat(assist): fixed session update

* fix(assist): fixed getSessions

* fix(assist): fixed request_control broadcast

* fix(assist): fixed typo

* fix(assist): added missed line

* fix(assist): fix typo

* feat(tracker): multitab support for assist sessions

* fix(tracker): fix dead tests (tabid prop)

* fix(tracker): fix yaml

* fix(tracker): timers issue

* fix(ui): fix ui E2E tests with magic?

* feat(assist): multitabs support for ee version

* fix(assist): added missed method import

* fix(tracker): fix fix events in assist

* feat(assist): added back compatibility for sessions without tabId

* fix(assist): apply message's top layer structure before broadcast call

* fix(assist): added random tabID for prev version

* fix(assist): added random tabID for prev version (ee)

* feat(assist): added debug logs

* fix(assist): fix typo in sessions_agents_count method

* fix(assist): fixed more typos in copy-pastes

* fix(tracker): fix restart timings

* feat(backend): added tabIDs for some events

* feat(ui): add tab change event to the user steps bar

* Revert "feat(backend): added tabIDs for some events"

This reverts commit 1467ad7f9f.

* feat(ui): revert timeline and xray to grab events from all tabs

* fix(ui): fix typo

---------

Co-authored-by: Alexander Zavorotynskiy <zavorotynskiy@pm.me>
2023-06-07 10:40:32 +02:00
Alexander
a0b842f13c
feat(backend): insert referrer to sessions table (#1237) 2023-05-05 18:22:49 +02:00
Alexander Zavorotynskiy
cdb6ab8b60 fix(backend): reduced ender tick duration 2023-05-05 11:34:21 +02:00
Alexander
528d1af173
Compression worker (#1233)
* feat(backend): added extra worker for session compression

* feat(backend): debug logs

* feat(backend): added compression ratio metric

* feat(backend): reduced number of duplicate logs

* feat(backend): rewrite workers managment
2023-05-04 17:46:43 +02:00
Alexander
742c038ecd
New env variable CLOUD (aws by default) (#1232)
* feat(backend): added new env variable CLOUD (aws by default)

* chore(backend): Adding env variable for CLOUD

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

---------

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
Co-authored-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-05-04 16:48:48 +02:00
Alexander
c98a93cfd4
[Storage] timestamp sorting and filtering (#1218)
* feat(backend): combined sorting by index and timestamp

* feat(backend): write the only last timestamp message in a row
2023-04-28 12:28:46 +02:00
Alexander
44d550ca3e
Remove message index from mob file (#1213)
* feat(backend): removed message index from mob file messages

* feat(backend): remove duplicated messages (by message index)

* feat(backend): added MAX_INDEX at the begining of session to indicate a new version of mob file

* feat(backend): added comments to code
2023-04-26 12:33:51 +02:00
Alexander
19fc925462
Improved session compression (#1200)
* feat(backend): implemented new compression
2023-04-25 10:25:25 +02:00
Alexander
e09396eaa3
Encryption metrics (#1151)
* feat(backend): added metric to measure the duration of session encryption

* feat(backend): enabled ecnryption

* feat(backend): fixed typo issue in packSession method
2023-04-12 15:00:55 +02:00
Alexander
1125d0c15d
feat(backend): stopped inserting input values into the database (#1068) 2023-04-11 16:04:24 +02:00
Alexander
f561593b1a
Memory control manager (#1067)
* feat(backend): added a mechanism to control memory consumption

* feat(backend): extra log for system allocation

* feat(backend): implemented new memory manager in db and heuristics service
2023-04-11 16:01:37 +02:00
Alexander Zavorotynskiy
561f333870 feat(backend/assets): set 30 days cache age for all s3 files 2023-03-22 12:59:02 +01:00
Alexander Zavorotynskiy
517b98197a feat(backend/assets): skip text/html content type files 2023-03-22 12:54:27 +01:00
Alexander Zavorotynskiy
9f71d1a6b3 feat(backend): added support for new version of ResourceTiming 2023-03-22 10:00:06 +01:00
nick-delirium
7156fa0fc4 change(tracker): fix msgs format 2023-03-22 10:00:06 +01:00
nick-delirium
d65e789b5b change(ui): regen messages; wait for player initialization; insert event lists instead of creating new ones 2023-03-22 10:00:06 +01:00
nick-delirium
89ec4b67f1 change(tracker): regen messages; add trans size and isCache to resource timing message, remove x-cached header detection 2023-03-22 10:00:06 +01:00
nick-delirium
2f1b233070 change(tracker/player): create new network msg for cached req 2023-03-22 10:00:06 +01:00
Alex Kaminskii
e5a93d4ca0 feat(backend): reader maintains multibyte type 2023-03-22 10:00:06 +01:00
Alexander Zavorotynskiy
9110e9cd6d feat(backend): removed debug logs 2023-03-17 12:17:14 +01:00
nick-delirium
fbab981614 change(tracker/backend): regenerate messages 2023-03-17 12:17:14 +01:00
nick-delirium
532d9b82f8 change(tracker): remove dom drop detection on tracker side 2023-03-17 12:17:14 +01:00
nick-delirium
01e4412815 change(tracker): add nodes drop message 2023-03-17 12:17:14 +01:00
nick-delirium
d9ab7b6853 change(tracker): add nodes drop message 2023-03-17 12:17:14 +01:00
nick-delirium
8129661356 Merge branch 'dev' into new-frustrations 2023-03-16 17:40:40 +01:00
nick-delirium
fcf4d1bc7e Merge branch 'dev' into new-frustrations 2023-03-16 17:27:19 +01:00
Alexander
4608911f5b
Sink and Ender message iterators refactoring (#1038)
* feat(backend): removed duplicate code in ender message iterator

* feat(backend): removed duplicate code in sink message iterator
2023-03-16 10:53:05 +01:00
Alexander Zavorotynskiy
a7ca8ac54f feat(backend): implemented new events for CH 2023-03-15 16:21:44 +01:00
Alexander Zavorotynskiy
89d45d2247 feat(backend): added skipped session metric for storage service 2023-03-14 11:53:20 +01:00
Alexander Zavorotynskiy
321c07d914 feat(backend): added heuristics metrics builder 2023-03-14 11:23:15 +01:00
Alexander Zavorotynskiy
907ae9a131 feat(backend): added hesitation time for click events 2023-03-13 12:54:34 +01:00
Alexander Zavorotynskiy
4480a5d93a fix(backend): fixed typo in issue type 2023-03-13 11:11:21 +01:00
Alexander Zavorotynskiy
ded9a88fe9 feat(backend): implemented db inserts for InputDuration and MouseThrashing 2023-03-10 09:56:31 +01:00
Alexander
a3c7681dfa
Merge branch 'dev' into new-frustrations 2023-03-09 15:33:58 +01:00
Alexander
c6aac11cbf
Heuristics refactoring (#987)
* feat(backend): refactored heuristics service

* feat(backend): refactored db service (moved several events to heuristics)
2023-03-09 09:54:12 +01:00
Alexander Zavorotynskiy
56c1469273 fix(backend): removed debug log from session iterator 2023-02-21 15:51:03 +01:00
Alexander Zavorotynskiy
dab2707107 feat(backend): clean up go modules 2023-02-20 16:59:57 +01:00
Alexander Zavorotynskiy
3d9ea580a2 fix(backend): removed wrong line from batchSet 2023-02-20 16:45:00 +01:00
Alexander
fdd28dbc4a
Draft: New metrics module (#982)
* feat(backend): created new metrics module
2023-02-20 16:37:55 +01:00
nick-delirium
4a96d87cb7 change(tracker): add mouse thrashing event message 2023-02-17 13:04:00 +01:00
nick-delirium
9628bcdfad change(tracker): add more events to input, fix typo and timestamp calc 2023-02-17 13:04:00 +01:00
nick-delirium
c2501530a0 fix(tracker): capture selection event 2023-02-17 13:04:00 +01:00
nick-delirium
3266f46440 fix(tracker): some events changes... 2023-02-17 13:04:00 +01:00
nick-delirium
018f618e12 change(tracker): add mouse shake and update input hesitation message 2023-02-17 13:03:59 +01:00
Alexander
a40ce7c376
[DB] async db inserts for PG and CH (#967)
* feat(backend): added async workers for db service
2023-02-13 13:58:03 +01:00