Alexander Zavorotynskiy
853ac7c277
feat(backend): added CH creds support
2023-03-21 17:18:31 +01:00
Alexander Zavorotynskiy
d6526464c6
fix(backend): fixed field names
2023-03-15 16:26:46 +01:00
Alexander Zavorotynskiy
a7ca8ac54f
feat(backend): implemented new events for CH
2023-03-15 16:21:44 +01:00
Alexander
c6aac11cbf
Heuristics refactoring ( #987 )
...
* feat(backend): refactored heuristics service
* feat(backend): refactored db service (moved several events to heuristics)
2023-03-09 09:54:12 +01:00
Alexander Zavorotynskiy
4bdc095c76
fix(backend): removed wrong defer in db.Saver
2023-02-21 15:29:24 +01:00
Alexander
fdd28dbc4a
Draft: New metrics module ( #982 )
...
* feat(backend): created new metrics module
2023-02-20 16:37:55 +01:00
Alexander
a40ce7c376
[DB] async db inserts for PG and CH ( #967 )
...
* feat(backend): added async workers for db service
2023-02-13 13:58:03 +01:00
Rajesh Rajendran
93f27fe459
clickhouse password ( #972 )
...
* chore(helm): Adding clickhouse password
* chore(backend): Support clickhouse password
* chore(api): Adding clickhouse password support
* chore(helm): inject clickhouse password
* chore(helm): Updating clickhouse image
* fix(clickhouse): Removing duplicate country code
---------
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-02-08 18:47:32 +01:00
Kraiem Taha Yassine
a68d2f2a58
Merge pull request #905 from openreplay/db_limits
...
[DB] limits for some columns
2023-01-20 17:47:58 +01:00
Alexander
bfe14db353
[DB] added last quickwit changes ( #950 )
...
* feat(backend): added last quickwit changes
2023-01-20 16:18:00 +01:00
Alexander Zavorotynskiy
6d557cd053
feat(backend): fixed missed session cache layer for some db methods
2023-01-20 14:43:56 +01:00
Alexander
da7d2038ef
[DB] added url field for click rage issues ( #925 )
...
* feat(backend): added url field for click rage issues
2023-01-18 13:38:10 +01:00
Alexander Zavorotynskiy
6972f84275
feat(backend): added batch and compression configuration for kafka producer
2023-01-11 16:52:32 +01:00
Alexander Zavorotynskiy
fa3655079d
feat(backend): added CH limits for some columns
2022-12-30 11:19:13 +01:00
Alexander
205fdcba42
fix(backend/clickhouse): fixed batch insert panic because of wrong error source ( #900 )
2022-12-24 20:53:11 +01:00
Alex K
b3cbf74deb
Merge branch 'dev' into network-request-messahe
2022-12-13 17:12:15 +01:00
Alexander
bab5a81959
[Storage] added workers perf improvements ( #877 )
...
* feat(backend): added workers for storage service
2022-12-13 14:35:41 +01:00
Alex Kaminskii
ff80386aff
feat(backend,mobs):replace Fetch with NetworkRequest
2022-12-09 15:48:47 +01:00
Alex K
e861bd9641
refactor(backend):remove legacy message wrapping ( #854 )
...
* refactor(backend):remove legacy message wrapping & few backend-only messages
2022-12-06 11:54:36 +01:00
Alexander Zavorotynskiy
065ecf9e03
feat(backend/ender): logs improvements
2022-12-01 12:47:08 +01:00
Alexander
8a8cf4d938
feat(backend/sink): manually sync all files on partitions rebalanced event ( #847 )
2022-11-29 11:34:39 +01:00
Dayan Graham
5d37d2da1e
feat(backend): enable Kerberos authentication for Kafka communication… ( #807 )
...
* feat(backend): enable Kerberos authentication for Kafka communications between services for EnterpriseEdition
* feat(backend): put default value for KAFKA_USE_KERBEROS
* feat(backend): Add Kerberos auth for Kafka - Update with comments for the envvars that configure the Kerberos auth
2022-11-22 12:10:01 +01:00
Alexander Zavorotynskiy
3b54ddb642
fix(backend): fixed panic from CH lib on incorrect issue type
2022-11-11 11:26:21 +01:00
Alexander Zavorotynskiy
408bd80ec3
fix(backend): added missed argument in kafka consumer
2022-10-25 16:11:56 +02:00
Alex K
974afa454b
feat(backend): insert error tags+ ( #768 )
...
* feat(backend): transform legacy messages
* refactor(backend/postgres):remove seqIndex transformation
* feat(backend/db): parse & insert errors_tags
* chore(backend): remove building folder after build
* fix(backend/db):remove message types from filter that do not go through kafka
* fix(backend/assets):use JSException instead of ErrorEvent
* refactor(backend/db):ErrorEvent is no longer a message
* feat(backend/db):insert error tags in clickhouse
* refactor(backend):remove unused LongTask code
2022-10-19 10:31:13 +02:00
Alexander Zavorotynskiy
35a58edec2
feat(backend): removed context from issue event
2022-10-18 14:12:19 +02:00
Alexander
a166482227
Session mod files encryption ( #766 )
...
* feat(backend): added session mod files encryption
2022-10-18 12:50:36 +02:00
Alexander
bdcc98492d
Issues table for ClickHouse ( #764 )
...
* feat(backend): added batch for issues table to clickhouse connector
2022-10-11 10:25:45 +02:00
Alexander
56ed06ed17
Message processing refactoring ( #743 )
...
* feat(backend): refactored message processing logic and cleaned up previous changes
2022-09-28 13:41:50 +02:00
Alexander Zavorotynskiy
4f8e000de3
fix(backend): removed old method from CH interface
2022-09-19 11:06:39 +02:00
Alexander Zavorotynskiy
7502ad76df
feat(backend): removed optimize call
2022-09-16 18:34:06 +02:00
Alexander Zavorotynskiy
3b045fa864
feat(backend): call sessions table optimise method only in one db service
2022-09-13 15:48:23 +02:00
Alexander Zavorotynskiy
348a323a41
feat(backend): added extra checks for urlMethod and resourceType in CH connector
2022-09-02 22:28:57 +02:00
Alexander Zavorotynskiy
c526d611f5
fix(backend): fixed some issues in db service
2022-09-02 18:16:10 +02:00
Alexander Zavorotynskiy
71609a19c3
fix(backend): set messageID = 0 for perf events in CH connector
2022-09-02 12:12:20 +02:00
Alexander Zavorotynskiy
e8de4ed5f5
fix(backend): fixed typo in CH connector
2022-09-02 12:03:28 +02:00
Alexander Zavorotynskiy
a621dd39b4
feat(backend): added message_id to events table in CH
2022-09-02 11:59:13 +02:00
Alexander
3904509f18
ClickHouse bugs fix ( #707 )
...
* fix(backend): fixed issues in CH connector
2022-09-01 17:45:28 +02:00
Alexander Zavorotynskiy
e2e6ef9861
fix(backend): added uint convertion to status field in CH connector
2022-09-01 11:17:53 +02:00
Alexander Zavorotynskiy
1ff51c44cb
fix(backend): fixed bug in db saver (ee)
2022-09-01 08:40:01 +02:00
Alexander
7421154939
Ch improvements ( #705 )
...
* feat(backend): in-memory batches for click house
* feat(backend): new scheme for ClickHouse tables
2022-08-31 19:00:26 +02:00
Alexander
5887ab5ddb
Message protocol update (message size) ( #663 )
...
* feat(tracker): update message schema with BatchMetadata; separate message-related responsibilities; add message size
* chore(docker): removing edge busybox, as the main repo updated
* feat(backend): updated message protocol templates
* feat(backend): added support of message size
* feat(backend): implemented iterator for new message protocol (with message size)
Co-authored-by: Alex Kaminskii <alex@openreplay.com>
2022-08-22 12:32:48 +02:00
Alexander
0d82d7feac
DB improvements ( #647 )
...
* feat(backend/db): updated ClickHouse library version from 1.5.4 to 2.2.0
* feat(backend/db): refactored ClickHouse connector
* feat(backend/db): rewritten batch implementation for ClickHouse inserts
* feat(backend/db): found and fix memory leak in db service
2022-07-28 16:34:44 +02:00
Kraiem Taha Yassine
16c70044fb
Chore(release): v1.7.0 ( #578 )
...
* change(ui) - redirect to the landing url on SSO login
* fix(ui): fix share popup styles
* change(ui) - non admin user preference restrictions
* fix(ui) - redirect fix
* change(ui) - show installation btn without mouse hover
* feat(api): api-v1 handle wrong projectKey
feat(api): api-v1 get live sessions
* change(ui) - show role edit on hover
* change(ui) - audit trail count with comma
* fix(ui) - audit trail date range custom picker alignment
* change(ui) - show a message when mob file not found
* feat(api): api-v1 fixed search live sessions
* feat(api): api-v1 handle wrong projectKey
* feat(api): fixed assist error response
* fix(tracker): check node scrolls only on start
* fixup! fix(tracker): check node scrolls only on start
* feat(ui/player): scroll view in click map
* feat(ui/player): rm unused check
* New configuration module (#558 )
* ci(dbmigrate): Create db migrate when there is change
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* fix(ui): fix login error/button margins
* fix(ui) - checkbox click
* fix(ui) - search rename and save fixes
* change(ui) - text changes
* fix(ui) - button text nowrap
* fix(ui): fix slowestdomains widget height
* change(ui) - ignore clicks while annotating
* change(ui) - if block with braces
* change(ui) - capitalize first letter in breadcrumb
* feat(db): remove errors from permissions
feat(api): remove errors from permissions
* feat(api): changed reset password response
* fix(ui) - assist active tab list, broken after with new api changes (pagination)
* fix(ui) - assist active tab list, broken after with new api changes (pagination)
* change(ui) - search compare
* fix(ui): last fixes for 1.7
* fix(ui): fix timeline
* fix(ui): small code fixes
* fix(ui): remove unused
* feat(frontend/assist): show when client tab is inactive + fix reconnection status update
* fix(ui) - visibility settings
* feat(assist): refactored extractSessionInfo
feat(assist): hardcoded session's attributes
* Added snabbdom (JS)
* fix(tracker): version check works with x.x.x-beta versions
* fix(backend): keep the highest user's timestamp instead of the latest message timestamp for correct session duration value
* feat(backend/s3): added file tag RETENTION (#561 )
* change(ui) - search optimization and autocomplete improvements
* feat(backend/assets): added new metrics assets_downloaded
* change(ui) - show back the date range in bookmarks since the api is filtering by daterange
* feat(backend-assets): custom headers for cacher requests
* chore(backend): no tidy in dockerfile (local build speed up)
* feat(backend/assets): added proxy support for cacher module
* feat(backend/storage): set retention env variable as not required
* fix(ui): fix jira issues
* ci(helm): use kubectl for deployment
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* feat(tracker):3.5.13: performance improvements for a case of extensive dom
* fix(backend): added missed err var and continue statement
* ci(helm): forcing namespace
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* feat(api): fixed slowest_domains query
* ci(helm): update helm deployment method
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* change(ui) - filter dropdown colros
* fix(ui) - speed index location avg attribute changed to value
* ci(api): enable kubectl apply
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* fix(ui) - widget y axis label
* feat(api): fixed slowest_domains query
* chore(helm): Adding namespaces to all templates (#565 )
* feat(api): assist type-autocomplete
* feat(api): assist global-autocomplete
* feat(sourcemaps): include wasm file in build
* feat(sourcemaps-reader): refactored
* fix(ui): fix data for funnels
* fix(ui): fix all sessions section margin
* fix(ui) - assist loader flag
* fix(ui) - assist loader flag
* fix(ui): fix weird check
* feat(api): autocomplete accept unsupported types
* feat(ui): migrate to yarn v3
* feat(ui): minor fixes for installment
* feat(ui): add typescript plugin to yarn
* chore(helm): Ability to override image registry
* chore(helm): Overriding openreplay docker registry
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* fix(ui): fix control arrows on firefox
* feat(crons): EE crons
* feat(api): fixed build script
* feat(alerts): fixed build script
* feat(crons): fixed build script
* chore(helm): Updating cron version
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* feat(crons): changes
* chore(helm): optional minio ingress
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* feat(crons): fix build script
feat(alerts): fix build script
* Revert "chore(helm): Updating cron version"
This reverts commit 3ca190ea2f#570 )
* feat(crons): changed entrypoint
* feat(player): dev-log on skipping message
* fix(tracker): removeNode mutation priority over attributes
* fix(tracker): capture relative img timing;use startsWith instead of substr; codestyle fix
* chore(build): fixing api build script
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* chore(ci): faster deployment
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* change(ui) - assist list show active status
* chore(actions): option to build all/specific services in GH
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* fix(ui) - slowest domain metric data as per the api changes
* ci(helm): updated variable name
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* ci(backend): cherrypick changes to ee
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* feat(backend): disabled pprof in http service
* fix(ui) - TimeToRender avg value as per the API change
* fix(ui) - ResponseTimeDistribution avg value as per the API change
* fix(ui) - MemoryConsumption avg value as per the API change
* fix(ui) - ResponseTime avg value as per the API change
* fix(ui) - DomBuildTime avg value as per the API change
* fix(ui) - FrameRate avg value as per the API change
* chore(helm): proper default tag
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* feat(backend): removed sensitive information from http logs
* ci(backend): adding default parameter value for workflow dispatch
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* fix(backend): deleted empty file
* fix(actions): creating image source file prior
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* fix(helm): variable substitution
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* change(ui) - project list item installation button text change
* fix(ui) - project create validation
* fix(backend): removed unsafe string logs in http service
* chore(kafka): Adding new topic
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* fix(efs-cron): variable name
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* fix(ui) - developer tools - hint links
* fix(ui) - session filters - country and platform dropdown values
* chore(helm): updating version
* chore(kafka): Update kafka default message size while provisioning
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* fix(tracker): fix dependency security
* change(ui) - webhook delete confirmation
* change(ui) - assist url to handle when empty
* feat(api): autocomplete replace console with errors
feat(DB): clean extra files
* chore(helm): Adding cron jobs
* change(ui) - set changed flag to false after the metric delete to avoid prompt
* chore(helm): enbaling cron only for ee
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* feat(api): autocomplete remove console
* change(ui) - removed Console filter type
* fix(ui) - timeline position
* fix(helm): RFC naming
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* fix(ui): let user change project in dashboards and select default dashboard
* chore(helm): update registry url
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* feat(DB): return pages_count to DB
* fix(ui) - account settings opt out checkbox
* fix(ui): fix modal width
* fix(ui) - explore circle bg
* fix(ui) - user name overlap
* fix(ui) - empty dashboards create button
* fix(ui): fix timeline position cursor for safari
* fix(ui) - custom metrics errors modal url reset on close
* fix(ui) - onboarding check for siteId
* change(ui) - tracker version
* Update local_deploy.sh
* fix(ui) - drilldown timestamp
* fix(tracker): fix deps for assist
* fix(tracker): update peerjs library
* fix(tracker): update assist v
* fix(tracker): fix type error
* fix(backend): no missing resource relying on resource zero-timing
* Update tracker to v3.5.15
* chore(helm): Adding CSP override variable.
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* feat(backend): added pem file support for kafka ssl setup
* feat(backend): added useBatch setup for kafka producer
* ci(backend): set verbose logging
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* fix(backend): using setKey instead of direct writes
* ci(backend): fix error code
* ci(deploy): Updating the image registry
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* feat(api): changed get user id alias
* ci(frontent): removing depricated steps
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* ci(fix): variable replace
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* ci(helm): creating image image_override
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
* fix(ui): fix timezone settings
* Added failover mechanism for storage service (#576 )
* fix(ui): fix typescript config to remove array iterator error
* fix(ui): refactor timezone settings store/comp
* feat(snippet): opensource snippet
* feat(assist): support multiple IPs
* fix(ui): fix type errors in select /timezones fix
* feat(backend): set size of first part of sessions at 500kb
* change(ui) - removed logs
* fix(ui) - custom metric errors reset url on modal close
* feat(DB): no funnel migration
* fix(ui): fix screensize bug
* feat(DB): migrate super old funnels support
* changed db-migration workflow
Co-authored-by: Shekar Siri <sshekarsiri@gmail.com>
Co-authored-by: sylenien <nikita@openreplay.com>
Co-authored-by: Alex Kaminskii <alex@openreplay.com>
Co-authored-by: Alexander <zavorotynskiy@pm.me>
Co-authored-by: rjshrjndrn <rjshrjndrn@gmail.com>
Co-authored-by: Mehdi Osman <estradino@users.noreply.github.com>
Co-authored-by: Alexander <alexander@openreplay.com>
Co-authored-by: Rajesh Rajendran <rjshrjndrn@users.noreply.github.com>
Co-authored-by: Delirium <sylenien@gmail.com>
2022-07-07 18:44:43 +02:00
ShiKhu
c9b1813e6a
feat/codefix(ee/backend): MAXPOL env & remove alerts
2022-04-15 20:31:01 +02:00
Taha Yassine Kraiem
72f2a96f31
parrot global changes
2022-04-04 14:09:49 +02:00
ShiKhu
c8872064ec
code(backend): use 1.18 time features
2022-04-01 19:43:46 +02:00
ShiKhu
8c97576970
codefix(backend): autoCommit as init consumer parameter
2022-03-30 18:27:33 +02:00
ShiKhu
5fea1fb785
fix(ee/kafka): restart worker after consumer timeout error
2022-03-30 13:13:50 +02:00
ShiKhu
ecbdfc27bb
fix(ee-backend): prepare clickhouse statement even on commit error
2022-02-15 19:56:36 +01:00
