Commit graph

453 commits

Author SHA1 Message Date
mauricio garcia suarez
8e563fb629 Merge branch 'connectors' 2022-08-25 12:20:36 +02:00
mauricio garcia suarez
846c167db3 added BatchMetadata and handle the new message format within it 2022-08-25 12:10:45 +02:00
mauricio garcia suarez
3381e3a081 New message with batchsize 2022-08-24 14:55:10 +02:00
mauricio garcia suarez
60adc62566 Merge branch 'quickwit-indexes' 2022-08-24 09:31:41 +02:00
mauricio garcia suarez
ec7e79a440 Merge branch 'connectors' 2022-08-23 16:10:20 +02:00
Taha Yassine Kraiem
29cdf9dccd feat(chalice): refactored assist configuration 2022-08-19 15:32:27 +01:00
Taha Yassine Kraiem
7bfe78a29a feat(assist): configurable LISTEN_PORT
feat(chalice): configurable LISTEN_PORT
feat(alerts): configurable LISTEN_PORT
2022-08-19 15:13:27 +01:00
mauricio garcia suarez
2c7235b768 uptodate 2022-08-10 14:37:35 +02:00
mauricio garcia suarez
dab72fbb38 snowflakes working 2022-08-10 12:23:42 +02:00
Taha Yassine Kraiem
d6a4f42066 feat(sourcemaps): fixed mapping file permissions 2022-08-09 13:44:11 +02:00
mauricio garcia suarez
ab06c5c8e3 added events detailed snowflakes 2022-08-09 10:40:14 +02:00
Taha Yassine Kraiem
210cfe8511 feat(chalice): PG-client unkeyed connexion 2022-08-08 19:42:45 +02:00
Kraiem Taha Yassine
cc73278f9a
Revert "v1.7.0 ES change" 2022-08-01 18:23:42 +02:00
Kraiem Taha Yassine
35eaf063a0
v1.7.0 ES change #649 2022-08-01 18:16:45 +02:00
Taha Yassine Kraiem
959d54be7e feat(chalice): fixed update self-user
feat(chalice): optimized /projects
2022-08-01 18:05:38 +02:00
mauricio garcia suarez
4ca07f4400 Changed type loaded from Fetch from i64 to bool 2022-08-01 14:48:15 +02:00
mauricio garcia suarez
1da78afa01 Add 'ee/quickwit/' from commit '2ad4f4ea124232274bc09ab1f1faf2581053e619'
git-subtree-dir: ee/quickwit
git-subtree-mainline: f1e4d60ea8
git-subtree-split: 2ad4f4ea12
2022-08-01 11:27:57 +02:00
Alexander
f1e4d60ea8 DB improvements (#647)
* feat(backend/db): updated ClickHouse library version from 1.5.4 to 2.2.0
* feat(backend/db): refactored ClickHouse connector
* feat(backend/db): rewritten batch implementation for ClickHouse inserts
* feat(backend/db): found and fix memory leak in db service
2022-07-29 09:23:27 +02:00
Taha Yassine Kraiem
976a7a5a03 feat(chalice): removed elasticsearch dependency 2022-07-27 18:48:58 +02:00
Taha Yassine Kraiem
bdfa17c95b feat(assist): support search operators
feat(chalice): support search operators for assist
2022-07-25 15:12:59 +02:00
Taha Yassine Kraiem
7d419225a0 feat(chalice): changed configuration
feat(crons): changed configuration
feat(alerts): changed configuration
2022-07-22 16:30:34 +02:00
mauricio garcia suarez
ee80c7c03f RedShift operational 2022-07-22 15:05:42 +02:00
rjshrjndrn
ff03c02e6d fix(chalice): user permission issue for geodb
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-07-21 09:19:14 +02:00
rjshrjndrn
591efd5a65 chore(docker): Run non root users for containers
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-07-20 22:15:58 +02:00
Taha Yassine Kraiem
ab800a40d7 feat(chalice): changed env-vars handling
feat(alerts): changed env-vars handling
feat(crons): changed env-vars handling
2022-07-20 15:24:29 +02:00
Taha Yassine Kraiem
7c0b1d7f3a feat(crons): changed weekly report 2022-07-20 14:58:43 +02:00
Taha Yassine Kraiem
1f2399d163 feat(chalice): changed Dockerfile
feat(alerts): changed Dockerfile
feat(crons): changed Dockerfile
2022-07-20 14:25:16 +02:00
rjshrjndrn
901d90b26e chore(docker): Updated docker base image
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-07-20 14:13:11 +02:00
Taha Yassine Kraiem
8ede1d906b feat(chalice): changed Dockerfile
feat(alerts): changed Dockerfile
feat(crons): changed Dockerfile
2022-07-20 13:33:16 +02:00
Taha Yassine Kraiem
4d11ddee77 feat(DB): changed autocomplete unique index 2022-07-20 13:30:12 +02:00
Taha Yassine Kraiem
fb3bbbc5c3 feat(chalice): api_key changes 2022-07-20 11:47:33 +02:00
mauricio garcia suarez
0b38f1dedb Updated types in BigQuery table 2022-07-20 10:56:17 +02:00
mauricio garcia suarez
7abe9f9680 Updated CH connector and event types 2022-07-20 10:54:53 +02:00
mauricio garcia suarez
f51b067ed8 Updated PG connector events 2022-07-19 11:19:17 +02:00
mauricio garcia suarez
de1977b0de Changed types of some messages and force type when pandas fails to recognize column type 2022-07-18 14:38:14 +02:00
mauricio garcia suarez
02cbeca771 deleted some prints 2022-07-15 17:15:56 +02:00
mauricio garcia suarez
b446147cb8 solved some minor issues 2022-07-15 17:12:22 +02:00
mauricio garcia suarez
eabc52b7a6 Fixed and updated detailed sessions 2022-07-15 17:06:11 +02:00
Kraiem Taha Yassine
b3efe61e95
v1.7.0 - hotfix (#611)
feat(chalice): fixed get null-duration-session
2022-07-15 14:51:57 +02:00
Kraiem Taha Yassine
d74a82383d
v1.7.0 enhanced (#606)
* feat(assist): changed Dockerfile

* feat(assist): changed Dockerfile

* feat(assist): changed Dockerfile

* feat(assist): changed lock file

* feat(assist): changed Dockerfile

* feat(chalice): return role name after update user

* feat(chalice): changed sessions search

* feat(chalice): changed sessions search

* feat(chalice): changed Dockerfile
feat(chalice): changed entrypoint
feat(alerts): changed Dockerfile
feat(alerts): changed entrypoint

* feat(assist): handle null uws payload

* feat(crons): fixed coroutine

* feat(chalice): optimize get projects
2022-07-13 22:40:29 +02:00
mauricio garcia suarez
fb42eded2c fixed minor issue consumer.py 2022-07-13 13:36:08 +02:00
mauricio garcia suarez
2e8f582bf7 consumer.py now working with new message types and BigQuery 2022-07-13 12:44:51 +02:00
mauricio garcia suarez
c271a0b64e Solved some properties issues 2022-07-13 12:39:55 +02:00
Kraiem Taha Yassine
dbd455ed0d
v1.7.0 enhanced (#598)
* feat(chalice): upgrades & refacotered image
* feat(alerts): upgrades & refacotered image
* feat(crons): upgrades & refacotered image
* feat(crons): changed build script
* feat(alerts): changed build script
* feat(crons): changed Dockerfile
* feat(alerts): changed shell interpreter
* feat(chalice): changed shell interpreter
* feat(crons): changed shell interpreter
* feat(alerts): changed Dockerfile
* feat(chalice): changed Dockerfile
* feat(crons): changed Dockerfile
* feat(chalice): include tenant_key
* feat(chalice): less imports
2022-07-12 22:16:23 +02:00
mauricio garcia suarez
d578f5e097 Updated messages methods. New values: - [x] IOSIssueEvent (111)
- [x] IOSBatchMeta (107)
- [x] IOSNetworkCall (105)
- [x] IOSPerformanceEvent (102)
- [x] IOSInputEvent (101)
- [x] IOSClickEvent (100)
- [x] IOSScreenEnter (98)
- [x] IOSCrash (97)
- [x] IOSScreenChanges (96)
- [x] IOSCustomEvent (93)
- [x] CreateIFrameDocument (70)
- [x] CSSInsertRuleURLBased (67)
- [x] AssetCache (66)
- [x] FetchEvent (51)
- [x] MouseClick (69) <- MouseClickDepricated (21)
2022-07-12 12:16:08 +02:00
Kraiem Taha Yassine
7055fb9a42
v1.7.0 hotfix (#591)
feat(api): check forwarded SSO path
2022-07-11 11:55:51 +02:00
Kraiem Taha Yassine
bb21df8b5f
v1.7.0 hot fixes
feat(api): fixed resources read time (#585)
feat(api): changed resources read time delta
2022-07-08 17:46:58 +02:00
Kraiem Taha Yassine
83420510ee
v1.7.0 hot fixes
feat(api): refactored s3 helper
feat(api): fixed s3 undefined tagging
2022-07-08 16:13:21 +02:00
Taha Yassine Kraiem
8fc1ec18d8 feat(DB): fixed missing type 2022-07-07 20:06:28 +02:00
Kraiem Taha Yassine
16c70044fb
Chore(release): v1.7.0 (#578)
* change(ui) - redirect to the landing url on SSO login

* fix(ui): fix share popup styles

* change(ui) - non admin user preference restrictions

* fix(ui) - redirect fix

* change(ui) - show installation btn without mouse hover

* feat(api): api-v1 handle wrong projectKey
feat(api): api-v1 get live sessions

* change(ui) - show role edit on hover

* change(ui) - audit trail count with comma

* fix(ui) - audit trail date range custom picker alignment

* change(ui) - show a message when mob file not found

* feat(api): api-v1 fixed search live sessions

* feat(api): api-v1 handle wrong projectKey

* feat(api): fixed assist error response

* fix(tracker): check node scrolls only on start

* fixup! fix(tracker): check node scrolls only on start

* feat(ui/player): scroll view in click map

* feat(ui/player): rm unused check

* New configuration module (#558)

* ci(dbmigrate): Create db migrate when there is change

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(ui): fix login error/button margins

* fix(ui) - checkbox click

* fix(ui) - search rename and save fixes

* change(ui) - text changes

* fix(ui) - button text nowrap

* fix(ui): fix slowestdomains widget height

* change(ui) - ignore clicks while annotating

* change(ui) - if block with braces

* change(ui) - capitalize first letter in breadcrumb

* feat(db): remove errors from permissions
feat(api): remove errors from permissions

* feat(api): changed reset password response

* fix(ui) - assist active tab list, broken after with new api changes (pagination)

* fix(ui) - assist active tab list, broken after with new api changes (pagination)

* change(ui) - search compare

* fix(ui): last fixes for 1.7

* fix(ui): fix timeline

* fix(ui): small code fixes

* fix(ui): remove unused

* feat(frontend/assist): show when client tab is inactive + fix reconnection status update

* fix(ui) - visibility settings

* feat(assist): refactored extractSessionInfo
feat(assist): hardcoded session's attributes

* Added snabbdom (JS)

* fix(tracker): version check works with x.x.x-beta versions

* fix(backend): keep the highest user's timestamp instead of the latest message timestamp for correct session duration value

* feat(backend/s3): added file tag RETENTION (#561)

* change(ui) - search optimization and autocomplete improvements

* feat(backend/assets): added new metrics assets_downloaded

* change(ui) - show back the date range in bookmarks since the api is filtering by daterange

* feat(backend-assets): custom headers for cacher requests

* chore(backend): no tidy in dockerfile (local build speed up)

* feat(backend/assets): added proxy support for cacher module

* feat(backend/storage): set retention env variable as not required

* fix(ui): fix jira issues

* ci(helm): use kubectl for deployment

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(tracker):3.5.13: performance improvements for a case of extensive dom

* fix(backend): added missed err var and continue statement

* ci(helm): forcing namespace

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(api): fixed slowest_domains query

* ci(helm): update helm deployment method

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* change(ui) - filter dropdown colros

* fix(ui) - speed index location avg attribute changed to value

* ci(api): enable kubectl apply

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(ui) - widget y axis label

* feat(api): fixed slowest_domains query

* chore(helm): Adding namespaces to all templates (#565)

* feat(api): assist type-autocomplete

* feat(api): assist global-autocomplete

* feat(sourcemaps): include wasm file in build

* feat(sourcemaps-reader): refactored

* fix(ui): fix data for funnels

* fix(ui): fix all sessions section margin

* fix(ui) - assist loader flag

* fix(ui) - assist loader flag

* fix(ui): fix weird check

* feat(api): autocomplete accept unsupported types

* feat(ui): migrate to yarn v3

* feat(ui): minor fixes for installment

* feat(ui): add typescript plugin to yarn

* chore(helm): Ability to override image registry

* chore(helm): Overriding openreplay docker registry

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(ui): fix control arrows on firefox

* feat(crons): EE crons

* feat(api): fixed build script

* feat(alerts): fixed build script

* feat(crons): fixed build script

* chore(helm): Updating cron version

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(crons): changes

* chore(helm): optional minio ingress

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(crons): fix build script
feat(alerts): fix build script

* Revert "chore(helm): Updating cron version"

This reverts commit 3ca190ea2f.

* feat(crons): fix build script

* feat(crons): fix Dockerfile

* feat(api): fixed metadata change-case

* change(ui) - remove capitalize for the meta value

* change(ui) - autocomplete improvements with custom textfield

* fix(tracker):3.5.13+:reuse metadata on internal-caused restarts

* fix(tracker-assist):3.5.13:send active:true on start; scroll behavior fix

* change(ui) - filters autocomplete blur on pressing Enter key

* fix(tracker): fix node v to lower

* fix(tracker): fix deps

* fix(tracker): fix deps

* fix(ui) - dashboard modal width

* change(ui) - filter dropdown overflow

* chore(helm): clickhouse reclaim polity to retain

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(tracker): fix engine max v

* fix(ui): load metadata in assist tab for sorting

* fix(ui): rm unneeded api call

* fix(tracker): build script to cjs

* change(ui) - removed sample data

* chore(tracker): remove upper node version limit

* Updating Beacon size

Beacon size should be <= QUEUE_MESSAGE_SIZE_LIMIT

* feat(crons): run 24/7
feat(alerts): support env-file override

* feat(api): changed EE env handler

* fix(ui): fix sessions search modal

* change(ui) - margin for error message

* change(ui) - disable assist sort when there are no meta options to choose

* chore(helm): Adding utilities service namespace

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(ui) - dashboard date range selection reload, metric not found message

* change(ui) - disable clearsearch in assist when there are no filters\

* feat(api): fixed EE env handler

* chore(helm): Adding migration namespaces

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(ui) - report logo path

* chore(helm): Removing unnecessary SA

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(api): changed EE env handler

* feat(api): changed EE env handler

* feat(api): changed EE env handler

* feat(api): changed EE env handler

* feat(crons): changed crons

* feat(api): accept wrong metric_id

* feat(crons): changed env handler
feat(api): changed env handler
feat(alerts): changed env handler

* feat(utilities): support old version of nodejs

* feat(crons): changed env handler
feat(api): changed env handler
feat(alerts): changed env handler

* fix(tracker): fix srcset tracking

* chore(build): Adding frontent

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(assist): changed general helper

* feat(assist): changed general helper

* fix(ui): fix widget pagination (#570)

* feat(crons): changed entrypoint

* feat(player): dev-log on skipping message

* fix(tracker): removeNode mutation priority over attributes

* fix(tracker): capture relative img timing;use startsWith instead of substr; codestyle fix

* chore(build): fixing api build script

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* chore(ci): faster deployment

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* change(ui) - assist list show active status

* chore(actions): option to build all/specific services in GH

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(ui) - slowest domain metric data as per the api changes

* ci(helm): updated variable name

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* ci(backend): cherrypick changes to ee

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(backend): disabled pprof in http service

* fix(ui) - TimeToRender avg value as per the API change

* fix(ui) - ResponseTimeDistribution avg value as per the API change

* fix(ui) - MemoryConsumption avg value as per the API change

* fix(ui) - ResponseTime avg value as per the API change

* fix(ui) - DomBuildTime avg value as per the API change

* fix(ui) - FrameRate avg value as per the API change

* chore(helm): proper default tag

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(backend): removed sensitive information from http logs

* ci(backend): adding default parameter value for workflow dispatch

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(backend): deleted empty file

* fix(actions): creating image source file prior

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(helm): variable substitution

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* change(ui) - project list item installation button text change

* fix(ui) - project create validation

* fix(backend): removed unsafe string logs in http service

* chore(kafka): Adding new topic

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(efs-cron): variable name

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(ui) - developer tools - hint links

* fix(ui) - session filters - country and platform dropdown values

* chore(helm): updating version

* chore(kafka): Update kafka default message size while provisioning

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(tracker): fix dependency security

* change(ui) - webhook delete confirmation

* change(ui) - assist url to handle when empty

* feat(api): autocomplete replace console with errors
feat(DB): clean extra files

* chore(helm): Adding cron jobs

* change(ui) - set changed flag to false after the metric delete to avoid prompt

* chore(helm): enbaling cron only for ee

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(api): autocomplete remove console

* change(ui) - removed Console filter type

* fix(ui) - timeline position

* fix(helm): RFC naming

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(ui): let user change project in dashboards and select default dashboard

* chore(helm): update registry url

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(DB): return pages_count to DB

* fix(ui) - account settings opt out checkbox

* fix(ui): fix modal width

* fix(ui) - explore circle bg

* fix(ui) - user name overlap

* fix(ui) - empty dashboards create button

* fix(ui): fix timeline position cursor for safari

* fix(ui) - custom metrics errors modal url reset on close

* fix(ui) - onboarding check for siteId

* change(ui) - tracker version

* Update local_deploy.sh

* fix(ui) - drilldown timestamp

* fix(tracker): fix deps for assist

* fix(tracker): update peerjs library

* fix(tracker): update assist v

* fix(tracker): fix type error

* fix(backend): no missing resource relying on resource zero-timing

* Update tracker to v3.5.15

* chore(helm): Adding CSP override variable.

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(backend): added pem file support for kafka ssl setup

* feat(backend): added useBatch setup for kafka producer

* ci(backend): set verbose logging

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(backend): using setKey instead of direct writes

* ci(backend): fix error code

* ci(deploy): Updating the image registry

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(api): changed get user id alias

* ci(frontent): removing depricated steps

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* ci(fix): variable replace

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* ci(helm): creating image image_override

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(ui): fix timezone settings

* Added failover mechanism for storage service (#576)

* fix(ui): fix typescript config to remove array iterator error

* fix(ui): refactor timezone settings store/comp

* feat(snippet): opensource snippet

* feat(assist): support multiple IPs

* fix(ui): fix type errors in select /timezones fix

* feat(backend): set size of first part of sessions at 500kb

* change(ui) - removed logs

* fix(ui) - custom metric errors reset url on modal close

* feat(DB): no funnel migration

* fix(ui): fix screensize bug

* feat(DB): migrate super old funnels support

* changed db-migration workflow

Co-authored-by: Shekar Siri <sshekarsiri@gmail.com>
Co-authored-by: sylenien <nikita@openreplay.com>
Co-authored-by: Alex Kaminskii <alex@openreplay.com>
Co-authored-by: Alexander <zavorotynskiy@pm.me>
Co-authored-by: rjshrjndrn <rjshrjndrn@gmail.com>
Co-authored-by: Mehdi Osman <estradino@users.noreply.github.com>
Co-authored-by: Alexander <alexander@openreplay.com>
Co-authored-by: Rajesh Rajendran <rjshrjndrn@users.noreply.github.com>
Co-authored-by: Delirium <sylenien@gmail.com>
2022-07-07 18:44:43 +02:00