openreplay/ee/quickwit
Delirium 35461acaf3
[WIP] Mobile replayer (#1452)
* fix(ui): fix up mobile recordings display

* fix(ui): some messages

* fix(ui): some messages

* fix(player): fix msg generation for ios messages

* feat(player): add generic mmanager interface for ios player impl

* feat(player): mobile player and message manager; touch manager; videoplayer

* feat(player): add iphone shells, add log panel,

* feat(player): detect ios sessions and inject correct player

* feat(player): move screen mapper to utils

* feat(player): events panel for mobile, map shell sizes to device type data,

* feat(player): added network tab to mobile player; unify network message (ios and web)

* feat(player): resize canvas up to phone screen size, fix capitalize util

* feat(player): some general changes to support mobile events and network entries

* feat(player): remove swipes from timeline

* feat(player): more stuff for list walker

* fix(ui): performance tab, mobile project typings and form

* fix(ui):some ui touches for ios replayer shell

* fix(ui): more fixes for ui, new onboarding screen for mobile projects

* feat(ui): mobile overview panel (xray)

* feat(ui): fixes for phone shell and tap events

* fix(tracker): change phone shells and sizes

* fix(tracker): fix border on replay screen

* feat(ui): use crashes from db to show in session

* feat(ui): use event name for xray

* feat(ui): some overall ui fixes

* feat(ui): IOS -> iOS

* feat(ui): change tags to ant d

* fix(ui): fast fix

* fix(ui): fix for capitalizer

* fix(ui): fix for browser display

* fix(ui): fix for note popup

* fix(ui): change exceptions display

* fix(ui): add click rage to ios xray

* fix(ui): some icons and resizing

* fix(ui): fix ios context menu overlay, fix console logs creation for ios

* feat(ui): added icons

* feat(ui): performance warnings

* feat(ui): performance warnings

* feat(ui): different styles

* feat(ui): rm debug true

* feat(ui): fix warnings display

* feat(ui): some styles for animation

* feat(ui): add some animations to warnings

* feat(ui): move perf warnings to performance graph

* feat(ui): hide/show warns dynamically

* feat(ui): new mobile touch animation

* fix(tracker): update msg for ios

* fix(ui): taprage fixes

* fix(ui): regenerate icons and messages

* fix(ui): fix msgs

* fix(backend): fix events gen

* fix(backend): fix userid msg
2023-10-27 12:12:09 +02:00
..
msgcodec [WIP] Mobile replayer (#1452) 2023-10-27 12:12:09 +02:00
.gitignore Add 'ee/quickwit/' from commit '2ad4f4ea124232274bc09ab1f1faf2581053e619' 2022-08-01 11:27:57 +02:00
clean.sh Add 'ee/quickwit/' from commit '2ad4f4ea124232274bc09ab1f1faf2581053e619' 2022-08-01 11:27:57 +02:00
consumer.py fix(quickwit): updated modules and solve s3 connection (#1524) 2023-10-19 09:16:36 -04:00
create_kafka_index.sh Add 'ee/quickwit/' from commit '2ad4f4ea124232274bc09ab1f1faf2581053e619' 2022-08-01 11:27:57 +02:00
create_sources.sh Add 'ee/quickwit/' from commit '2ad4f4ea124232274bc09ab1f1faf2581053e619' 2022-08-01 11:27:57 +02:00
Dockerfile fix(quickwit): updated modules and solve s3 connection (#1524) 2023-10-19 09:16:36 -04:00
entrypoint.sh fix(quickwit): updated modules and solve s3 connection (#1524) 2023-10-19 09:16:36 -04:00
index-config-fetch.yaml fix(quickwit): updated modules and solve s3 connection (#1524) 2023-10-19 09:16:36 -04:00
index-config-graphql.yaml fix(quickwit): updated modules and solve s3 connection (#1524) 2023-10-19 09:16:36 -04:00
index-config-pageevent.yaml fix(quickwit): updated modules and solve s3 connection (#1524) 2023-10-19 09:16:36 -04:00
kafka_sample.py Add 'ee/quickwit/' from commit '2ad4f4ea124232274bc09ab1f1faf2581053e619' 2022-08-01 11:27:57 +02:00
quickwit_start_task.sh fix(quickwit): updated modules and solve s3 connection (#1524) 2023-10-19 09:16:36 -04:00
README.md Add 'ee/quickwit/' from commit '2ad4f4ea124232274bc09ab1f1faf2581053e619' 2022-08-01 11:27:57 +02:00
requirements.txt fix(quickwit): updated modules and solve s3 connection (#1524) 2023-10-19 09:16:36 -04:00
run_quickwit.sh Add 'ee/quickwit/' from commit '2ad4f4ea124232274bc09ab1f1faf2581053e619' 2022-08-01 11:27:57 +02:00
s3-config-listen.yaml fix(quickwit): updated modules and solve s3 connection (#1524) 2023-10-19 09:16:36 -04:00
s3-config.yaml fix(quickwit): updated modules and solve s3 connection (#1524) 2023-10-19 09:16:36 -04:00
setup_indexes_and_worker.sh fix(quickwit): updated modules and solve s3 connection (#1524) 2023-10-19 09:16:36 -04:00
source-fetch.yaml Add 'ee/quickwit/' from commit '2ad4f4ea124232274bc09ab1f1faf2581053e619' 2022-08-01 11:27:57 +02:00
source-graphql.yaml Add 'ee/quickwit/' from commit '2ad4f4ea124232274bc09ab1f1faf2581053e619' 2022-08-01 11:27:57 +02:00
source-pageevent.yaml Add 'ee/quickwit/' from commit '2ad4f4ea124232274bc09ab1f1faf2581053e619' 2022-08-01 11:27:57 +02:00

Quickwit for kafka messages (S3 storage)

index

  1. Setup
  2. Deploy

Setup

This setup is made using Docker, make changes to the files accordingly to run it locally.

In order to connect to AWS S3 service the aws credentials must be defined in the environment

export aws_access_key_id={your_aws_access_key_id}
export aws_secret_access_key={your_aws_secret_access_key}
export aws_region={bucket_region}

In the file kafka-source.yaml replace the bootstap.server with the address of your kafka service and uncomment to activate ssl protocol if needed.

Deploy

To create the index 'quickwit-kafka' run the command:

bash create_kafka_index.sh

Having the topic 'quickwit-kafka' in the kafka server defined in the kafka-source.yaml, the connection between the created index and the topic can be achieved by running the command:

bash create_source.sh

To delete both the index and the source connection run the command:

bash clean.sh

To deploy the indexer, search and UI services run the command:

bash run_quickwit.sh

UI server will start at localhost:7280. The api can also be called through the url http://127.0.0.1:7280/api/v1/quickwit-kafka/search?query={your_query} for example

curl "http://127.0.0.1:7280/api/v1/quickwit-kafka/search?query=body:error"