Commit graph

57 commits

Author SHA1 Message Date
rjshrjndrn
3bd2578c9c fix(helmcharts): clickhouse fix the configmap mount
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2025-05-27 16:40:05 +02:00
rjshrjndrn
408c3122d3 fix(clickhouse): update user config mount paths
Properly mount clickhouse user configuration files to the users.d
directory with correct paths for each file. Also adds several
performance-related settings to the default user profile including
query cache and JSON type support.

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2025-04-14 15:37:55 +02:00
rjshrjndrn
3272f5b9fd refactor(clickhouse): split server and user config
Split the ClickHouse configuration into separate ConfigMaps for server
and user configurations. This allows more granular management of the
different configuration types and proper mounting to their respective
paths.

- Created separate serverConfig and userConfig under configOverride
- Added user-default.xml under userConfig
- Updated StatefulSet to mount each ConfigMap separately

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2025-04-11 17:20:26 +02:00
rjshrjndrn
1b851a8b72 feat(clickhouse): add config override capability
Adds support for overriding ClickHouse server configurations by:
- Creating a new ConfigMap to store custom XML configurations
- Mounting the ConfigMap to ClickHouse pods under /etc/clickhouse-server/config.d
- Adding configOverride field to values.yaml with examples

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2025-04-09 16:36:04 +02:00
rjshrjndrn
346fd76ea8 chore(db): Update min CH version 2025-02-19 10:57:03 +01:00
rjshrjndrn
b70effa904 chore(helm): remove clickhouse resource requests
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2025-02-18 13:21:58 +01:00
rjshrjndrn
92c142ec33 chore(databases): Update postgresql to 17.2
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2025-02-05 12:36:44 +01:00
rjshrjndrn
e1b05dbd33 chore(helmcharts): Update database versions
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2025-02-05 12:36:44 +01:00
rjshrjndrn
5dbe313a68 Squashed commit of the following:
fix(helm): password
    remove: debug
    chore(helm): change helm hook to post upgrde, since pre-upgrde triggered
    before install
    fix(helm): remove default ns
    fix(helm): template number
    chore(helm): change trigger preference
    fix(helm): variable
    revert: disabling clickhouse pwd rotation, as CH not used
    chore(helm): trigger password update only if passwords are rotated
    chore(helm): Adding snippet for postgres/clickhouse secret rotation

    Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2024-11-25 18:37:06 +01:00
rjshrjndrn
c90236e598 chore(helm): Update db images.
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2024-10-30 19:36:32 +01:00
rjshrjndrn
a79a280f96 chore(helm): Upgrade postgres image to 16.3.0
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2024-09-04 08:50:51 +02:00
rjshrjndrn
39a8a03b3f chore(helm): upgrade postgres version
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2024-02-22 18:45:35 +01:00
rjshrjndrn
fb924ec305 fix(minio): wrong data path for minio
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2024-02-19 17:00:46 +01:00
rjshrjndrn
b11cf8a12c refactor(helm): remove duplicate code
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2024-02-02 18:24:00 +01:00
rjshrjndrn
d5372c13f5 chore(helm): Update image tags of dbs, to support arm
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-12-04 14:58:56 +01:00
Rajesh Rajendran
0cd7f68452 Create PR environment on PRs (#1671)
* refactor(helm): minio size limit to 5Gi
* feat(actions): pr-env action
* Adding pr-env configs
* Update PR env creation with latest requirements (#1658)
* fixesss
* fix pr env variable
* enble debugging
* Automatically take PR number from branch
* pr-env: taking open pr number only (#1669)
* pr-env: taking open pr number only
* enable ee cluster installation
* pr-env adding resource constraints
* pr-env: build and deploy applications

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-11-20 16:15:12 +01:00
Rajesh Rajendran
5bb0e8bc82 Changes for clickhouse compression (#1500)
* feat(helm): Update clickhouse image

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* chore(helm): disabling ch_compression for chalice

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

---------

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-10-04 19:51:45 +02:00
rjshrjndrn
4522947ceb fix(helm): kafka persistence variable
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-06-26 16:09:00 +02:00
Alexander
111d6a1b54
Azure support (#1270)
* feat(backend): implemented azure blob storage support

* feat(backend): added azure implementation to backend services

* feat(backend): added azure blob storage support to chalice service

* fix(backend): removed prev version of s3

* feat(backend): moved azure support to ee subfolder

* feat(backend): prepared ee code for new utils.objects package

* feat(backend): added missed modules to go.mod

* feat(backend): added missed modules to go.sum

* feat(backend): go mod tidy

* feat(backend): temporary made s3 vars are not required

* feat(backend): added azure lib to ee chalice

* feat(api): changed azure env var name

* feat(api): added new object store and extra methods to chalice ee

* fix(api): added azure blob lib to alerts

* fix(api): fixed incorrect call in sessions_devtool

* fix(crons): added azure blob storage library to requirements list

* chore(build): Error message for not providing flag.

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(backend): removed ios headers and object store for ios messages

* feat(backend): object config refactoring

* chore(helm): Update BUCKET_NAME

* fix(backend): removed object storage usage in http

* feat(backend): added debug logs to azure upload method

* fix(backend): fixed empty folder issue

* fix(backend): removed extra debug log

* chore(helm): Adding global variables for crons

* chore(helm): Remove clickhouse resource limit

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(backend): removed assets debug log

* feat(api): use ABC class instead of empty interface

* feat(api): renamed helpers to generators

* feat(api): changed prep/clean dev scripts

* feat(api): changed name obj_store -> StorageClient

* feat(api): some changes after code review

* fix(api): removed unnecesery packages in oss api

* feat(backend): moved azure implementation to ee folder

---------

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
Co-authored-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-06-08 13:31:54 +02:00
rjshrjndrn
e0f7522752 chore(helm): enablig pg_stat for metrics
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-05-16 14:36:19 +02:00
rjshrjndrn
dce19801b7 chore(helm): enable kafka jmx metrics
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-05-04 12:37:35 +02:00
rjshrjndrn
693449e739 chore(helm): Update kafka chart
Enable metrics and increased storage
2023-05-04 11:26:06 +02:00
Rajesh Rajendran
00e136f9cb Changing default encryption to false (#1161) 2023-05-02 10:57:13 +02:00
Rajesh Rajendran
db2ab0c91e
chore(helm): Adding ch backup env vars (#1004)
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-03-02 15:32:34 +01:00
rjshrjndrn
30efc6cfe5 chore(helm): 2 kafka replicas
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-02-21 11:56:19 +01:00
rjshrjndrn
2f2e84f9f6 chore(helm): Updating minio image
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-02-16 17:18:13 +01:00
rjshrjndrn
0759ec2888 chore(helm): Updating kafka chart 2023-02-13 16:31:24 +01:00
rjshrjndrn
f16d0870aa chore(helm): enable clickhouse access management
This is required to create user

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-02-10 18:30:04 +01:00
rjshrjndrn
d8565698d6 chore(helm): bump pdb version
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-02-10 17:39:04 +01:00
Rajesh Rajendran
93f27fe459
clickhouse password (#972)
* chore(helm): Adding clickhouse password
* chore(backend): Support clickhouse password
* chore(api): Adding clickhouse password support
* chore(helm): inject clickhouse password
* chore(helm): Updating clickhouse image
* fix(clickhouse): Removing duplicate country code

---------

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-02-08 18:47:32 +01:00
rjshrjndrn
c5828afaf3 feat(build): cherry-pick 2023-01-25 18:38:54 +01:00
rjshrjndrn
bed6b04a3f chore(helm): Update helm check for kube version 2023-01-25 11:27:51 +01:00
rjshrjndrn
2db89dc4d7 fix(helm): Select cron api based on kube api
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-01-24 19:52:21 +01:00
rjshrjndrn
a7f14a1512 chore(helm): upgrading kube api version for batch jobs 2023-01-23 14:42:42 +01:00
Rajesh Rajendran
53bf8eef07 fix(clickhouse): calling service name (#869)
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-12-12 04:19:06 +01:00
Rajesh Rajendran
4698075aa0
Make helm installation namespaces customizable (#836)
* chore(helm): Better configurability.

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* chore(init): Adding sleep 10 for resources to be up

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(helm): Updated env vars

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* chore(helm): Derive namespace from minio endpoint

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(helm): Update namespace for chalice env vars

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* chore(init): random secret for assist jwt secret

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* chore(backend): Removing unnecessary files

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-11-25 10:27:12 +00:00
rjshrjndrn
da55fa5f0d chore(helm): Adding vault chart
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-11-03 04:58:02 +01:00
Taha Yassine Kraiem
ad1b2b304b chore(helm): changed psql commands to stop on first-script-error 2022-10-27 16:36:38 +02:00
rjshrjndrn
b820cd648d chore(helm): show clickhouse backup status
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-10-26 21:48:23 +02:00
rjshrjndrn
ce6f524c79 chore(helm): Adding wait time before the upload starts
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-10-26 21:48:23 +02:00
rjshrjndrn
c5e8e2458e chore(helm): clickhouse backup path
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-10-26 21:48:23 +02:00
rjshrjndrn
1d9c26d8cd fix(helm): backup create command for clickhouse
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-10-26 17:16:06 +02:00
rjshrjndrn
9c3311cab5 chore(helm): clickhouse keep 2 backups in local
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-10-26 16:01:38 +02:00
rjshrjndrn
7bd7b37899 chore(helm): expose clickhouse backup port
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-10-26 15:56:32 +02:00
rjshrjndrn
cee236071f chore(helm): Adding backup cron for clickhouse
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-10-26 15:53:34 +02:00
rjshrjndrn
c67f22dfe5 chore(helm): Update backupenv vars 2022-10-25 19:17:49 +02:00
rjshrjndrn
657b903ec3 fix(helm): clickhouse backup env varialbe
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-10-25 17:19:02 +02:00
Rajesh Rajendran
8b9692faa8
Clickhouse Backup (#787)
* chore(helm): standalone clickhouse

* chore(helmcharts): blocking private endpoint

* chore(helm): clickhouse backup

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-10-25 15:16:51 +00:00
rjshrjndrn
469d9f74e8 chore(helm): Update clickhouse to 22.2.2.1
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-10-19 10:56:07 +02:00
rjshrjndrn
55893008b5 chore(helm): updating postgres and kafka 2022-09-15 09:29:07 +02:00