91921d622e
* Updated pg connector * fix(player): fix first 8 byte checker * fix(player): fix commit conflict * Added pylint * Removed pylint for incompatible license * change(ui): check for sessions records state * Patch/api v1.12.0 (#1299) * fix(chalice): include metadata in sessions exp search * fix(chalice): fixed sessions exp search wrong col name * fix(chalice): removed cookies * fix(chalice): changed base image to support SSO/xmlsec * fix(chalice): changed Dockerfile to support SSO/xmlsec * fix(chalice): changed Dockerfile to support SSO/xmlsec (cherry picked from commit4b8cf9742c) * fix(ui): project fallback to recorded variable * Patch/api v1.12.0 (#1301) * fix(chalice): changed base image to support SSO/xmlsec * fix(chalice): fixed exp search null metadata (cherry picked from commitab000751d2) * change(ui): assist no content message styles and icons * change(ui): revert menu disable * fix(connector): Added method to save state in s3 for redshift if sigterm arise * Rewriting python code in cython * Added pyx module for messages * Auto create pyx files * Updated and fixed msgcodec.pyx * Added new module to connector code * Updated kafka lib for base image * cleaned Docker and updated base image version for pandas * cleaned prints * Added code to fetch data from db and add it into redshift * Updated consumer reading method. Async multithreading over sessionId * Added split for country (Country,State,City) * Fixed decoding issue for uint * Created service able to fix data from redshift by reading from db * Handle when process ended because of lost connection to pg, country set to country value only
23 lines
721 B
Text
23 lines
721 B
Text
FROM redshift_connector_base
|
|
|
|
ENV CLOUD_SERVICE=redshift \
|
|
CONNECTION_STRING=postgresql+psycopg2://{USER}:{PASSWORD}@{HOST}:{PORT}/{DBNAME} \
|
|
# Keep postgres connection
|
|
PG_MINCONN=3 \
|
|
PG_MAXCONN=10
|
|
RUN apk add --no-cache postgresql-libs lz4-libs zstd-libs
|
|
COPY deploy/requirements_redshift.txt .
|
|
COPY msgcodec msgcodec
|
|
COPY build_modules.sh .
|
|
RUN apk add --no-cache --virtual .build-deps gcc g++ musl-dev postgresql-dev && \
|
|
./build_modules.sh && python3 -m pip install -r requirements_redshift.txt --no-cache-dir && \
|
|
apk --purge del .build-deps
|
|
COPY utils utils
|
|
COPY db db
|
|
COPY sql sql
|
|
COPY handler.py .
|
|
COPY consumer_async.py .
|
|
COPY fill_from_db.py .
|
|
COPY entrypoint.sh .
|
|
|
|
ENTRYPOINT ./entrypoint.sh
|