16efb1316c
* feature(intelligent-search): Added API to connect to Llama.cpp in EC2 and filter the response into OR filters * updated sql to filter script and added init.sql for tables * feature(intelligent-search): Changed llama.cpp for llama in GPU now contained in API * Updated Dockerfile to use GPU and download LLM from S3 * Added link to facebook/research/llama * Updated Dockerfile * Updated requirements and Dockerfile base images * fixed minor issues: Not used variables, updated COPY and replace values * fix(intelligent-search): Fixed WHERE statement filter * feature(smart-charts): Added method to create charts using llama. style(intelligent-search): Changed names for attributes to match frontend format. fix(intelligent-search): Fixed vulnerability in requiments and small issues fix * Added some test before deploying the service * Added semaphore to handle concurrency --------- Co-authored-by: EC2 Default User <ec2-user@ip-10-0-2-226.eu-central-1.compute.internal>
227 lines
14 KiB
Python
227 lines
14 KiB
Python
search_context = """Llama_AI is a programmer that translates text from [[USER_NAME]] into filters for a searching bar. The filters are Click, Text_Input, Visited_URL, Custom_Events, Network_Request, GraphQL, State_Action, Error_Message, Issue, User_OS, User_Browser, User_Device, Platform, Version_ID, Referrer, Duration, User_Country, User_City, User_State, User_Id, User_Anonymous_Id, DOM_Complete, Larges_Contentful_Paint, Time_to_First_Byte, Avg_CPU_Load, Avg_Memory_Usage, Failed_Request and Plan.
|
|
* Click is a string whose value X means that during the session the user clicked in the X
|
|
* Text_Input is a string whose value X means that during the sessions the user typed X
|
|
* Visited_URL is a string whose value X means that the user X visited the url path X
|
|
* Custom_Events is a string whose value X means that this event happened during the session
|
|
* Network_Request is a dictionary that contains an url, status_code, method and duration
|
|
* GraphQL is a dictionary that contains a name, a method, a request_body and a response_body
|
|
* State_Action is a integer
|
|
* Error Message is a string representing the error that arised in the session
|
|
* Referrer is a string representing the url that refered to the current site
|
|
* Duration is an integer representing the lenght of the session in minutes
|
|
* User_Country is a string representing the Country of the session
|
|
* User_City is a string representing the City of the session
|
|
* User_State is a string representing the State of the City where the session was recorded
|
|
* User_Id is a string representing the id of the user
|
|
* User_AnonymousId is a string representing the anonymous id of the user
|
|
* DOM_Complete is a tuple (integer, string) representing the time to render the url and the url string
|
|
* Largest_Contentful_Paint is a tuple (integer, string) representing the time to load the heaviest content and the url string
|
|
* Time_to_First_Byte is a tuple (integer, string) representing the time to get the first response byte from url and the url string
|
|
* Avg_CPU_Load is a tuple (integer, string) representing the porcentage of average cpu load in the url and the url string
|
|
* Avg_Memory_Usage is a tuple (integer, string) representing the porcentage of average memory usage in the url and the url string
|
|
* Failed_Request is a string representing an url that had a Failed Request event
|
|
* Plan is a string that could be 'pay_as_you_go', 'trial', 'free', 'enterprise'
|
|
The expected response should be a SQL query that contains the text from [[USER_NAME]] translated into conditions in the WHERE clause. All [[USER_NAME]] requests must be answered only with a SQL request assuming the table name will be sessions.
|
|
{user_question}
|
|
"""
|
|
|
|
search_context_v2 = """[[AI_BOT]]: We have a SQL table called sessions that contains the columns: Click, Text_Input, Visited_URL, Custom_Events, Network_Request, GraphQL, State_Action, Error_Message, Issue, User_OS, User_Browser, User_Device, Platform, Version_ID, Referrer, Duration, User_Country, User_City, User_State, User_Id, User_Anonymous_Id, DOM_Complete, Larges_Contentful_Paint, Time_to_First_Byte, Avg_CPU_Load, Avg_Memory_Usage, Failed_Request and Plan.
|
|
[[USER]]: What is the attribute of the Click column?
|
|
[[AI_BOT]]: Click is a string whose value X means that during the session the user clicked in the X
|
|
[[USER]]: What's the attribute of Text_Input?
|
|
[[AI_BOT]]: Text_Input is a string whose value X means that during the sessions the user typed X
|
|
[[USER]]: What's the attribute of Visited_URL?
|
|
[[AI_BOT]]: Visited_URL is a string whose value X means that the user X visited the url path X
|
|
[[USER]]: What's the attribute of Custom_Events?
|
|
[[AI_BOT]]: Custom_Events is a string whose value X means that this event happened during the session
|
|
[[USER]]: What's the attribute of Network_Request?
|
|
[[AI_BOT]]: Network_Request is a dictionary that contains an url, status_code, method and duration
|
|
[[USER]]: What's the attribute of GraphQL
|
|
[[AI_BOT]]: GraphQL is a dictionary that contains a name, a method, a request_body and a response_body
|
|
[[USER]]: What's the attribute of State_Action?
|
|
[[AI_BOT]]: State_Action is a integer
|
|
[[USER]]: What's the attribute of Error_Message?
|
|
[[AI_BOT]]: Error_Message is a string representing the error that arised in the session
|
|
[[USER]]: What's the attribute of Referrer?
|
|
[[AI_BOT]]: Referrer is a string representing the url that refered to the current site
|
|
[[USER]]: What's the attribute of Duration?
|
|
[[AI_BOT]]: Duration is an integer representing the lenght of the session in minutes
|
|
[[USER]]: What's the attribute of User_Country?
|
|
[[AI_BOT]]: User_Country is a string representing the Country of the session
|
|
[[USER]]: What's the attribute of User_City?
|
|
[[AI_BOT]]: User_City is a string representing the City of the session
|
|
[[USER]]: What's the attribute of User_State?
|
|
[[AI_BOT]]: User_State is a string representing the State of City where the session was recorded
|
|
[[USER]]: What's the attribute of User_Id?
|
|
[[AI_BOT]]: User_Id is a string representing the id of the user
|
|
[[USER]]: What's the attribute of User_AnonymousId?
|
|
[[AI_BOT]]: User_AnonymousId is a string representing the anonymous id of the user
|
|
[[USER]]: What's the attribute of DOM_Complete?
|
|
[[AI_BOT]]: DOM_Complete is a tuple (integer, string) representing the time to render the url and the url string
|
|
[[USER]]: What's the attribute of Largest_Contentful_Paint?
|
|
[[AI_BOT]]: Largest_Contentful_Paint is a tuple (integer, string) representing the time to load the heaviest content and the url string
|
|
[[USER]]: What's the attribute of
|
|
[[AI_BOT]]: Time_to_First_Byte is a tuple (integer, string) representing the time to get the first response byte from url and the url string
|
|
[[USER]]: What's the attribute of Avg_CPU_Load?
|
|
[[AI_BOT]]: Avg_CPU_Load is a tuple (integer, string) representing the porcentage of average cpu load in the url and the url string
|
|
[[USER]]: What's the attribute of Avg_Memory_Usage?
|
|
[[AI_BOT]]: Avg_Memory_Usage is a tuple (integer, string) representing the porcentage of average memory usage in the url and the url string
|
|
[[USER]]: What's the attribute of Failed_Request?
|
|
[[AI_BOT]]: Failed_Request is a string representing an url that had a Failed Request event
|
|
[[USER]]: What's the attribute of Plan?
|
|
[[AI_BOT]]: Plan is a string that could be 'pay_as_you_go', 'trial', 'free', 'enterprise'
|
|
[[USER]]: Can you translate the following text into SQL query: {user_question}
|
|
[[AI_BOT]]:
|
|
"""
|
|
|
|
search_context_v3 = """We have a SQL table called sessions that contains the columns: Click, textInput, visitedUrl, customEvents, networkRequest->url, networkRequest->statusCode, networkRequest->method, networkRequest->duration, graphql->name, graphql->method, graphql->requestBody, graphql->responseBody, stateAction, errorMessage, issue, userOs, userBrowser, userDevice, platform, versionId, referrer, duration, userCountry, userCity, userState, userId, userAnonymousId, domComplete->time_to_render, domComplete->url, largesContentfulPaint->timeToLoad, largestContentfulPaint->url, timeToFirstByte->timeToLoad, timeToFirst_Byte->url, avgCpuLoad->percentage, avgCpuLoad->url, avgMemoryUsage->percentage, avgMemoryUsage->url, failedRequest->name and plan.
|
|
[[USER]]: What is the attribute of the click column?
|
|
[[AI_BOT]]: Click is a string whose value X means that during the session the user clicked in the X
|
|
[[USER]]: What's the attribute of textInput?
|
|
[[AI_BOT]]: textInput is a string whose value X means that during the sessions the user typed X
|
|
[[USER]]: What's the attribute of visitedUrl?
|
|
[[AI_BOT]]: visitedUrl is a string whose value X means that the user X visited the url path X
|
|
[[USER]]: What's the attribute of customEvents?
|
|
[[AI_BOT]]: customEvents is a string whose value X means that this event happened during the session
|
|
[[USER]]: What's the attribute of networkRequest?
|
|
[[AI_BOT]]: networkRequest->url is the requested url, networkRequest->statusCode is the status of the request, networkRequest->method is the request method and networkRequest->duration is the duration of the request in miliseconds.
|
|
[[USER]]: What's the attribute of graphql
|
|
[[AI_BOT]]: graphql->name is the name of the graphql event, graphql->method is the graphql method, graphql->requestBody is the request payload and graphql->responseBody is the response
|
|
[[USER]]: What's the attribute of stateAction?
|
|
[[AI_BOT]]: stateAction is a integer
|
|
[[USER]]: What's the attribute of errorMessage?
|
|
[[AI_BOT]]: errorMessage is a string representing the error that arised in the session
|
|
[[USER]]: What's the attribute of referrer?
|
|
[[AI_BOT]]: referrer is a string representing the url that refered to the current site
|
|
[[USER]]: What's the attribute of duration?
|
|
[[AI_BOT]]: duration is an integer representing the lenght of the session in minutes
|
|
[[USER]]: What's the attribute of userCountry?
|
|
[[AI_BOT]]: userCountry is a string representing the Country of the session
|
|
[[USER]]: What's the attribute of userCity?
|
|
[[AI_BOT]]: userCity is a string representing the City of the session
|
|
[[USER]]: What's the attribute of userState?
|
|
[[AI_BOT]]: userState is a string representing the State of City where the session was recorded
|
|
[[USER]]: What's the attribute of userId?
|
|
[[AI_BOT]]: userId is a string representing the id of the user
|
|
[[USER]]: What's the attribute of userAnonymousId?
|
|
[[AI_BOT]]: userAnonymousId is a string representing the anonymous id of the user
|
|
[[USER]]: What's the attribute of domComplete?
|
|
[[AI_BOT]]: domComplete->timeToRender is the time to render the url in miliseconds and domComplete->url is the rendered url
|
|
[[USER]]: What's the attribute of largestContentfulPaint?
|
|
[[AI_BOT]]: largestContentfulPaint->timeToLoad is the time to load the heaviest content in miliseconds and largestContentfulPaint is the contents url
|
|
[[USER]]: What's the attribute of timeToFirstByte?
|
|
[[AI_BOT]]: timeToFirstByte->timeToLoad is the time to get the first response byte from url in miliseconds and timeToFirstByte->url is the url
|
|
[[USER]]: What's the attribute of avgCpuLoad?
|
|
[[AI_BOT]]: avgCpuLoad->percentage is an integer representing the porcentage of average cpu load in the url and avgCpuLoad->url is the url
|
|
[[USER]]: What's the attribute of avgMemoryUsage?
|
|
[[AI_BOT]]: avgMemoryUsage->percentage is the porcentage of average memory usage in the url and the avgMemoryUsage->url is the url
|
|
[[USER]]: What's the attribute of failedRequest?
|
|
[[AI_BOT]]: failedRequest->name is a string representing an url that had a Failed Request event
|
|
[[USER]]: What's the attribute of plan?
|
|
[[AI_BOT]]: Plan is a string that could be 'payAsYouGo', 'trial', 'free', 'enterprise'
|
|
[[USER]]: Can you translate the following text into SQL query: {user_question}
|
|
[[AI_BOT]]:"""
|
|
|
|
search_context_v4 = """We have a database working with GraphQL, the type system is the following:
|
|
type Click (name: String)
|
|
type Text_Input (value: String)
|
|
type Visited_URL (url: String)
|
|
type Custom_Events (name: String)
|
|
type Network Request (url: String, status_code: Int, method: String, duration: Int)
|
|
type GraphQL (name: String, method: String, request_body: String, response_body: String)
|
|
type State_Action (value: Int)
|
|
type Error_Message (name: String)
|
|
type Issue (name: String)
|
|
type User_OS (name: String)
|
|
type User_Browser (name: String)
|
|
type User_Device (name: String)
|
|
type Platform (name: String)
|
|
type Version_ID (name: String)
|
|
type Referrer (url: String)
|
|
type Duration (value: Int)
|
|
type User_Country (name: String)
|
|
type User_City (name: String)
|
|
type User_State (name: String)
|
|
type User_Id (name: String)
|
|
type User_Anonymous_Id (name: String)
|
|
type DOM_Complete (time_to_render: Int, url: String)
|
|
type Largest_Contentful_Paint (time_to_load: Int, url: String)
|
|
type Time_to_First_Byte (time_to_load: Int, url: String)
|
|
type Avg_Memory_Usage (percentage: Int, url: String)
|
|
type Avg_Memory_Usage (percentage: Int, url: String)
|
|
type Failed_Request (name: String)
|
|
type Plan (name: String)
|
|
[[USER]]: Get all session from India which has 5 minutes length
|
|
[[AI_BOT]]: ```[
|
|
(
|
|
"value": [],
|
|
"type": "User_Country",
|
|
"operator": "is",
|
|
"isEvent": true,
|
|
"filters": [
|
|
(
|
|
"value": ["India"],
|
|
"type": "name",
|
|
"operator": "=",
|
|
"filters": []
|
|
)
|
|
]
|
|
),
|
|
(
|
|
"value": [300], // 5 minutes in seconds (5 * 60)
|
|
"type": "Duration",
|
|
"operator": "=",
|
|
"filters": [
|
|
(
|
|
"value": [],
|
|
"type": "value",
|
|
"operator": "=",
|
|
"filters": []
|
|
)
|
|
]
|
|
)
|
|
]```
|
|
[[USER]]: How can I see all the sessions from the free plan that had a cpu load of under 30% in the /watchagain/film url?
|
|
[[AI_BOT]]: ```[
|
|
(
|
|
"value": [],
|
|
"type": "Plan",
|
|
"operator": "is",
|
|
"filters": [
|
|
(
|
|
"value": ["free"],
|
|
"type": "name",
|
|
"operator": "=",
|
|
"filters": []
|
|
)
|
|
]
|
|
),
|
|
(
|
|
"value": [],
|
|
"type": "Avg_Memory_Usage",
|
|
"operator": "<",
|
|
"filters": [
|
|
(
|
|
"value": ["30"],
|
|
"type": "percentage",
|
|
"operator": "<",
|
|
"filters": []
|
|
)
|
|
]
|
|
),
|
|
(
|
|
"value": [],
|
|
"type": "Network Request",
|
|
"operator": "is",
|
|
"filters": [
|
|
(
|
|
"value": ["/watchagain/film"],
|
|
"type": "url",
|
|
"operator": "=",
|
|
"filters": []
|
|
)
|
|
]
|
|
)
|
|
]```
|
|
[[USER]]: Can you translate the following text into a GraphQL request to database: {user_question}
|
|
[[AI_BOT]]:""" # Using GraphQL form to create filters in json format
|