Generative AI Security Framework | Slides
ATTACK SURFACE
ATTACK SURFACE |
WHAT TO SECURE
WHAT TO SECURE |
ACTION PLAN
ACTION PLAN |
Generative AI Security Framework |
|
|
Verify LLM and AI Assistant Answers |
|
If you are using AI Assistant, you should cross check facts/number given by AI Assistant
Check in Vecor DB: If you are using Vector DB/RAG, you can check what value RAG provide. This will help to ensure that response generated by RAG is in line with value stored in vector DB. Use Second LLM: Other/aditional approach is you can ask a smaller question from second or same LLM and se what answer you get e.g. if there is 1 page of text and it says company Dataknobs has revenue of $78M, you can ask a smaller question "how much revneue Dataknobs has". However you need to consider additional cost of 2nd call? You may have more than one fact and multiple calls may be needed for each fact. Call to Search Engine: You can run a query on search engine programmatically and chec response. However depending on domain this result may or may not work. It may require parsing result from search engine. |
|
|
Action-plan Attack-surace Attack-surface Security-governance-framework What-to-secure