MogiKnightec Group
Thesis: Human-in-the-Loop Sanitization for Hybrid Local and Cloud LLM Agents under Data Sovereignty Constraints
On-siteFull-time
About the job
High Level Description Many Swedish public authorities cannot send sensitive information to cloud LLM services. At the same time, the hardware needed to run open models that come close to the leading cloud models on-premise is expensive, and the smaller models that are affordable to run locally are less capable. This thesis aims to investigate a hybrid setup where a small local model does the work and, when it gets stuck, asks a cloud model for help through an anonymizing step that a human approves. Nothing leaves the network until it has been sanitized and approved. Project Description In this thesis, investigate and build an escalation path from a local coding agent to a cloud LLM within...