Skip to main content

3 posts tagged with "Return of Experience"

View All Tags

Sandboxing LLM-generated code execution

· 13 min read
Xavier Blondel
Xavier Blondel
Engineering Manager Lead
Arthur Busser
Arthur Busser
Site Reliability Engineer
Romain Loisel
Romain Loisel
Security Engineer

Pigment provides a central AI platform to organizations for real-time business planning. Pigment AI is based on an agentic architecture that is described in more detail in this blog post.

One of our agents, the Analyst, already had multiple tools to perform simple calculations, such as contribution and variance analysis. In order to add more capabilities, we decided to leverage the code generation feature of LLMs rather than creating a dedicated tool for each capability.

LLM-generated code cannot be trusted by default. It is produced from user-controlled input, which means users may intentionally or accidentally steer the model toward unsafe behavior: reading sensitive data, calling internal services, exfiltrating data, pivoting into internal infrastructure, or exhausting compute resources. From a security perspective, the generated code has to be handled as an untrusted workload.

That requirement led us to build a sandboxed execution environment. In this article, we explain how we went from the initial risk analysis to a proof of concept, and eventually to a production-ready sandbox with support for large datasets.

Agentic AI for data analysis in Pigment

· 7 min read
Sergey Arsenyev
Sergey Arsenyev
Data Scientist

Agentic AI, in which one or multiple AI agents can pursue goals autonomously or collaboratively, represents a new frontier in generative AI. Unlike traditional large language models (LLMs) that operate independently, these systems combine specialized agents with unique roles to handle complex, open-ended tasks. Here, we’ll explore how Pigment uses this approach for data analysis, empowering clients to gain deeper insights.

The journey towards Tech Blog

· 4 min read
Nicolas Dubien
Nicolas Dubien
Software Engineer

Many mature companies publish their own technical blog. But have you ever wondered how to launch such an initiative as your company grows, when to do it, and how to make it real? This post describes how we spawned our first blog at Pigment and the various challenges and questions we addressed to reach that goal.