Forum Discussion

tejaskashyap's avatar
tejaskashyap
Icon for Microsoft rankMicrosoft
Jun 02, 2026

Understanding AI workloads on Linux

Hi everyone,

I’m a PM working on security for Linux environments and trying to better understand how AI workloads are actually showing up in production today.

Would appreciate hearing from folks here:

  • Are you running any AI workloads on Linux today? Or actively exploring?
  • What does your deployment/setup look like — e.g., model training/inference, agents, MCP servers, data pipelines, etc.?
  • How are you thinking about securing this stack, if at all?

If you’re open to a quick 30-min chat, I’d love to learn more from your experience as well.

Thanks in advance — this will directly help shape where we invest next.

1 Reply

  • Jamony's avatar
    Jamony
    MCT
    Jul 11, 2026

    Hi tejaskashyap, in the environments I usually see, AI workloads on Linux often show up as Python services, containerized inference APIs, GPU-enabled batch jobs, or Jupyter-style experimentation hosts. From a security angle, the common gaps are package provenance, exposed notebooks, weak secrets handling, and containers running with more privilege than needed. It would help admins if Defender surfaced GPU/process context, model-serving ports, container image lineage, and unusual package activity around ML frameworks.