Migrating to Palo Alto Cortex XSIAM: Solving the "Getting Data In" Problem

Palo Alto's Cortex XSIAM is a genuinely impressive platform, converging SIEM, XDR, threat intel, and SOAR into a single analytics engine built around the Cortex Data Model (XDM). That ambition, however, creates a single point of failure: the data layer.

XSIAM's AI-driven detection engines depend entirely on well-normalized, schema-mapped inputs. In practice, getting dirty data into XSIAM correctly is a far harder engineering problem than most migration teams budget for.

The Mechanics of Ingestion: Where Migrations Stall

Understanding why data ingestion breaks down in XSIAM requires looking closely at how the platform accepts logs:

Multiple collection routes create operational drag

XSIAM doesn't use a unified ingestion path. Instead, it relies on a mix of Broker VMs (for syslog, WEC, databases, and flat files), endpoint agents, and an HTTP Log Collector. Because these mechanisms aren't interchangeable, mid-to-large environments inevitably end up managing a complex web of overlapping collection pipelines.

The parsing pipeline relies on guesswork

Standard ingestion routes accept CEF, LEEF, or JSON; Axoflow standardizes on LEEF, which XSIAM's internal parsers then try to map into XDM. While native parsers handle standard vendor logs reasonably well, custom or slightly off-spec sources often fail. Crucially, there is no direct way to hand pre-normalized XDM data straight to XSIAM through its default paths.

Schema drift creates quiet blind spots

A minor firmware update on a firewall or an updated field in a SaaS log can cause XSIAM's built-in parsers to silently drop or misclassify fields. Because the platform's machine-learning models rely on cross-telemetry correlation, quiet parsing failures degrade your overall detection capabilities without triggering an explicit system error.

Source-level reconfigurations don't scale

Default integrations expect specific input shapes. Reconfiguring log formats at the source in a large enterprise means touching thousands of endpoints, turning a platform migration into an endless operational task.

Broker VMs become infrastructure bottlenecks

Routing all legacy protocols through a Broker VM introduces extra network hops and makes data duplication difficult. If you plan to feed a secondary data lake or run parallel validation against an existing SIEM, the Broker VM quickly becomes a chokepoint.

How an Autonomous Data Layer Fixes the Pipeline

Rather than treating XSIAM as a generic log destination, Axoflow addresses the ingestion challenge directly at the network layer:

  • Standardizing on HTTP Ingestion: By leveraging XSIAM's HTTP Log Collector via high-throughput, batched LEEF streams, you bypass the need for Broker VMs while multiplexing logs from dozens of distinct vendors into a single efficient pipeline.
  • Upstream XDM Normalization: Instead of trusting native parsers to interpret raw events, data is normalized into XDM format before it hits XSIAM, guaranteeing events land correctly inside the schema.
  • Catching Drift Early: Validation happens inside the pipeline layer. When a log source updates its output format, the system flags the variance before it reaches XSIAM, preventing silent parsing drops.
  • Decoupled Transformations: Source systems simply send raw data to Axoflow. Any necessary schema transformations happen centrally, sparing your operations team from modifying individual endpoints.
  • Native Multi-Destination Routing: Curated telemetry streams can be multiplexed out to XSIAM, a legacy SIEM, and cold storage simultaneously, simplifying dual-run migration testing.
  • Schema Versatility: Axoflow can output raw LEEF, normalized XDM, or open formats like ECS and OCSF depending on what your downstream tools require.

Why Open Infrastructure Matters with Proprietary SIEMs

XSIAM is a powerful platform, but its native ingestion mechanics and data models are tightly controlled. Building your upstream collection on open standards keeps your overall security architecture flexible:

  • AxoSyslog (syslog-ng fork): Developed on GitHub by the original syslog-ng creators, this open-source core ensures your telemetry collection layer isn't tied to a single vendor's product roadmap.
  • Vendor-Neutral Schemas: Support for OCSF and ECS lets you build a standardized data layer that can feed data lakes, alternate analytics platforms, or legacy SIEMs alongside XSIAM.
  • OpenTelemetry Support: Instrument cloud workloads and applications using open industry protocols instead of proprietary agent software.
  • Auditable Transformation Logic: FilterX makes parsing and mapping rules explicitly visible, so your team can troubleshoot unmapped fields directly rather than waiting on vendor support tickets.

Migration Checklist

  • Map Ingestion Paths Early: Categorize every log source by its optimal collection path (Broker VM, Agent, or HTTP Collector) before writing migration rules.
  • Pre-Validate Parsing for High-Value Logs: Don't assume built-in parsers will handle non-standard logs; test core telemetry types against XDM early.
  • Filter Schema Drift at the Edge: Detect unmapped or modified fields at the pipeline layer rather than relying on SIEM alerts.
  • Transform Data Centrally: Keep log transformation logic inside the pipeline to avoid reconfiguring end devices.
  • Use Batched HTTP Streams: Maximize ingestion throughput and remove hardware bottlenecks by using HTTP collection where possible.
  • Dual-Ship Telemetry: Send live log streams to both your old SIEM and XSIAM simultaneously to validate detection rule parity.
  • Adopt Open Schemas: Use OCSF or ECS upstream to prevent lock-in to any single vendor's proprietary data model.
  • Keep Mappings Auditable: Maintain clear visibility over how every raw log field translates to its destination schema for compliance and debugging.

XSIAM expects high-quality inputs because it attempts to automate far more than traditional SIEMs. Placing an open, autonomous data layer in front of the platform ensures you get the real-time detection performance you paid for, without the continuous headache of broken ingestion pipelines.

Follow Our Progress!

We are excited to be realizing our vision above with a full Axoflow product suite.

Sign Me Up
This button is added to each code block on the live site, then its parent is removed from here.

Fighting data Loss?

Balázs Scheidler

Book a free 30-min consultation with syslog-ng creator Balázs Scheidler

Recent Posts

ASD's ACSC Best Practices for Event Logging and Threat Detection: What the 9-Country Advisory Means for Your SOC
Migrating Off IBM QRadar: A Security Architect's Guide to De-Risking the Move
Migrating Off Splunk: A Security Architect's Playbook for Breaking the Ingest-Cost Spiral