SIEM
What Is SIEM? How It Works and How to Choose One
Logchase Security Team10 min read
SIEM (security information and event management) is software that collects logs and security events from across an IT environment, normalizes them into a common format and analyzes them in near real time to detect threats. It correlates related events, raises prioritized alerts and keeps searchable records for investigations, audits and compliance reporting.
What is SIEM?
SIEM is a security platform that turns scattered log data into detections and evidence. The name joins two older product categories: security information management (SIM), which focused on collecting and retaining log data, and security event management (SEM), which focused on real-time monitoring and alerting.
Every server, firewall, identity provider, endpoint agent and cloud service writes its own logs in its own format. On their own, those records rarely say much. A single failed login is noise; hundreds of failed logins against many accounts from one address, followed by a successful login, is a pattern worth an alert. A SIEM exists to see those patterns across sources that would otherwise be reviewed in isolation, if at all.
In practice, a SIEM platform does five jobs:
- Collect — receive logs from network devices, servers, applications, identity systems and cloud services over syslog, APIs, agents or file collection.
- Normalize — parse each format and map it to common fields such as user, source IP, host and action, so different products can be queried the same way.
- Detect — apply correlation rules, threat intelligence matches and behavioral analytics to find suspicious activity.
- Alert and investigate — raise prioritized alerts and give analysts the related events, users and assets in one place.
- Retain and report — keep logs searchable for investigations and produce evidence for audits.
NIST's Guide to Computer Security Log Management (SP 800-92) lists SIEM software as one type of log management infrastructure, next to syslog-based centralized logging. The distinction matters: a SIEM is not just a place where logs are stored, but a system that interprets them and tells you when something needs attention. It also gives incident responders and auditors one consistent record of what happened across systems.
How does SIEM work?
A SIEM works as a pipeline. It collects raw logs, parses and normalizes them, enriches them with context and evaluates them against detection logic; when a rule or model matches, it creates an alert that an analyst can investigate with all related events attached.
How a SIEM turns raw logs into an alert
- 1
Collect
Syslog, APIs, agents and file collection bring in events from every source.
- 2
Normalize
Parsers map vendor formats to common fields such as user, src_ip, host and action.
- 3
Enrich
Context is added: asset owner, location, threat intelligence matches.
- 4
Correlate
Rules link related events across sources and time windows.
- 5
Alert
Matches become prioritized alerts with a severity or risk score.
- 6
Investigate
Analysts review the timeline, related users and assets, and respond.
What correlation looks like
Correlation is what separates a SIEM from a search tool. A typical rule says: alert when one source IP produces five or more failed logins within 10 minutes, then a successful login for the same account, followed by that account being added to an administrators group. The events come from different systems (VPN gateway, identity provider, server) and none is alarming alone. Together they describe a brute-force attack that probably succeeded. In pseudocode:
rule failed_logins_then_success
when count(auth.failure) >= 5 by src_ip, user within 10m
then auth.success for same user within 30m
then group.member_added for same user
severity highOther detection methods sit alongside rules: thresholds and frequency counts, matches against threat intelligence feeds such as known malicious IP addresses or domains, and anomaly detection that flags deviations from a learned baseline, for example a login from a country the user has never logged in from. Good SIEMs also combine these signals into a risk score, so the alerts with the most evidence behind them rise to the top of the queue.
How is SIEM different from log management?
Log management collects, stores and searches logs; SIEM adds security analysis on top. Log management answers "what happened?" when you ask it, while a SIEM continuously watches for threats and tells you when something needs attention.
The two overlap heavily, and most SIEM platforms include a log management layer. The difference is in purpose and output. Log management is built for retention, troubleshooting and audit access: you collect everything, keep it for as long as policy requires and search it on demand. A SIEM is built for detection: it normalizes security-relevant data so rules can run across sources, and its output is alerts and investigations rather than search results.
| Capability | Log management | SIEM |
|---|---|---|
| Centralized collection | Yes | Yes |
| Normalization | Often basic | Required for cross-source rules |
| Search and retention | Core function | Included, often in tiers |
| Correlation across sources | Rare | Core function |
| Alerting and prioritization | Basic thresholds | Rules, risk scores, threat intelligence |
| Investigation workflow | Search results | Alerts, cases, timelines |
Many organizations start with centralized log management to meet retention and audit requirements, then add SIEM capabilities when they need detection. That order makes sense: correlation rules are only as good as the data under them, and a SIEM fed with incomplete or unparsed logs will miss attacks and still produce noise.
There is also a practical difference in what each one keeps. Log management usually stores everything, including verbose application and debug logs, because you cannot predict what a future investigation will need. A SIEM is often fed the security-relevant subset that drives detections, while the full archive stays in cheaper storage.
If you are still at the collection stage, our syslog server guide covers getting network device logs into one place, and the log retention guide covers how long to keep them.
How does SIEM fit into a SOC?
A security operations center (SOC) is the team and its processes; the SIEM is usually its central tool. Analysts use the SIEM to triage alerts, investigate incidents and hunt for threats, and its data feeds every later step of incident response.
Many SOCs organize work in tiers. First-line analysts triage incoming alerts and close false positives, more experienced analysts investigate confirmed incidents, and senior staff tune detections and hunt for threats that rules missed. All of them work from the same SIEM data, which is why alert quality matters so much: every noisy rule costs analyst time on every shift. Common SOC metrics, such as time to detect and time to respond, are also measured largely from SIEM data.
A SIEM supports the SOC workflow at each step:
- Detect — ingest and correlate events continuously.
- Investigate — pivot from an alert to related events, users, hosts and IP addresses.
- Prioritize — rank incidents by severity, asset criticality and risk indicators.
- Respond — assign the case, record notes and decisions, and hand off to containment and recovery.
NIST's incident response guidance, SP 800-61 Rev. 3 (2025), frames incident response within the NIST Cybersecurity Framework 2.0. In those terms, a SIEM mainly serves the Detect function (continuous monitoring and adverse event analysis) and supplies the evidence that Respond and Recover depend on. Mapping detections to MITRE ATT&CK techniques also shows a SOC which attacker behaviors it can and cannot detect.
What are common SIEM use cases?
The most common SIEM use cases are detecting account compromise, spotting malware and command-and-control traffic, catching privilege abuse and lateral movement, and producing audit evidence. Most organizations start with a small set of high-value detections and expand from there.
- Brute force and password spraying — many failed logins against one or many accounts, especially when followed by a success (MITRE ATT&CK T1110).
- Compromised accounts — valid credentials used from unusual locations, at unusual times or from new devices (T1078 Valid Accounts).
- Privilege escalation — users added to administrator groups, new privileged accounts, or sudo and policy changes outside a change window.
- Lateral movement — one account or host authenticating to many internal systems in a short period.
- Malware and command-and-control — outbound connections to IP addresses or domains listed in threat intelligence feeds, or unusual DNS activity.
- Ransomware precursors — security tools being stopped, backups being deleted, or mass file changes reported by file integrity monitoring (T1486).
- Insider activity — access outside working hours, or to systems and data unrelated to a user's role.
- Data exfiltration — unusually large outbound transfers, or access to sensitive data by accounts that do not normally touch it.
- Compliance and audit — retaining and reporting on access to cardholder data, personal data or critical systems for frameworks such as PCI DSS and ISO 27001.
A practical way to start is to pick five to ten use cases that match your biggest risks, confirm that you collect the logs each one needs, and measure how many alerts each produces per week. That keeps the SIEM focused on detections your team can actually act on, and it shows quickly which log sources are missing. Revisit the list as your environment and the threats against it change.
How do you choose a SIEM?
Choose a SIEM by testing it against your own log sources and use cases rather than feature lists. The deciding factors are usually source coverage, detection quality, investigation speed, deployment model, scalability and total cost of ownership.
- Source coverage — can it collect and parse every log source you depend on, and can you add custom parsers for in-house applications?
- Detection quality — how good are the built-in rules, how easy is it to write your own, and how many false positives do they produce on your data?
- Investigation — can an analyst go from an alert to related events, users and assets in a few clicks, and how fast are searches over long time ranges?
- Deployment — do you need cloud, self-hosted or both? Data residency and regulation often decide this.
- Scale and resilience — how does it handle peak event rates, long retention, high availability and disaster recovery?
- Integrity and compliance — can it prove that logs were not altered, for example with hashing and trusted timestamps?
- Cost model — is it priced by data volume, events per second, log sources or users, and how will that bill grow?
Run a proof of concept with real data from at least your firewalls, identity provider and critical servers, and replay a known attack scenario to see what the SIEM catches. Our guide to evaluating SIEM tools goes through each criterion in detail, including the questions to ask vendors, and open source vs commercial SIEM covers the build-or-buy decision.
To see how these pieces fit together in one product, the Logchase SIEM platform combines log collection, normalization, correlation rules, risk scoring, alerting and incident management, and runs in the cloud or self-hosted.
Sources
- NIST SP 800-92: Guide to Computer Security Log Management
- NIST SP 800-61 Rev. 3: Incident Response Recommendations and Considerations for Cybersecurity Risk Management
- CISA and partners: Guidance for SIEM and SOAR Implementation (2025)
- MITRE ATT&CK
- MITRE ATT&CK T1110: Brute Force
- MITRE ATT&CK T1078: Valid Accounts
- MITRE ATT&CK T1486: Data Encrypted for Impact
- PCI Security Standards Council: PCI DSS
Written by
Logchase Security Team
The engineers who build Logchase, working on log management, SIEM, threat detection and file integrity monitoring.
FAQ
Frequently asked questions
What does SIEM stand for?
SIEM stands for security information and event management. The name reflects its origins in two product categories: security information management (log collection and retention) and security event management (real-time monitoring and alerting).
Is SIEM the same as a SOC?
No. A SOC is a team and a set of processes for monitoring and responding to threats; a SIEM is a tool the SOC uses. Smaller organizations often run a SIEM without a dedicated SOC, sometimes with help from a managed security provider.
What is the difference between SIEM and SOAR?
A SIEM detects and prioritizes threats from log data. SOAR (security orchestration, automation and response) automates the steps that follow, such as enriching an alert, blocking an IP address or opening a ticket, using predefined playbooks. Many teams use the two together.
Which logs should go into a SIEM first?
Start with sources that cover authentication and the network edge: identity providers and domain controllers, firewalls and VPN gateways, critical servers and endpoint security tools. Joint guidance from CISA and Australia's ACSC includes a dedicated document on prioritizing log sources for SIEM ingestion.
Can a small company use a SIEM?
Yes, if the scope is realistic. A smaller deployment with a handful of high-value log sources and well-tuned rules is more useful than a large one that nobody reviews. Cloud-hosted SIEMs and managed services reduce the infrastructure work, and starting with a few clear use cases keeps the effort manageable.
Does a SIEM help with compliance?
Yes. Frameworks such as PCI DSS and ISO 27001 expect organizations to log security events, review them and keep them for a defined period. A SIEM supports those processes with central retention, reporting and alerting, but compliance also depends on policies and controls outside the tool.
Related articles
SIEM
SIEM Tools: How to Evaluate a SIEM Platform
How to evaluate SIEM tools: log source coverage, correlation and detection, scale, cloud vs self-hosted deployment, pricing models and questions for vendors.
SIEM
Open Source SIEM vs Commercial SIEM
Open source SIEM or commercial SIEM software? Compare total cost, detection content, scaling, support and compliance, and see when each one fits.
File integrity monitoring
File Integrity Monitoring Tools: What to Look For
What file integrity monitoring is and what to look for in FIM software: hashing, diffs, user and process context, Linux and Windows support, SIEM integration.