Anomalous Process For a Windows Population

Searches for rare processes running on multiple hosts in an entire fleet or network. This reduces the detection of false positives since automated maintenance processes usually only run occasionally on a single machine but are common to all or many hosts in a fleet.

Elastic rule (View on GitHub)

  1[metadata]
  2creation_date = "2020/03/25"
  3integration = ["endpoint", "windows"]
  4maturity = "production"
  5updated_date = "2024/06/18"
  6
  7[transform]
  8[[transform.osquery]]
  9label = "Osquery - Retrieve DNS Cache"
 10query = "SELECT * FROM dns_cache"
 11
 12[[transform.osquery]]
 13label = "Osquery - Retrieve All Services"
 14query = "SELECT description, display_name, name, path, pid, service_type, start_type, status, user_account FROM services"
 15
 16[[transform.osquery]]
 17label = "Osquery - Retrieve Services Running on User Accounts"
 18query = """
 19SELECT description, display_name, name, path, pid, service_type, start_type, status, user_account FROM services WHERE
 20NOT (user_account LIKE '%LocalSyste' OR user_account LIKE '%LocalService' OR user_account LIKE '%NetworkService' OR
 21user_account == null)
 22"""
 23
 24[[transform.osquery]]
 25label = "Retrieve Service Unisgned Executables with Virustotal Link"
 26query = """
 27SELECT concat('https://www.virustotal.com/gui/file/', sha1) AS VtLink, name, description, start_type, status, pid,
 28services.path FROM services JOIN authenticode ON services.path = authenticode.path OR services.module_path =
 29authenticode.path JOIN hash ON services.path = hash.path WHERE authenticode.result != 'trusted'
 30"""
 31
 32
 33[rule]
 34anomaly_threshold = 50
 35author = ["Elastic"]
 36description = """
 37Searches for rare processes running on multiple hosts in an entire fleet or network. This reduces the detection of false
 38positives since automated maintenance processes usually only run occasionally on a single machine but are common to all
 39or many hosts in a fleet.
 40"""
 41false_positives = [
 42    """
 43    A newly installed program or one that runs rarely as part of a monthly or quarterly workflow could trigger this
 44    alert.
 45    """,
 46]
 47from = "now-45m"
 48interval = "15m"
 49license = "Elastic License v2"
 50machine_learning_job_id = ["v3_windows_anomalous_process_all_hosts"]
 51name = "Anomalous Process For a Windows Population"
 52setup = """## Setup
 53
 54This rule requires the installation of associated Machine Learning jobs, as well as data coming in from one of the following integrations:
 55- Elastic Defend
 56- Windows
 57
 58### Anomaly Detection Setup
 59
 60Once the rule is enabled, the associated Machine Learning job will start automatically. You can view the Machine Learning job linked under the "Definition" panel of the detection rule. If the job does not start due to an error, the issue must be resolved for the job to commence successfully. For more details on setting up anomaly detection jobs, refer to the [helper guide](https://www.elastic.co/guide/en/kibana/current/xpack-ml-anomalies.html).
 61
 62### Elastic Defend Integration Setup
 63Elastic Defend is integrated into the Elastic Agent using Fleet. Upon configuration, the integration allows the Elastic Agent to monitor events on your host and send data to the Elastic Security app.
 64
 65#### Prerequisite Requirements:
 66- Fleet is required for Elastic Defend.
 67- To configure Fleet Server refer to the [documentation](https://www.elastic.co/guide/en/fleet/current/fleet-server.html).
 68
 69#### The following steps should be executed in order to add the Elastic Defend integration to your system:
 70- Go to the Kibana home page and click "Add integrations".
 71- In the query bar, search for "Elastic Defend" and select the integration to see more details about it.
 72- Click "Add Elastic Defend".
 73- Configure the integration name and optionally add a description.
 74- Select the type of environment you want to protect, either "Traditional Endpoints" or "Cloud Workloads".
 75- Select a configuration preset. Each preset comes with different default settings for Elastic Agent, you can further customize these later by configuring the Elastic Defend integration policy. [Helper guide](https://www.elastic.co/guide/en/security/current/configure-endpoint-integration-policy.html).
 76- We suggest selecting "Complete EDR (Endpoint Detection and Response)" as a configuration setting, that provides "All events; all preventions"
 77- Enter a name for the agent policy in "New agent policy name". If other agent policies already exist, you can click the "Existing hosts" tab and select an existing policy instead.
 78For more details on Elastic Agent configuration settings, refer to the [helper guide](https://www.elastic.co/guide/en/fleet/current/agent-policy.html).
 79- Click "Save and Continue".
 80- To complete the integration, select "Add Elastic Agent to your hosts" and continue to the next section to install the Elastic Agent on your hosts.
 81For more details on Elastic Defend refer to the [helper guide](https://www.elastic.co/guide/en/security/current/install-endpoint.html).
 82
 83### Windows Integration Setup
 84The Windows integration allows you to monitor the Windows OS, services, applications, and more.
 85
 86#### The following steps should be executed in order to add the Elastic Agent System integration "windows" to your system:
 87- Go to the Kibana home page and click “Add integrations”.
 88- In the query bar, search for “Windows” and select the integration to see more details about it.
 89- Click “Add Windows”.
 90- Configure the integration name and optionally add a description.
 91- Review optional and advanced settings accordingly.
 92- Add the newly installed “windows” to an existing or a new agent policy, and deploy the agent on your system from which windows log files are desirable.
 93- Click “Save and Continue”.
 94- For more details on the integration refer to the [helper guide](https://docs.elastic.co/integrations/windows).
 95"""
 96note = """## Triage and analysis
 97
 98###  Investigating Anomalous Process For a Windows Population
 99
100Searching for abnormal Windows processes is a good methodology to find potentially malicious activity within a network. Understanding what is commonly run within an environment and developing baselines for legitimate activity can help uncover potential malware and suspicious behaviors.
101
102This rule uses a machine learning job to detect a Windows process that is rare and unusual for all of the monitored Windows hosts in your environment.
103
104> **Note**:
105> This investigation guide uses the [Osquery Markdown Plugin](https://www.elastic.co/guide/en/security/master/invest-guide-run-osquery.html) introduced in Elastic Stack version 8.5.0. Older Elastic Stack versions will display unrendered Markdown in this guide.
106
107#### Possible investigation steps
108
109- Investigate the process execution chain (parent process tree) for unknown processes. Examine their executable files for prevalence, whether they are located in expected locations, and if they are signed with valid digital signatures.
110  - If the parent process is a legitimate system utility or service, this could be related to software updates or system management. If the parent process is something user-facing like an Office application, this process could be more suspicious.
111  - Investigate the process metadata — such as the digital signature, directory, etc. — to obtain more context that can indicate whether the executable is associated with an expected software vendor or package.
112- Investigate other alerts associated with the user/host during the past 48 hours.
113- Consider the user as identified by the `user.name` field. Is this program part of an expected workflow for the user who ran this program on this host?
114- Validate the activity is not related to planned patches, updates, network administrator activity, or legitimate software installations.
115- Validate if the activity has a consistent cadence (for example, if it runs monthly or quarterly), as it could be part of a monthly or quarterly business process.
116- Examine the arguments and working directory of the process. These may provide indications as to the source of the program or the nature of the tasks it is performing.
117- Examine the host for derived artifacts that indicate suspicious activities:
118  - Analyze the process executable using a private sandboxed analysis system.
119  - Observe and collect information about the following activities in both the sandbox and the alert subject host:
120    - Attempts to contact external domains and addresses.
121      - Use the Elastic Defend network events to determine domains and addresses contacted by the subject process by filtering by the process' `process.entity_id`.
122      - Examine the DNS cache for suspicious or anomalous entries.
123        - $osquery_0
124    - Use the Elastic Defend registry events to examine registry keys accessed, modified, or created by the related processes in the process tree.
125    - Examine the host services for suspicious or anomalous entries.
126      - $osquery_1
127      - $osquery_2
128      - $osquery_3
129  - Retrieve the files' SHA-256 hash values using the PowerShell `Get-FileHash` cmdlet and search for the existence and reputation of the hashes in resources like VirusTotal, Hybrid-Analysis, CISCO Talos, Any.run, etc.
130
131### False Positive Analysis
132
133- If this activity is related to new benign software installation activity, consider adding exceptions — preferably with a combination of user and command line conditions.
134- Try to understand the context of the execution by thinking about the user, machine, or business purpose. A small number of endpoints, such as servers with unique software, might appear unusual but satisfy a specific business need.
135
136### Related Rules
137
138- Unusual Process For a Windows Host - 6d448b96-c922-4adb-b51c-b767f1ea5b76
139- Unusual Windows Path Activity - 445a342e-03fb-42d0-8656-0367eb2dead5
140- Unusual Windows Process Calling the Metadata Service - abae61a8-c560-4dbd-acca-1e1438bff36b
141
142### Response and Remediation
143
144- Initiate the incident response process based on the outcome of the triage.
145- Isolate the involved hosts to prevent further post-compromise behavior.
146- If the triage identified malware, search the environment for additional compromised hosts.
147  - Implement temporary network rules, procedures, and segmentation to contain the malware.
148  - Stop suspicious processes.
149  - Immediately block the identified indicators of compromise (IoCs).
150  - Inspect the affected systems for additional malware backdoors like reverse shells, reverse proxies, or droppers that attackers could use to reinfect the system.
151- Remove and block malicious artifacts identified during triage.
152- Investigate credential exposure on systems compromised or used by the attacker to ensure all compromised accounts are identified. Reset passwords for these accounts and other potentially compromised credentials, such as email, business systems, and web services.
153- Run a full antimalware scan. This may reveal additional artifacts left in the system, persistence mechanisms, and malware components.
154- Determine the initial vector abused by the attacker and take action to prevent reinfection through the same vector.
155- Using the incident response data, update logging and audit policies to improve the mean time to detect (MTTD) and the mean time to respond (MTTR).
156"""
157references = ["https://www.elastic.co/guide/en/security/current/prebuilt-ml-jobs.html"]
158risk_score = 21
159rule_id = "6e40d56f-5c0e-4ac6-aece-bee96645b172"
160severity = "low"
161tags = [
162    "Domain: Endpoint",
163    "OS: Windows",
164    "Use Case: Threat Detection",
165    "Rule Type: ML",
166    "Rule Type: Machine Learning",
167    "Tactic: Persistence",
168    "Tactic: Execution",
169]
170type = "machine_learning"
171[[rule.threat]]
172framework = "MITRE ATT&CK"
173[[rule.threat.technique]]
174id = "T1543"
175name = "Create or Modify System Process"
176reference = "https://attack.mitre.org/techniques/T1543/"
177
178
179[rule.threat.tactic]
180id = "TA0003"
181name = "Persistence"
182reference = "https://attack.mitre.org/tactics/TA0003/"
183[[rule.threat]]
184framework = "MITRE ATT&CK"
185[[rule.threat.technique]]
186id = "T1204"
187name = "User Execution"
188reference = "https://attack.mitre.org/techniques/T1204/"
189[[rule.threat.technique.subtechnique]]
190id = "T1204.002"
191name = "Malicious File"
192reference = "https://attack.mitre.org/techniques/T1204/002/"
193
194
195
196[rule.threat.tactic]
197id = "TA0002"
198name = "Execution"
199reference = "https://attack.mitre.org/tactics/TA0002/"

Triage and analysis

Investigating Anomalous Process For a Windows Population

Searching for abnormal Windows processes is a good methodology to find potentially malicious activity within a network. Understanding what is commonly run within an environment and developing baselines for legitimate activity can help uncover potential malware and suspicious behaviors.

This rule uses a machine learning job to detect a Windows process that is rare and unusual for all of the monitored Windows hosts in your environment.

Note: This investigation guide uses the Osquery Markdown Plugin introduced in Elastic Stack version 8.5.0. Older Elastic Stack versions will display unrendered Markdown in this guide.

Possible investigation steps

  • Investigate the process execution chain (parent process tree) for unknown processes. Examine their executable files for prevalence, whether they are located in expected locations, and if they are signed with valid digital signatures.
    • If the parent process is a legitimate system utility or service, this could be related to software updates or system management. If the parent process is something user-facing like an Office application, this process could be more suspicious.
    • Investigate the process metadata — such as the digital signature, directory, etc. — to obtain more context that can indicate whether the executable is associated with an expected software vendor or package.
  • Investigate other alerts associated with the user/host during the past 48 hours.
  • Consider the user as identified by the user.name field. Is this program part of an expected workflow for the user who ran this program on this host?
  • Validate the activity is not related to planned patches, updates, network administrator activity, or legitimate software installations.
  • Validate if the activity has a consistent cadence (for example, if it runs monthly or quarterly), as it could be part of a monthly or quarterly business process.
  • Examine the arguments and working directory of the process. These may provide indications as to the source of the program or the nature of the tasks it is performing.
  • Examine the host for derived artifacts that indicate suspicious activities:
    • Analyze the process executable using a private sandboxed analysis system.
    • Observe and collect information about the following activities in both the sandbox and the alert subject host:
      • Attempts to contact external domains and addresses.
        • Use the Elastic Defend network events to determine domains and addresses contacted by the subject process by filtering by the process' process.entity_id.
        • Examine the DNS cache for suspicious or anomalous entries.
          • $osquery_0
      • Use the Elastic Defend registry events to examine registry keys accessed, modified, or created by the related processes in the process tree.
      • Examine the host services for suspicious or anomalous entries.
        • $osquery_1
        • $osquery_2
        • $osquery_3
    • Retrieve the files' SHA-256 hash values using the PowerShell Get-FileHash cmdlet and search for the existence and reputation of the hashes in resources like VirusTotal, Hybrid-Analysis, CISCO Talos, Any.run, etc.

False Positive Analysis

  • If this activity is related to new benign software installation activity, consider adding exceptions — preferably with a combination of user and command line conditions.
  • Try to understand the context of the execution by thinking about the user, machine, or business purpose. A small number of endpoints, such as servers with unique software, might appear unusual but satisfy a specific business need.
  • Unusual Process For a Windows Host - 6d448b96-c922-4adb-b51c-b767f1ea5b76
  • Unusual Windows Path Activity - 445a342e-03fb-42d0-8656-0367eb2dead5
  • Unusual Windows Process Calling the Metadata Service - abae61a8-c560-4dbd-acca-1e1438bff36b

Response and Remediation

  • Initiate the incident response process based on the outcome of the triage.
  • Isolate the involved hosts to prevent further post-compromise behavior.
  • If the triage identified malware, search the environment for additional compromised hosts.
    • Implement temporary network rules, procedures, and segmentation to contain the malware.
    • Stop suspicious processes.
    • Immediately block the identified indicators of compromise (IoCs).
    • Inspect the affected systems for additional malware backdoors like reverse shells, reverse proxies, or droppers that attackers could use to reinfect the system.
  • Remove and block malicious artifacts identified during triage.
  • Investigate credential exposure on systems compromised or used by the attacker to ensure all compromised accounts are identified. Reset passwords for these accounts and other potentially compromised credentials, such as email, business systems, and web services.
  • Run a full antimalware scan. This may reveal additional artifacts left in the system, persistence mechanisms, and malware components.
  • Determine the initial vector abused by the attacker and take action to prevent reinfection through the same vector.
  • Using the incident response data, update logging and audit policies to improve the mean time to detect (MTTD) and the mean time to respond (MTTR).

References

Related rules

to-top