Splunk is one of the leading SIEM solutions in the market that provides the ability to collect, analyze and correlate the network and machine logs in real-time. In this room, we will explore the basics of Splunk and its functionalities and how it provides better visibility of network activities and help in speeding up the detection.
Learning Objective and Pre-requisites
If you are new to SIEM, please complete the Introduction to SIEM. This room covers the following learning objectives:
- Splunk overview
- Splunk components and how they work
- Different ways to ingest logs
- Normalization of logs
Deploy Machine and connect to IP via browser
Splunk has three main components, namely Forwarder, Indexer, and Search Head. These components are explained below:
Splunk Forwarder
Splunk Forwarder is a lightweight agent installed on the endpoint intended to be monitored, and its main task is to collect the data and send it to the Splunk instance. It does not affect the endpoint’s performance as it takes very few resources to process. Some of the key data sources are:
- Web server generating web traffic.
- Windows machine generating Windows Event Logs, PowerShell, and Sysmon data.
- Linux host generating host-centric logs.
- Database generating DB connection requests, responses, and errors.
Splunk Indexer
Splunk Indexer plays the main role in processing the data it receives from forwarders. It takes the data, normalizes it into field-value pairs, determines the datatype of the data, and stores them as events. Processed data is easy to search and analyze.
Search Head
Splunk Search Head is the place within the Search & Reporting App where users can search the indexed logs as shown below. When the user searches for a term or uses a Search language known as Splunk Search Processing Language, the request is sent to the indexer and the relevant events are returned in the form of field-value pairs.
Search Head also provides the ability to transform the results into presentable tables, visualizations like pie-chart, bar-chart and column-chart, as shown below:
Answer: Forwarder
Splunk Bar
When you access Splunk, you will see the default home screen identical to the screenshot below.
Let’s look at each section, or panel, that makes up the home screen. The top panel is the Splunk Bar (below image).
In the Splunk Bar, you can see system-level messages (Messages), configure the Splunk instance (Settings), review the progress of jobs (Activity), miscellaneous information such as tutorials (Help), and a search feature (Find).
The ability to switch between installed Splunk apps instead of using the Apps panel can be achieved from the Splunk Bar, like in the image below.
Apps Panel
Next is the Apps Panel. In this panel, you can see the apps installed for the Splunk instance.
The default app for every Splunk installation is Search & Reporting.
Explore Splunk
The next section is Explore Splunk. This panel contains quick links to add data to the Splunk instance, add new Splunk apps, and access the Splunk documentation.
Splunk Dashboard
The last section is the Home Dashboard. By default, no dashboards are displayed. You can choose from a range of dashboards readily available within your Splunk instance. You can select a dashboard from the dropdown menu or by visiting the dashboards listing page.
You can also create dashboards and add them to the Home Dashboard. The dashboards you create can be viewed isolated from the other dashboards by clicking on the Yours tab.
Please review the Splunk documentation on Navigating Splunk here.
Answer: Monitor
Splunk can ingest any data. As per the Splunk documentation, when data is added to Splunk, the data is processed and transformed into a series of individual events.
The data sources can be event logs, website logs, firewall logs, etc.
Data sources are grouped into categories. Below is a chart listing from the Splunk documentation detailing each data source category.
In this room, we’re going to focus on VPN logs. When we click on the Add Data link (from the Splunk home screen), we’re presented with the following screen.
We will use the Upload Option to upload the data from our local machine. Download the attached log file and upload it on Splunk.
As shown above, it has a total of 5 steps to successfully upload the data.
- Select Source -> Where we select the Log source.
- Select Source Type > Select what type of logs are being ingested.
- Input Settings ->Select the index where these logs will be dumped and hostName to be associated with the logs.
- Review -> Review all the gif
- Done > Final step, where the data is uploaded successfully and ready to be analyzed.
As you can see, there are A LOT more logs we can add to the Splunk instance, and Splunk supports various source types.
Download the attached log file “VPN_logs” and upload this file into the Splunk instance with the right source type.
Note: In case you are using the AttackBox, the file is available in the /root/Rooms/SplunkBasic/ directory.
Upload the data file via upload, add Host Field Value VPN_Connections and new index vpn_logs
!! add Host Field Value VPN_Connections and new index vpn_logs !!
Upload the data attached to this task
Create an index “VPN_Logs”. How many events are present in the log file?
Answer: 2862 – Answer at top of data
How many log events by the user Maleena are captured?
Answer: 60 – Use left hand column to click on Username
What is the name associated with IP 107.14.182.38?
Answer: Smith – Use search bar to add filter of Source_ip=107.14.182.38
!! Reuploaded with Index and Host Field Value Updated !!
What is the number of events that originated from all countries except France?
Answer: 2814 – Use search bar to add filter of NOT Source_Country=”France”
How many VPN Events were observed by the IP 107.3.206.58?
Answer: 14 – Use search bar to filter IP address again
In this room, we explored Splunk, its components, and how it works. Please check the following Splunk walkthrough and challenge rooms to understand how Splunk is effectively used in investigating the incidents.
Hope this helped, thanks for reading.
Leave a Reply