mirror of
https://github.com/SHOGGOTH-SECTOR/sica-fondt.git
synced 2026-08-01 08:30:20 +00:00
Place useful parts of the surrounding repos into sica-fondt by layer, per the
body model (Ada = membrane; brain/endocrine/capabilities/knowledge non-Ada):
- brain/ LLM reasoning + providers (dapr, hermes, MoMoA)
- capabilities/ REPRAG sidecars: hermes tools/skills, dapr tools, parallel
dispatch, A51 channels, and the OSINT cluster
- knowledge/ LORAG corpus: 754 cyber-skills, agency personas, secure-coding,
MITRE ATT&CK data
- reference/ defensive threat-reference (C3, shhbruh doc) + AdaYaml parser
License handling: AGPL sources (worldosint, advanced_evolution, mercury,
Reticulum) and GPL DeTTECT are SPEC-only clean-room/port descriptions — no
copyleft code copied. MIT/Apache/data parts copied as working trees.
Safety: shhbruh escape/persistence material and C3 covert-C2 kept as reference
only, not wired into the running organism. See CONSOLIDATION.md.
https://claude.ai/code/session_01UehUqEXXJJCsHoA4voCU5c
268 lines
9.1 KiB
Markdown
268 lines
9.1 KiB
Markdown
---
|
|
name: building-incident-timeline-with-timesketch
|
|
description: Build collaborative forensic incident timelines using Timesketch to ingest, normalize, and analyze multi-source
|
|
event data for attack chain reconstruction and investigation documentation.
|
|
domain: cybersecurity
|
|
subdomain: incident-response
|
|
tags:
|
|
- timesketch
|
|
- timeline-analysis
|
|
- forensic-timeline
|
|
- plaso
|
|
- dfir
|
|
- incident-investigation
|
|
- collaborative-forensics
|
|
mitre_attack:
|
|
- T1070
|
|
- T1059
|
|
- T1053
|
|
version: '1.0'
|
|
author: mahipal
|
|
license: Apache-2.0
|
|
d3fend_techniques:
|
|
- Executable Denylisting
|
|
- Execution Isolation
|
|
- File Metadata Consistency Validation
|
|
- Content Format Conversion
|
|
- File Content Analysis
|
|
nist_csf:
|
|
- RS.MA-01
|
|
- RS.MA-02
|
|
- RS.AN-03
|
|
- RC.RP-01
|
|
---
|
|
|
|
# Building Incident Timeline with Timesketch
|
|
|
|
## Overview
|
|
|
|
Timesketch is an open-source collaborative forensic timeline analysis tool developed by Google that enables security teams to visualize and analyze chronological data from multiple sources during incident investigations. It ingests logs and artifacts from endpoints, servers, and cloud services, normalizes them into a unified searchable timeline, and provides powerful analysis capabilities including built-in analyzers, tagging, sketch annotations, and story building. Timesketch integrates with Plaso (log2timeline) for artifact parsing and supports direct CSV/JSONL ingestion for rapid timeline construction during active incidents.
|
|
|
|
|
|
## When to Use
|
|
|
|
- When deploying or configuring building incident timeline with timesketch capabilities in your environment
|
|
- When establishing security controls aligned to compliance requirements
|
|
- When building or improving security architecture for this domain
|
|
- When conducting security assessments that require this implementation
|
|
|
|
## Prerequisites
|
|
|
|
- Familiarity with incident response concepts and tools
|
|
- Access to a test or lab environment for safe execution
|
|
- Python 3.8+ with required dependencies installed
|
|
- Appropriate authorization for any testing activities
|
|
|
|
## Architecture and Components
|
|
|
|
### Core Components
|
|
- **Timesketch Server**: Web application with REST API for timeline management
|
|
- **OpenSearch/Elasticsearch**: Backend storage and search engine for timeline events
|
|
- **PostgreSQL**: Metadata storage for sketches, stories, and user data
|
|
- **Redis**: Task queue management for background processing
|
|
- **Celery Workers**: Asynchronous processing of timeline uploads and analyzers
|
|
|
|
### Data Flow
|
|
```
|
|
Evidence Sources --> Plaso/log2timeline --> Plaso storage file (.plaso)
|
|
| |
|
|
v v
|
|
CSV/JSONL --> Timesketch Importer --> OpenSearch Index
|
|
|
|
|
v
|
|
Timesketch Web UI
|
|
(Search, Analyze, Story)
|
|
```
|
|
|
|
## Deployment
|
|
|
|
### Docker Deployment (Recommended)
|
|
```bash
|
|
# Clone Timesketch repository
|
|
git clone https://github.com/google/timesketch.git
|
|
cd timesketch
|
|
|
|
# Run deployment helper script
|
|
cd docker
|
|
sudo docker compose up -d
|
|
|
|
# Default access: https://localhost:443
|
|
# Admin credentials generated during first run
|
|
```
|
|
|
|
### System Requirements
|
|
- Minimum 8 GB RAM (16+ GB recommended for large investigations)
|
|
- 4 CPU cores minimum
|
|
- SSD storage for OpenSearch indices
|
|
- Docker and Docker Compose installed
|
|
|
|
## Data Ingestion Methods
|
|
|
|
### Method 1: Plaso Integration (Comprehensive)
|
|
```bash
|
|
# Process disk image with log2timeline
|
|
log2timeline.py --storage-file evidence.plaso /path/to/disk/image
|
|
|
|
# Process Windows event logs
|
|
log2timeline.py --parsers winevtx --storage-file windows_events.plaso /path/to/evtx/
|
|
|
|
# Process multiple evidence sources
|
|
log2timeline.py --parsers "winevtx,prefetch,amcache,shimcache,userassist" \
|
|
--storage-file full_analysis.plaso /path/to/mounted/image/
|
|
|
|
# Import Plaso file into Timesketch
|
|
timesketch_importer -s "Case-2025-001" -t "Endpoint-WKS01" evidence.plaso
|
|
```
|
|
|
|
### Method 2: CSV Import (Quick Ingestion)
|
|
```csv
|
|
message,datetime,timestamp_desc,source,hostname
|
|
"User login detected","2025-01-15T08:30:00Z","Event Recorded","Security Log","DC01"
|
|
"PowerShell execution","2025-01-15T08:31:15Z","Event Recorded","PowerShell","WKS042"
|
|
```
|
|
|
|
```bash
|
|
# Import CSV directly
|
|
timesketch_importer -s "Case-2025-001" -t "Quick-Triage" events.csv
|
|
```
|
|
|
|
### Method 3: JSONL Import (Structured Data)
|
|
```json
|
|
{"message": "Suspicious logon from 10.1.2.3", "datetime": "2025-01-15T08:30:00Z", "timestamp_desc": "Event Recorded", "source_short": "Security", "hostname": "DC01"}
|
|
```
|
|
|
|
### Method 4: Sigma Rule Integration
|
|
```bash
|
|
# Upload Sigma rules for automated detection
|
|
timesketch_importer --sigma-rules /path/to/sigma/rules/
|
|
```
|
|
|
|
## Analysis Workflow
|
|
|
|
### Step 1: Create Investigation Sketch
|
|
```
|
|
1. Log into Timesketch web interface
|
|
2. Create new sketch (investigation case)
|
|
3. Add relevant timelines to the sketch
|
|
4. Set sketch description and tags
|
|
```
|
|
|
|
### Step 2: Run Built-in Analyzers
|
|
Timesketch includes analyzers that automatically identify:
|
|
- **Browser Search Analyzer**: Extracts search queries from browser history
|
|
- **Chain of Events Analyzer**: Links related events (download -> execute)
|
|
- **Domain Analyzer**: Extracts and categorizes domain names
|
|
- **Feature Extraction Analyzer**: Identifies IPs, URLs, hashes
|
|
- **Geo Location Analyzer**: Maps events to geographic locations
|
|
- **Similarity Scorer**: Finds similar events across timelines
|
|
- **Sigma Analyzer**: Matches events against Sigma detection rules
|
|
- **Account Finder**: Identifies user account activity patterns
|
|
- **Tagger**: Applies labels based on predefined rules
|
|
|
|
### Step 3: Search and Filter
|
|
```
|
|
# Search examples in Timesketch query language
|
|
|
|
# Find all events related to specific user
|
|
source_short:Security AND message:"john.admin"
|
|
|
|
# Find PowerShell execution events
|
|
data_type:"windows:evtx:record" AND event_identifier:4104
|
|
|
|
# Find lateral movement indicators
|
|
source_short:Security AND event_identifier:4624 AND xml_string:"LogonType\">3"
|
|
|
|
# Find events within specific time range
|
|
datetime:[2025-01-15T00:00:00 TO 2025-01-15T23:59:59]
|
|
|
|
# Find file creation events
|
|
data_type:"fs:stat" AND timestamp_desc:"Creation Time"
|
|
|
|
# Search with tags
|
|
tag:"suspicious" OR tag:"lateral_movement"
|
|
```
|
|
|
|
### Step 4: Build Investigation Story
|
|
```
|
|
1. Create new story within the sketch
|
|
2. Add search views that support each finding
|
|
3. Annotate key events with investigator notes
|
|
4. Link events to MITRE ATT&CK techniques
|
|
5. Document the attack narrative chronologically
|
|
6. Export story for inclusion in incident report
|
|
```
|
|
|
|
## Advanced Features
|
|
|
|
### Collaborative Investigation
|
|
- Multiple analysts work on the same sketch simultaneously
|
|
- Comments and annotations persist on events
|
|
- Saved searches shared across the team
|
|
- Investigation stories document findings in context
|
|
|
|
### API Automation
|
|
```python
|
|
from timesketch_api_client import config
|
|
from timesketch_api_client import client as ts_client
|
|
|
|
# Connect to Timesketch
|
|
ts = ts_client.TimesketchApi(
|
|
host_uri="https://timesketch.local",
|
|
username="analyst",
|
|
password="password"
|
|
)
|
|
|
|
# Get sketch
|
|
sketch = ts.get_sketch(1)
|
|
|
|
# Search events
|
|
search = sketch.explore(
|
|
query_string='event_identifier:4624 AND LogonType:3',
|
|
return_fields='datetime,message,hostname,source_short'
|
|
)
|
|
|
|
# Add tags to events
|
|
for event in search.get('objects', []):
|
|
sketch.tag_event(event['_id'], ['lateral_movement'])
|
|
```
|
|
|
|
### Integration with Dissect
|
|
```bash
|
|
# Use Dissect for faster artifact parsing (alternative to Plaso)
|
|
target-query -f timesketch://timesketch.local/case-001 \
|
|
targets/hostname/ -q "windows.evtx" --limit 0
|
|
```
|
|
|
|
## Key Data Sources for Timeline Building
|
|
|
|
| Source | Parser | Evidence Value |
|
|
|--------|--------|---------------|
|
|
| Windows Event Logs (.evtx) | winevtx | Authentication, process execution, services |
|
|
| Prefetch Files | prefetch | Program execution history |
|
|
| MFT ($MFT) | mft | File system activity |
|
|
| Registry Hives | winreg | System configuration, persistence |
|
|
| Browser History | chrome/firefox | Web activity, downloads |
|
|
| Syslog | syslog | Linux/network device events |
|
|
| CloudTrail Logs | jsonl | AWS API activity |
|
|
| Azure Activity Logs | jsonl | Azure resource operations |
|
|
| Firewall Logs | csv/jsonl | Network connections |
|
|
| Proxy Logs | csv/jsonl | HTTP/HTTPS traffic |
|
|
|
|
## MITRE ATT&CK Mapping
|
|
|
|
| Technique | Timeline Indicators |
|
|
|-----------|-------------------|
|
|
| Initial Access (TA0001) | First malicious event, phishing email receipt |
|
|
| Execution (T1059) | PowerShell/CMD events, process creation |
|
|
| Persistence (TA0003) | Registry modifications, scheduled tasks, services |
|
|
| Lateral Movement (TA0008) | Remote logons, SMB connections, RDP sessions |
|
|
| Exfiltration (TA0010) | Large data transfers, cloud storage uploads |
|
|
|
|
## References
|
|
|
|
- [Timesketch Official Documentation](https://timesketch.org/)
|
|
- [Timesketch GitHub Repository](https://github.com/google/timesketch)
|
|
- [CISA Timesketch Resource](https://www.cisa.gov/resources-tools/services/timesketch)
|
|
- [Hunt and Hackett: Scalable Forensics with Dissect and Timesketch](https://www.huntandhackett.com/blog/scalable-forensics-timeline-analysis-using-dissect-and-timesketch)
|
|
- [Plaso (log2timeline) Documentation](https://plaso.readthedocs.io/)
|