Difference between pages "Snorkel" and "SQLite database format"

From ForensicsWiki
(Difference between pages)
Jump to: navigation, search
(Image File Formats Understood)
 
(Use Cases)
 
Line 1: Line 1:
{{Infobox_Software |
+
{{expand}}
  name = Snorkel |
+
  maintainer = NFI |
+
  os = Java |
+
  genre = {{Analysis}}  |
+
  license = proprietary |
+
  website = [http://www.holmes.nl/NFIlabs/Snorkel http://www.holmes.nl/NFIlabs/Snorkel] |
+
}}
+
  
'''Snorkel''' is a Java software library that is used by developers of forensic software. Snorkel is not a standalone forensic application, but it is an important piece of infrastructure that can be used by many forensic applications: Snorkel gives access to digital evidence files, file systems, files, slack space, unallocated clusters, etc. This type of access is a key enabler in the development of forensic software systems, ranging from single-purpose stand-alone tools to integrated forensic processing systems.
+
SQLite databases are used by many programs including several forensics tools, e.g. [[Autopsy]] 3.
 +
SQLite 3 is current and older SQLite packages cannot use sqlite3 databases so use sqlite3 tools.
  
Snorkel is developed by the Netherlands Forensic Institute
+
== SQLite3 ==
  
=Features=
+
SQLite version 3 uses a page-based storage where the pages are used for various types of data e.g. there are:
 +
* lock-byte pages
 +
* freelist pages
 +
** freelist trunk pages
 +
** freelist leaf pages
 +
* B-tree pages
 +
** table B-tree interior pages
 +
** table B-tree leaf pages
 +
** index B-tree interior pages
 +
** index B-tree leaf pages
 +
* payload overflow pages
 +
* pointer map pages
  
Snorkel recognizes and gives access to numerous storage formats for digital evidence, disk partitioning schemes, volume managers, file systems, and structured files. The formats supported are summarized below.
+
=== Write-Ahead Log (WAL) ===
 +
The default method by which SQLite implements atomic commit and rollback is a rollback journal. In version 3.7.0 a "Write-Ahead Log" option was added.
  
==Image File Formats Understood==
+
== Temporary sqlite files ==
 +
Seen in e.g.
 +
<pre>
 +
/Users/%USERNAME%/AppData/Local/Temp/etilqs_%RANDOM%
 +
</pre>
  
{|
+
Where "etilqs" is "sqlite" in reverse
|Image file formats
+
|[[Encase image file format|EnCase]]
+
|-
+
|
+
|[[Raw Image Format|RAW (dd)]]
+
|-
+
|
+
|[[VMWare Virtual Disk Format (VMDK)|VMWare (VMDK)]]
+
|}
+
  
==File Systems Understood==
+
== Use Cases ==
 +
=== Web Browser Data ===
 +
[[Mozilla Firefox]] and [[Google Chrome]] both use SQLite version 3 databases for user data such as history, downloaded files.
  
{|
+
=== Mobile OS ===
|Volume managers
+
[[Google Android]] and [[Apple iOS]] use SQLite3 databases for many system applications. Phone data including calls, messages, and credentials are all stored in SQLite3.
|[[Logical Disk Manager (LDM)|Windows (LDM)]]
+
|-
+
|Partitioning schemes
+
|PC/MBR
+
|-
+
|
+
|Apple
+
|-
+
|
+
|GPT
+
|-
+
|
+
|BSD
+
|-
+
|File systems
+
|Windows ([[FAT]], [[NTFS]])
+
|-
+
|
+
|Apple ([[MFS]], [[HFS]], [[HFS+]])
+
|-
+
|
+
|Linux ([[Ext3|EXT]], [[Reiserfs|Reiser]])
+
|-
+
|
+
|Solaris, BSD ([[UFS]])
+
|-
+
|
+
|CD ([[ISO9660]], Joliet)
+
|-
+
|File Formats
+
|Windows registry (Win 9x, NT)
+
|-
+
|
+
|Microsoft Office (OLE2)
+
|}
+
  
<!-- ==File Search Facilities== -->
+
== External Links ==
<!-- ==Historical Reconstruction== -->
+
* [http://sqlite.org/fileformat2.html The SQLite Database File Format], by the [[SQLite|SQLite project]]
<!-- Can it build timelines and search by creation date? -->
+
* [http://sqlite.org/wal.html Write-Ahead Logging], by the [[SQLite|SQLite project]]
<!-- ==Searching Abilities== -->
+
* [http://forensicsfromthesausagefactory.blogspot.com/2011/04/carving-sqlite-databases-from.html Carving SQLite databases from unallocated clusters], by Richard Drinkwater, April 27, 2011
<!-- Can it search? Does it build an index? Can it focus on file types or particular kinds of metadata? -->
+
* [http://linuxsleuthing.blogspot.ch/2013/09/recovering-data-from-deleted-sqlite.html Recovering Data from Deleted SQLite Records: Redux], by [[John Lehr]], September 13, 2013
<!-- ==Hash Databases== -->
+
<!-- Can it create hashes of files and/or blocks? Can it compare these hash values to any databases? -->
+
<!-- What sort of hash functions does it use? -->
+
<!-- ==Evidence Collection Features== -->
+
<!-- Can it sign files? Does it keep an audit log? -->
+
<!-- =History= -->
+
  
==License Notes==
+
== Tools ==
 +
* [[SQLite]]
 +
* [[SQLite Forensic Reporter]]
  
Snorkel is has a proprietary license.
+
[[Category:File Formats]]
An evaluation version is available from the website.
+
 
+
= External Links =
+
 
+
* [http://www.forensischinstituut.nl/ the Netherlands Forensic Institute]
+
* [http://www.holmes.nl/NFIlabs/Snorkel Snorkel website]
+
 
+
<!-- ==External Reviews== -->
+

Revision as of 10:15, 26 June 2014

Information icon.png

Please help to improve this article by expanding it.
Further information might be found on the discussion page.

SQLite databases are used by many programs including several forensics tools, e.g. Autopsy 3. SQLite 3 is current and older SQLite packages cannot use sqlite3 databases so use sqlite3 tools.

SQLite3

SQLite version 3 uses a page-based storage where the pages are used for various types of data e.g. there are:

  • lock-byte pages
  • freelist pages
    • freelist trunk pages
    • freelist leaf pages
  • B-tree pages
    • table B-tree interior pages
    • table B-tree leaf pages
    • index B-tree interior pages
    • index B-tree leaf pages
  • payload overflow pages
  • pointer map pages

Write-Ahead Log (WAL)

The default method by which SQLite implements atomic commit and rollback is a rollback journal. In version 3.7.0 a "Write-Ahead Log" option was added.

Temporary sqlite files

Seen in e.g.

/Users/%USERNAME%/AppData/Local/Temp/etilqs_%RANDOM%

Where "etilqs" is "sqlite" in reverse

Use Cases

Web Browser Data

Mozilla Firefox and Google Chrome both use SQLite version 3 databases for user data such as history, downloaded files.

Mobile OS

Google Android and Apple iOS use SQLite3 databases for many system applications. Phone data including calls, messages, and credentials are all stored in SQLite3.

External Links

Tools