Difference between pages "Windows SuperFetch Format" and "Libsmraw"

From ForensicsWiki
(Difference between pages)
Jump to: navigation, search
(Compressed blocks)
 
(Tools)
 
Line 1: Line 1:
{{expand}}
+
{{Infobox_Software |
 +
  name = libsmraw |
 +
  maintainer = [[Joachim Metz]] |
 +
  os = [[Linux]], [[FreeBSD]], [[NetBSD]], [[OpenBSD]], [[Mac OS X]], [[Windows]] |
 +
  genre = {{Disk imaging}} |
 +
  license = {{LGPL}} |
 +
  website = [https://code.google.com/p/libsmraw/ code.google.com/p/libsmraw/] |
 +
}}
  
SuperFetch, is a memory management scheme that enhances the least-recently accessed approach with historical information and proactive memory management. [http://technet.microsoft.com/en-us/magazine/2007.03.vistakernel.aspx]
+
The '''libsmraw''' package contains a library and applications to read and write (split) RAW storage media bitstream copies.
 +
Libsmraw contains supports for multiple (split) RAW naming schemes.
  
<b>Note that the following format specification are incomplete.</b>
+
== History ==
  
== SuperFetch DB files ==
+
Libsmraw was created by [[Joachim Metz]] in 2010, while working for [http://en.hoffmannbv.nl/ Hoffmann Investigations].
The <tt>Ag*.db</tt> files are of the SuperFetch file format. E.g.
+
Libsmraw is a rewrite of earlier work for the proof-of-concept multi-threaded imager: GNOME Forensic Imager.
<pre>
+
AgAppLaunch.db
+
AgCx_SC*.db
+
AgGlFaultHistory.db
+
AgGlFgAppHistory.db
+
AgGlGlobalHistory.db
+
AgGlUAD_%SID%.db
+
AgGlUAD_P_%SID%.db
+
AgRobust.db
+
</pre>
+
  
The SuperFetch DB files can be stored in uncompressed or compressed form, where different version of Windows use different compressed forms:
+
== Tools ==
* Compressed SuperFetch DB - MEMO file format; Windows Vista
+
The '''libsmraw''' package contains the following tools:
* Compressed SuperFetch DB - MEM0 file format; Windows  7
+
* '''smrawmount''', which FUSE mounts (split) RAW image files.
* Compressed SuperFetch DB - MAM file format; Windows 8
+
  
=== Compressed SuperFetch DB - MEMO file format ===
+
The '''libsmraw''' package also contains the following bindings:
The MEM file consists of:
+
* '''pysmraw''', bindings for Python (libsmraw 20140621 or later).
* file header
+
* compressed blocks
+
  
This format uses the LZNT1 compression method
+
== Examples ==
  
==== File header ====
+
FUSE mounting a split RAW image (libsmraw 20110916 or later)
The file header is 84 bytes of size and consists of:
+
<pre>
{| class="wikitable"
+
smrawmount image.raw.000 mount_point
|-
+
</pre>
! Offset
+
! Size
+
! Value
+
! Description
+
|-
+
| 0
+
| 4
+
| "MEMO" (0x4d, 0x45, 0x4d, 0x4f)
+
| Signature
+
|-
+
| 4
+
| 4
+
|
+
| Uncompressed (total) data size
+
|-
+
|}
+
  
==== Compressed blocks ====
+
Or:
The compressed block size is the chunk data size, which is part of the LZNT1 compressed data, + 2 bytes for the size of the chunk header itself.
+
 
+
The uncompressed block size is 4096 (0x1000) or the remaining uncompressed data size for the last block.
+
 
+
=== Compressed SuperFetch DB - MEM0 file format ===
+
The MEM file consists of:
+
* file header
+
* compressed blocks
+
 
+
This format uses the LZXPRESS Huffman compression method
+
 
+
==== File header ====
+
The file header is 8 bytes of size and consists of:
+
{| class="wikitable"
+
|-
+
! Offset
+
! Size
+
! Value
+
! Description
+
|-
+
| 0
+
| 4
+
| "MEM0" (0x4d, 0x45, 0x4d, 0x30)
+
| Signature
+
|-
+
| 4
+
| 4
+
|
+
| Uncompressed (total) data size
+
|-
+
|}
+
 
+
==== Compressed blocks ====
+
The file header is followed by compressed blocks:
+
{| class="wikitable"
+
|-
+
! Offset
+
! Size
+
! Value
+
! Description
+
|-
+
| 0
+
| 4
+
|
+
| Compressed data size
+
|-
+
| 4
+
| ...
+
|
+
| Compressed data
+
|-
+
|}
+
 
+
The uncompressed block size is 65536 (0x10000) or the remaining uncompressed data size for the last block.
+
 
+
=== Compressed SuperFetch DB - MAM file format ===
+
The MAM file consists of:
+
* file header
+
* compressed blocks
+
 
+
This format uses the LZXPRESS Huffman compression method.
+
 
+
==== File header ====
+
The file header is 12 bytes of size and consists of:
+
{| class="wikitable"
+
|-
+
! Offset
+
! Size
+
! Value
+
! Description
+
|-
+
| 0
+
| 4
+
| "MAM\x84" (0x4d, 0x41, 0x4d, 0x84)
+
| Signature
+
|-
+
| 4
+
| 4
+
|
+
| Uncompressed (total) data size
+
|-
+
| 8
+
| 4
+
|
+
| Unknown (checksum?)
+
|-
+
|}
+
 
+
==== Compressed blocks ====
+
The uncompressed block size is 65536 (0x10000) or the remaining uncompressed data size for the last block.
+
 
+
Note the LZExpress Huffman variant used differs from the one used in the MEM0 format. This variant can refer to uncompressed data stored in the previous compressed block. The compressed blocks are essentially a single compressed stream.
+
 
+
=== Uncompressed SuperFetch DB format ===
+
<b>TODO</b>
+
 
+
==== File header ====
+
<b>TODO</b>
+
 
+
{| class="wikitable"
+
|-
+
! Offset
+
! Size
+
! Value
+
! Description
+
|-
+
| 0
+
| 4
+
| 0x0000000e
+
| Unknown (Database type or signature?)
+
|-
+
| 4
+
| 4
+
|
+
| Uncompressed (total) data size
+
|-
+
|}
+
== TRX files ==
+
The <tt>Ag*.db.trx</tt> files are of the TRX file format. E.g.
+
 
<pre>
 
<pre>
AgCx_SC*.db.trx
+
smrawmount image.raw.??? mount_point
 
</pre>
 
</pre>
  
<b>Note that the following format specification is incomplete.</b>
+
== Also See ==
 
+
[[Raw_Image_Format | RAW Image format]]
=== File header ===
+
The file header is variable of size and consists of:
+
{| class="wikitable"
+
|-
+
! Offset
+
! Size
+
! Value
+
! Description
+
|-
+
| 0
+
| 4
+
| 1
+
| Unknown (Version?)
+
|-
+
| 4
+
| 4
+
|
+
| Unknown
+
|-
+
| 8
+
| 4
+
|
+
| File size
+
|-
+
| 12
+
| 4
+
|
+
| Maximum number of records (of the record offsets array)
+
|-
+
| 16
+
| 4
+
|
+
| Number of records
+
|-
+
| 20
+
| ...
+
|
+
| Record offsets array, where the record offset is a 32-bit integer. Unused record offset are set to 0.
+
|-
+
|}
+
 
+
=== Record ===
+
<b>TODO describe</b>
+
 
+
== See Also ==
+
* [[SuperFetch]]
+
  
 
== External Links ==
 
== External Links ==
* [http://technet.microsoft.com/en-us/magazine/2007.03.vistakernel.aspx Inside the Windows Vista Kernel: Part 2], by [[Mark Russinovich]], March 2007
 
* [http://blog.rewolf.pl/blog/?p=214 Windows SuperFetch file format – partial specification], by ReWolf, October 5, 2011
 
  
[[Category:File Formats]]
+
* [https://code.google.com/p/libsmraw/ Project site]

Revision as of 07:46, 21 June 2014

libsmraw
Maintainer: Joachim Metz
OS: Linux, FreeBSD, NetBSD, OpenBSD, Mac OS X, Windows
Genre: Disk imaging
License: LGPL
Website: code.google.com/p/libsmraw/

The libsmraw package contains a library and applications to read and write (split) RAW storage media bitstream copies. Libsmraw contains supports for multiple (split) RAW naming schemes.

History

Libsmraw was created by Joachim Metz in 2010, while working for Hoffmann Investigations. Libsmraw is a rewrite of earlier work for the proof-of-concept multi-threaded imager: GNOME Forensic Imager.

Tools

The libsmraw package contains the following tools:

  • smrawmount, which FUSE mounts (split) RAW image files.

The libsmraw package also contains the following bindings:

  • pysmraw, bindings for Python (libsmraw 20140621 or later).

Examples

FUSE mounting a split RAW image (libsmraw 20110916 or later)

smrawmount image.raw.000 mount_point

Or:

smrawmount image.raw.??? mount_point

Also See

RAW Image format

External Links