Difference between pages "Chrome Disk Cache Format" and "Mac OS X"

From ForensicsWiki
(Difference between pages)
Jump to: navigation, search
(Index file format (index))
 
m (EFI boot)
 
Line 1: Line 1:
{{expand}}
+
{{Expand}}
  
== Cache files ==
+
Apple Inc.'s Macintosh OS X (pronounced "'''OS Ten'''") is the operating system distributed with Apple computers. It includes heavily used several programs by default, including [[Apple Mail]], a web browser called [[Apple Safari | Safari]], and an [[Apple Address Book]], and [[iCal]].
The cache is stored in multiple:
+
{| class="wikitable"
+
|-
+
! Filename
+
! Description
+
|-
+
| index
+
| The index file
+
|-
+
| data_#
+
| Data block files
+
|-
+
| f_######
+
| (Separate) data stream file
+
|}
+
  
== Cache address ==
+
== EFI boot ==
The cache address is 4 bytes in size and consists of:
+
* Configuration in nvram
{| class="wikitable"
+
|-
+
! offset
+
! size
+
! value
+
! description
+
|-
+
| <i>If file type is 0 (Separate file)</i>
+
|
+
|
+
|
+
|-
+
| 0.0
+
| 28 bits
+
|
+
| File number <br> The value represents the value of # in f_######
+
|-
+
| <i>Else</i>
+
|
+
|
+
|
+
|-
+
| 0.0
+
| 16 bits
+
|
+
| Block number
+
|-
+
| 2.0
+
| 8 bits
+
|
+
| File number (or file selector) <br> The value represents the value of # in data_#
+
|-
+
| 3.0
+
| 2 bits
+
|
+
| Block size <br> The number of contiguous blocks where 0 represents 1 block and 3 represents 4 blocks.
+
|-
+
| 3.2
+
| 2 bits
+
|
+
| Reserved
+
|-
+
| <i>Common</i>
+
|
+
|
+
|
+
|-
+
| 3.4
+
| 3 bits
+
|
+
| File type
+
|-
+
| 3.7
+
| 1 bit
+
|
+
| Initialized flag
+
|}
+
  
=== File types ===
+
The firmware looks for the boot partition in nvram.
{| class="wikitable"
+
|-
+
! Value
+
! Description
+
|-
+
| 0
+
| (Separate) data stream file
+
|-
+
| 1
+
| (Rankings) block data file (36 byte block data file)
+
|-
+
| 2
+
| 256 byte block data file
+
|-
+
| 3
+
| 1024 byte block data file
+
|-
+
| 4
+
| 4096 byte block data file
+
|-
+
|
+
|
+
|-
+
| 6
+
| Unknown; seen on Mac OS  X 0x6f430074
+
|}
+
  
==== Examples ====
+
Mac OS X EFI boot process supports both MZ-PE/COFF and EFI fat binary type [[Executable|executables]].
{| class="wikitable"
+
<pre>
|-
+
/com.apple.recovery.boot/boot.efi
! Value
+
/System/Library/CoreServices/boot.efi
! Description
+
/usr/standalone/i386/boot.efi
|-
+
</pre>
| 0x00000000
+
| Not initialized
+
|-
+
| 0x8000002a
+
| Data stream file: f_00002a
+
|-
+
| 0xa0010003
+
| Block data file: data_1, block number 3, 1 block of size
+
|}
+
  
== Index file format (index) ==
+
== Disk image types ==
Overview:
+
* File header
+
* least recently used (LRU) data (or eviction control data)
+
* index table
+
  
=== File header ===
+
Mac OS X has support for various disk image types build-in, some of which are:
The index file header (struct IndexHeader) is 256 bytes in size and consists of:
+
* read-write disk image (.dmg) some of which use the [[Raw Image Format]]
{| class="wikitable"
+
* [[Sparse Image format|Sparse disk image (.spareimage)]]
|-
+
* [[Sparse Bundle Image format|Sparse bundle disk image (.sparsebundle)]]
! offset
+
! size
+
! value
+
! description
+
|-
+
| 0
+
| 4
+
| "\xc3\xca\x03\xc1"
+
| Signature
+
|-
+
| 4
+
| 2
+
|
+
| Minor version
+
|-
+
| 6
+
| 2
+
|
+
| Major version
+
|-
+
| 8
+
| 4
+
|
+
| Number of entries
+
|-
+
| 12
+
| 4
+
|
+
| Stored data size
+
|-
+
| 16
+
| 4
+
|
+
| Last created file number <br> The value represents the value of # in f_######
+
|-
+
| 20
+
| 4
+
|
+
| Dirty flag <br> Identifier for all entries being changed
+
|-
+
| 24
+
| 4
+
|
+
| Usage statistics data cache address
+
|-
+
| 28
+
| 4
+
|
+
| Table size <br> Where 0 represents 0x10000 (is this the same as the file size?)
+
|-
+
| 32
+
| 4
+
|
+
| Signals a previous crash
+
|-
+
| 36
+
| 4
+
|
+
| Identifier of an ongoing test or experiment
+
|-
+
| 40
+
| 8
+
|
+
| Creation time
+
|-
+
| 48
+
| 52 x 8 = 208
+
|
+
| Padding <br> Contains 0-byte values
+
|}
+
  
==== Format versions ====
+
== Burn Folder ==
{| class="wikitable"
+
|-
+
! Value
+
! Description
+
|-
+
|2.0
+
|
+
|-
+
| 2.1
+
|
+
|}
+
  
=== Least recently used (LRU) data ===
+
Mac OS X Burn Folder:
The least recently used (LRU) data (struct LruData) is 112 bytes in size and consists of:
+
<pre>
{| class="wikitable"
+
$NAME.fpbf
|-
+
</pre>
! offset
+
! size
+
! value
+
! description
+
|-
+
| 0
+
| 2 x 4 = 8
+
|
+
| Padding
+
|-
+
| 8
+
| 4
+
|
+
| Filled flag <br> Value to indicate if when the cache was filled
+
|-
+
| 12
+
| 5 x 4 = 20
+
|
+
| Array of sizes
+
|-
+
| 32
+
| 5 x 4 = 20
+
|
+
| Array of head cache addresses
+
|-
+
| 52
+
| 5 x 4 = 20
+
|
+
| Array of tail cache addresses
+
|-
+
| 72
+
| 4
+
|
+
| Transaction cache address <br> Value to indicate an in-flight operation
+
|-
+
| 76
+
| 4
+
|
+
| Operation <br> The in-flight operation
+
|-
+
| 80
+
| 4
+
|
+
| Operations list <br> The in-flight operations list
+
|-
+
| 84
+
| 7 x 4 = 28
+
|
+
| Padding <br> Contains 0-byte values
+
|}
+
  
=== Array indexes ===
+
This folder normally contains [[Mac OS X Alias Files|alias files]] (similar to LNK files under Windows). Which should have the following signature.
The array indexes correspond to the file types.
+
<pre>
{| class="wikitable"
+
00000000  62 6f 6f 6b 00 00 00 00  6d 61 72 6b 00 00 00 00  |book....mark....|
|-
+
</pre>
! Value
+
! Description
+
|-
+
| 0
+
| Separate file
+
|-
+
| 1
+
| (Rankings) block data file
+
|-
+
| 2
+
| 256 byte block data file
+
|-
+
| 3
+
| 1024 byte block data file
+
|-
+
| 4
+
| 4096 byte block data file
+
|}
+
  
=== Index table ===
+
These [[Mac OS X Alias Files|alias files]] contain additional date and time values.
The index table is an array of cache addresses.
+
  
== Data block file format (data_#) ==
+
Also check the following files for references to deleted .fpbf paths:
Overview:
+
<pre>
* File header
+
/Users/$USERNAME/Library/Preferences/com.apple.finder.plist
* array of blocks
+
/Users/$USERNAME/Library/Preferences/com.apple.sidebarlists.plist
 +
</pre>
  
=== File header ===
+
Actual burning of optical media is logged in:
The index file header (struct BlockFileHeader) is 8192 bytes in size and consists of:
+
<pre>
{| class="wikitable"
+
/var/log/system.log
|-
+
/Users/$USERNAME/Library/Logs/DiscRecording.log
! offset
+
/private/var/.logs_exporter/cache/Users/$USERNAME/Library/Logs/DiscRecording.log
! size
+
</pre>
! value
+
! description
+
|-
+
| 0
+
| 4
+
| "\xc3\xca\x04\xc1"
+
| Signature
+
|-
+
| 4
+
| 2
+
|
+
| Minor version
+
|-
+
| 6
+
| 2
+
|
+
| Major version
+
|-
+
| 8
+
| 2
+
|
+
| File number (or file index) <br> The value represents the value of # in data_#
+
|-
+
| 10
+
| 2
+
|
+
| Next file number (or next file index) <br> The value represents the value of # in data_#
+
|-
+
| 12
+
| 4
+
|
+
| Block size (or cache entry) size
+
|-
+
| 16
+
| 4
+
|
+
| Number of entries
+
|-
+
| 20
+
| 4
+
|
+
| Maximum number of entries
+
|-
+
| 24
+
| 4 x 4 = 16
+
|
+
| Array of empty entry counters <br> The counters of empty entries for each type
+
|-
+
| 40
+
| 4 x 4 = 16
+
|
+
| Array of last used position (hints) <br> The last used position for each type
+
|-
+
| 56
+
| 4
+
|
+
| Updating <br> Value to keep track of updates to the header
+
|-
+
| 60
+
| 5 x 4 = 20
+
|
+
| User
+
|-
+
| 80
+
| 2028 x 4 = 8112
+
|
+
| Block allocation bitmap
+
|}
+
  
==== Format versions ====
+
== HFS/HFS+ date and time values ==
{| class="wikitable"
+
|-
+
! Value
+
! Description
+
|-
+
| 2.0
+
|
+
|-
+
| 2.1
+
|
+
|}
+
  
=== Cache entry ===
+
In HFS+ date and time values are stored in an unsigned 32-bit integer containing the number of seconds since January 1, 1904 at 00:00:00 (midnight) UTC (GMT). This is slightly different from HFS where the date and time value are stored using the local time. The maximum representable date is February 6, 2040 at 06:28:15 UTC (GMT). The date values do not account for leap seconds. They do include a leap day in every year that is evenly divisible by four. This is sufficient given that the range of representable dates does not contain 1900 or 2100, neither of which have leap days. Also see: [http://web.archive.org/web/20090214212148/http://developer.apple.com/technotes/tn/tn1150.html Technical Note TN1150 - HFS Plus Volume Format]
The cache entry (struct EntryStore) is 256 bytes in size and consists of:
+
{| class="wikitable"
+
|-
+
! offset
+
! size
+
! value
+
! description
+
|-
+
| 0
+
| 4
+
|
+
| Hash <br> The hash of the key
+
|-
+
| 4
+
| 4
+
|
+
| Next entry cache address <br> The next entry with the same hash or bucket
+
|-
+
| 8
+
| 4
+
|
+
| Rankings node cache address
+
|-
+
| 12
+
| 4
+
|
+
| Reuse count <br> Value that indicates how often this entry was (re-)used
+
|-
+
| 16
+
| 4
+
|
+
| Refetch count <br> Value that indicates how often this entry was (re-)fetched (or downloaded)
+
|-
+
| 20
+
| 4
+
|
+
| Cache entry state
+
|-
+
| 24
+
| 8
+
|
+
| Creation time
+
|-
+
| 32
+
| 4
+
|
+
| Key data size
+
|-
+
| 36
+
| 4
+
|
+
| Long key data cache address <br> The value is 0 if no long key data is present
+
|-
+
| 40
+
| 4 x 4 = 16
+
|
+
| Array of data stream sizes
+
|-
+
| 56
+
| 4 x 4 = 16
+
|
+
| Array of data stream cache addresses
+
|-
+
| 72
+
| 4
+
|
+
| Cache entry flags
+
|-
+
| 76
+
| 4 x 4 = 16
+
|
+
| Padding
+
|-
+
| 92
+
| 4
+
|
+
| Self hash <br> The hash of the first 92 bytes of the cache entry is this used as a checksum?
+
|-
+
| 96
+
| 160
+
|
+
| Key data <br> Contains an UTF-8 encoded string with an end-of-string character with the original URL
+
|}
+
  
==== Array indexes ====
+
Converting HFS/HFS+ date and time values with Python:
The data stream array indexes correspond to:
+
<pre>
{| class="wikitable"
+
import datetime
|-
+
! Value
+
! Description
+
|-
+
| 0
+
| HTTP response headers
+
|-
+
| 1
+
| Page contents (Payload)
+
|-
+
| 2
+
|
+
|-
+
| 3
+
|
+
|}
+
  
==== Cache entry state ====
+
print datetime.datetime( 1904, 1, 1 ) + datetime.timedelta( seconds=0xCBDAF25B )
{| class="wikitable"
+
</pre>
|-
+
! Value
+
! Identifier
+
! Description
+
|-
+
| 0
+
| ENTRY_NORMAL
+
| Normal cache entry
+
|-
+
| 1
+
| ENTRY_EVICTED
+
| The cache entry was recently evicted
+
|-
+
| 2
+
| ENTRY_DOOMED
+
| The cache entry was doomed
+
|}
+
  
==== Cache entry flags ====
+
== Launch Agents ==
{| class="wikitable"
+
System-wide:
|-
+
<pre>
! Value
+
/Library/LaunchAgents
! Identifier
+
/System/Library/LaunchAgents
! Description
+
</pre>
|-
+
| 0x00000001
+
| PARENT_ENTRY
+
| Parent cache entry
+
|-
+
| 0x00000002
+
| CHILD_ENTRY
+
| Child cache entry
+
|}
+
  
=== Rankings node ===
+
Per user:
The rankings node (struct RankingsNode) is 36 bytes in size and consists of:
+
<pre>
{| class="wikitable"
+
/Users/$USERNAME/Library/LaunchAgents
|-
+
</pre>
! offset
+
! size
+
! value
+
! description
+
|-
+
| 0
+
| 8
+
|
+
| Last used <br> Contains LRU information?
+
|-
+
| 8
+
| 8
+
|
+
| Last modified <br> Contains LRU information?
+
|-
+
| 16
+
| 4
+
|
+
| Next rankings node cache address
+
|-
+
| 20
+
| 4
+
|
+
| Previous rankings node cache address
+
|-
+
| 24
+
| 4
+
|
+
| Cache entry cache address
+
|-
+
| 28
+
| 4
+
|
+
| Is dirty flag
+
|-
+
| 32
+
| 4
+
|
+
| Self hash <br> The hash of the first 32 bytes of the rankings node is this used as a checksum?
+
|}
+
  
== Data stream ==
+
These directories contain  [[Property list (plist)]] files.
The data stream is stored inside the data block file (data_#), for small amounts of data, or stored as a separate file (f_######). The data stream is stored as a [[gzip|gzip file]].
+
  
Note that the last modification time of the gzip file is set to 0.
+
== Launch Daemons ==
 +
System-wide:
 +
<pre>
 +
/Library/LaunchDaemons
 +
/System/Library/LaunchDaemons
 +
</pre>
  
== See Also ==
+
These directories contain [[Property list (plist)]] files.
* [[Google Chrome]]
+
 
* [[gzip]]
+
== Startup Items ==
 +
<pre>
 +
/Library/StartupItems/
 +
/System/Library/StartupItems/
 +
</pre>
 +
 
 +
== Crash Reporter ==
 +
<pre>
 +
/Library/Application Support/CrashReporter
 +
</pre>
 +
 
 +
Contains text files named .crash, .diag, .spin
 +
 
 +
== Diagnostic Reports ==
 +
<pre>
 +
/Library/Logs/DiagnosticReports
 +
</pre>
 +
 
 +
== Internet Plug-Ins ==
 +
System-wide:
 +
<pre>
 +
/Library/Internet Plug-Ins
 +
</pre>
 +
 
 +
Per user:
 +
<pre>
 +
/Users/$USERNAME/Library/Internet Plug-Ins
 +
</pre>
 +
 
 +
== Quarantine event database ==
 +
See [http://menial.co.uk/blog/2011/06/16/mac-quarantine-event-database/]
 +
 
 +
Snow Leopard and earlier
 +
<pre>
 +
/Users/$USER/Library/Preferences/com.apple.LaunchServices.QuarantineEvents
 +
</pre>
 +
 
 +
<pre>
 +
SELECT datetime(LSQuarantineTimeStamp + 978307200, "unixepoch") as LSQuarantineTimeStamp, LSQuarantineAgentName, LSQuarantineOriginURLString, LSQuarantineDataURLString from LSQuarantineEvent;
 +
</pre>
 +
 
 +
Lion and later
 +
<pre>
 +
/Users/$USER/Library/Preferences/com.apple.LaunchServices.QuarantineEventsV2
 +
</pre>
 +
 
 +
== sleepimage ==
 +
This file is similar to the hibernation file on Windows.
 +
<pre>
 +
/private/var/vm/sleepimage
 +
</pre>
 +
 
 +
Also see: [http://osxdaily.com/2010/10/11/sleepimage-mac/]
 +
 
 +
== Last shutdown logs ==
 +
<pre>
 +
/private/var/log/com.apple.launchd/launchd-shutdown.system.log
 +
/private/var/log/com.apple.launchd/launchd-shutdown.system.log.1
 +
</pre>
 +
 
 +
== Package Files (.PKG) ==
 +
Package Files (.PKG) are XAR archives [http://en.wikipedia.org/wiki/Xar_(archiver)] that contain a cpio archive and metadata [http://s.sudre.free.fr/Stuff/Ivanhoe/FLAT.html].
 +
 
 +
== Also see ==
 +
* [[MacOS Process Monitoring]]
 +
* [[Acquiring a MacOS System with Target Disk Mode]]
 +
* [[Converting Binary Plists]]
 +
* [[FileVault Disk Encryption]]
 +
* [[File Vault]]
 +
 
 +
=== Formats ===
 +
* [[Basic Security Module (BSM) file format]]
 +
* [[Property list (plist)]]
  
 
== External Links ==
 
== External Links ==
* [http://www.chromium.org/developers/design-documents/network-stack/disk-cache Disk Cache], The Chromium Projects
+
* [http://www.apple.com/macosx/ Official website]
 +
* [http://en.wikipedia.org/wiki/OS_X Wikipedia entry on OS X]
 +
* [http://menial.co.uk/blog/2011/06/16/mac-quarantine-event-database/ Quarantine event database]
 +
* [http://www2.tech.purdue.edu/cit/Courses/cit556/readings/MacForensicsCraiger.pdf Mac Forensics: Mac OS X and the HFS+ File System] by P. Craiger
 +
* [http://web.me.com/driley/iWeb/Previous_files/Directory_Services_Overview.pdf Mac OS X Directory Services Integration including Active Directory]
 +
* [http://digitalinvestigation.wordpress.com/2012/04/04/geek-post-nskeyedarchiver-files-what-are-they-and-how-can-i-use-them/ NSKeyedArchiver files – what are they, and how can I use them?]
 +
* [http://krypted.com/mac-os-x/command-line-alf-on-mac-os-x/ Command Line ALF on Mac OS X]
 +
* [http://newosxbook.com/DMG.html Demystifying the DMG File Format]
 +
* [https://code.google.com/p/mac-security-tips/wiki/ALL_THE_TIPS mac-security-tips]
 +
 
 +
=== Apple Examiner ===
 +
* [http://www.appleexaminer.com/ The Apple Examiner]
 +
* [http://www.appleexaminer.com/MacsAndOS/Analysis/USBOSX/USBOSX.html USB Entries on OS X]
 +
* [http://www.appleexaminer.com/Downloads/MacForensics.pdf Macintosh Forensics - A Guide for the Forensically Sound Examination of a Macintosh Computer] by Ryan R. Kubasiak
 +
 
 +
=== EFI ===
 +
* [http://refit.sourceforge.net/info/boot_process.html The Intel Mac boot process], by the [[rEFIt|rEFIt project]]
 +
* [http://ho.ax/posts/2012/02/carving-up-efi-fat-binaries/ Carving up EFI fat binaries], by snare, February 24, 2012
 +
 
 +
=== iCloud ===
 +
* [http://support.apple.com/kb/HT4865?viewlocale=en_US&locale=en_US iCloud: iCloud security and privacy overview]
  
[[Category:File Formats]]
+
[[Category:Mac OS X]]
 +
[[Category:Operating systems]]

Revision as of 06:04, 25 June 2014

Information icon.png

Please help to improve this article by expanding it.
Further information might be found on the discussion page.

Apple Inc.'s Macintosh OS X (pronounced "OS Ten") is the operating system distributed with Apple computers. It includes heavily used several programs by default, including Apple Mail, a web browser called Safari, and an Apple Address Book, and iCal.

EFI boot

  • Configuration in nvram

The firmware looks for the boot partition in nvram.

Mac OS X EFI boot process supports both MZ-PE/COFF and EFI fat binary type executables.

/com.apple.recovery.boot/boot.efi
/System/Library/CoreServices/boot.efi
/usr/standalone/i386/boot.efi

Disk image types

Mac OS X has support for various disk image types build-in, some of which are:

Burn Folder

Mac OS X Burn Folder:

$NAME.fpbf

This folder normally contains alias files (similar to LNK files under Windows). Which should have the following signature.

00000000  62 6f 6f 6b 00 00 00 00  6d 61 72 6b 00 00 00 00  |book....mark....|

These alias files contain additional date and time values.

Also check the following files for references to deleted .fpbf paths:

/Users/$USERNAME/Library/Preferences/com.apple.finder.plist
/Users/$USERNAME/Library/Preferences/com.apple.sidebarlists.plist

Actual burning of optical media is logged in:

/var/log/system.log
/Users/$USERNAME/Library/Logs/DiscRecording.log
/private/var/.logs_exporter/cache/Users/$USERNAME/Library/Logs/DiscRecording.log

HFS/HFS+ date and time values

In HFS+ date and time values are stored in an unsigned 32-bit integer containing the number of seconds since January 1, 1904 at 00:00:00 (midnight) UTC (GMT). This is slightly different from HFS where the date and time value are stored using the local time. The maximum representable date is February 6, 2040 at 06:28:15 UTC (GMT). The date values do not account for leap seconds. They do include a leap day in every year that is evenly divisible by four. This is sufficient given that the range of representable dates does not contain 1900 or 2100, neither of which have leap days. Also see: Technical Note TN1150 - HFS Plus Volume Format

Converting HFS/HFS+ date and time values with Python:

import datetime

print datetime.datetime( 1904, 1, 1 ) + datetime.timedelta( seconds=0xCBDAF25B )

Launch Agents

System-wide:

/Library/LaunchAgents
/System/Library/LaunchAgents

Per user:

/Users/$USERNAME/Library/LaunchAgents

These directories contain Property list (plist) files.

Launch Daemons

System-wide:

/Library/LaunchDaemons
/System/Library/LaunchDaemons

These directories contain Property list (plist) files.

Startup Items

/Library/StartupItems/
/System/Library/StartupItems/

Crash Reporter

/Library/Application Support/CrashReporter

Contains text files named .crash, .diag, .spin

Diagnostic Reports

/Library/Logs/DiagnosticReports

Internet Plug-Ins

System-wide:

/Library/Internet Plug-Ins

Per user:

/Users/$USERNAME/Library/Internet Plug-Ins

Quarantine event database

See [1]

Snow Leopard and earlier

/Users/$USER/Library/Preferences/com.apple.LaunchServices.QuarantineEvents
SELECT datetime(LSQuarantineTimeStamp + 978307200, "unixepoch") as LSQuarantineTimeStamp, LSQuarantineAgentName, LSQuarantineOriginURLString, LSQuarantineDataURLString from LSQuarantineEvent;

Lion and later

/Users/$USER/Library/Preferences/com.apple.LaunchServices.QuarantineEventsV2

sleepimage

This file is similar to the hibernation file on Windows.

/private/var/vm/sleepimage

Also see: [2]

Last shutdown logs

/private/var/log/com.apple.launchd/launchd-shutdown.system.log
/private/var/log/com.apple.launchd/launchd-shutdown.system.log.1

Package Files (.PKG)

Package Files (.PKG) are XAR archives [3] that contain a cpio archive and metadata [4].

Also see

Formats

External Links

Apple Examiner

EFI

iCloud