Difference between pages "Document Metadata Extraction" and "Mac OS X"

From ForensicsWiki
(Difference between pages)
Jump to: navigation, search
(PDF Files: PDF files metadata and embedded objects are handled by Belkasoft Evidence Center)
 
(Launch Agents)
 
Line 1: Line 1:
Here are tools that will extract metadata from document files.
+
{{Expand}}
  
=Office Files=
+
Apple Inc.'s Macintosh OS X (pronounced "'''OS Ten'''") is the operating system distributed with Apple computers. It includes heavily used several programs by default, including [[Apple Mail]], a web browser called [[Apple Safari | Safari]], and an [[Apple Address Book]], and [[iCal]].
  
; [[antiword]]
+
== Disk image types ==
: http://www.winfield.demon.nl/
+
  
; [[Belkasoft]] Evidence Center
+
Mac OS X has support for various disk image types build-in, some of which are:
: http://belkasoft.com/
+
* read-write disk image (.dmg) some of which use the [[Raw Image Format]]
: Extracts metadata from various [[Microsoft]] Office files (both 97-2003 and 2007-2013 formats), as well as Open Office documents. Besides, can extract plain texts (combining all texts from all XLS/XLSX/ODS pages and PPT/PPTX/ODP slides) and embedded objects. For pictures, embedded into a document, the tool can visualize them all right in its user interface.
+
* [[Sparse Image format|Sparse disk image (.spareimage)]]
 +
* [[Sparse Bundle Image format|Sparse bundle disk image (.sparsebundle)]]
  
; [[catdoc]]
+
== Burn Folder ==
: http://www.45.free.net/~vitus/software/catdoc/
+
  
; [[laola]]
+
Mac OS X Burn Folder:
: http://user.cs.tu-berlin.de/~schwartz/pmh/index.html
+
<pre>
 +
$NAME.fpbf
 +
</pre>
  
; [[word2x]]
+
This folder normally contains [[Mac OS X Alias Files|alias files]] (similar to LNK files under Windows). Which should have the following signature.
: http://word2x.sourceforge.net/
+
<pre>
 +
00000000  62 6f 6f 6b 00 00 00 00  6d 61 72 6b 00 00 00 00  |book....mark....|
 +
</pre>
  
; [[wvWare]]
+
These [[Mac OS X Alias Files|alias files]] contain additional date and time values.
: http://wvware.sourceforge.net/
+
: Extracts metadata from various [[Microsoft]] Word files ([[doc]]). Can also convert doc files to other formats such as HTML or plain text.
+
  
; [[Outside In]]
+
Also check the following files for references to deleted .fpbf paths:
: http://www.oracle.com/technology/products/content-management/oit/oit_all.html
+
<pre>
: Originally developed by Stellant, supports hundreds of file types.
+
/Users/$USERNAME/Library/Preferences/com.apple.finder.plist
 +
/Users/$USERNAME/Library/Preferences/com.apple.sidebarlists.plist
 +
</pre>
  
; [[FI Tools]]
+
Actual burning of optical media is logged in:
: http://forensicinnovations.com/
+
<pre>
: More than 100 file types.
+
/var/log/system.log
 +
/Users/$USERNAME/Library/Logs/DiscRecording.log
 +
/private/var/.logs_exporter/cache/Users/$USERNAME/Library/Logs/DiscRecording.log
 +
</pre>
  
=StickyNotes=
+
== HFS/HFS+ date and time values ==
; StickyNotes Parser
+
Windows 7 StickyNotes follow the [http://msdn.microsoft.com/en-us/library/dd942138%28v=prot.13%29.aspx MS Compound Document binary format]; the StickyNotes Parser extracts metadata (time stamps) from the OLE format, including the text content (not the RTF contents) of the notes themselves. Sn.exe also extracts the modified time of the Root Entry to the Compound Document; all times are displayed in UTC format
+
:http://code.google.com/p/winforensicaanalysis/downloads/list
+
  
=PDF Files=
+
In HFS+ date and time values are stored in an unsigned 32-bit integer containing the number of seconds since January 1, 1904 at 00:00:00 (midnight) UTC (GMT). This is slightly different from HFS where the date and time value are stored using the local time. The maximum representable date is February 6, 2040 at 06:28:15 UTC (GMT). The date values do not account for leap seconds. They do include a leap day in every year that is evenly divisible by four. This is sufficient given that the range of representable dates does not contain 1900 or 2100, neither of which have leap days. Also see: [http://web.archive.org/web/20090214212148/http://developer.apple.com/technotes/tn/tn1150.html Technical Note TN1150 - HFS Plus Volume Format]
  
; [[Belkasoft]] Evidence Center
+
Converting HFS/HFS+ date and time values with Python:
: http://belkasoft.com/
+
<pre>
: Extracts metadata from [[PDF]] files. Besides, can extract texts and embedded objects. For pictures, embedded into a PDF document, the tool can visualize them all right in its user interface.
+
import datetime
  
; [[xpdf]]
+
print datetime.datetime( 1904, 1, 1 ) + datetime.timedelta( seconds=0xCBDAF25B )
: http://www.foolabs.com/xpdf/
+
</pre>
: [[pdfinfo]] (part of the [[xpdf]] package) displays some metadata of [[PDF]] files.
+
  
 +
== Launch Agents ==
 +
System-wide:
 +
<pre>
 +
/Library/LaunchAgents
 +
/System/Library/LaunchAgents
 +
</pre>
  
(See [[PDF]])
+
Per user:
 +
<pre>
 +
/Users/$USERNAME/Library/LaunchAgents
 +
</pre>
  
=Images=
+
These directories contain  [[Property list (plist)]] files.
  
; [[Exiftool]]
+
== Launch Daemons ==
: http://www.sno.phy.queensu.ca/~phil/exiftool/
+
System-wide:
: Free, cross-platform tool to extract metadata from many different file formats. Also supports writing
+
<pre>
 +
/Library/LaunchDaemons
 +
/System/Library/LaunchDaemons
 +
</pre>
  
; [[jhead]]
+
These directories contain [[Property list (plist)]] files.
: http://www.sentex.net/~mwandel/jhead/
+
: Displays or modifies [[Exif]] data in [[JPEG]] files.
+
  
; [[vinetto]]
+
== Startup Items ==
: http://vinetto.sourceforge.net/
+
<pre>
: Examines [[Thumbs.db]] files.
+
/Library/StartupItems/
 +
/System/Library/StartupItems/
 +
</pre>
  
;[[libexif]]
+
== Crash Reporter ==
: http://sourceforge.net/projects/libexif EXIF tag Parsing Library
+
<pre>
 +
/Library/Application Support/CrashReporter
 +
</pre>
  
; [[Adroit Photo Forensics]]
+
== Diagnostic Reports ==
: http://digital-assembly.com/products/adroit-photo-forensics/
+
<pre>
: Displays meta data and uses date and camera meta-data for grouping, timelines etc.
+
/Library/Logs/DiagnosticReports
 +
</pre>
  
; Exif Viewer
+
== Quarantine event database ==
: http://araskin.webs.com/exif/exif.html
+
See [http://menial.co.uk/blog/2011/06/16/mac-quarantine-event-database/]
: Add-on for Firefox and Thunderbird that displays various [[JPEG]]/JPG metadata in local and remote images.
+
  
; exiftags
+
Snow Leopard and earlier
: http://johnst.org/sw/exiftags/
+
<pre>
: open source utility to parse and edit [[exif]] data in [[JPEG]] images. Found in many Debian based distributions.
+
/Users/$USER/Library/Preferences/com.apple.LaunchServices.QuarantineEvents
 +
</pre>
  
; exifprobe
+
<pre>
: http://www.virtual-cafe.com/~dhh/tools.d/exifprobe.d/exifprobe.html
+
SELECT datetime(LSQuarantineTimeStamp + 978307200, "unixepoch") as LSQuarantineTimeStamp, LSQuarantineAgentName, LSQuarantineOriginURLString, LSQuarantineDataURLString from LSQuarantineEvent;
: Open source utility that reads [[exif]] data in [[JPEG]] and some "RAW" image formats. Found in many Debian based distributions.
+
</pre>
  
; Exiv2
+
Lion and later
: http://www.exiv2.org
+
<pre>
: Open source C++ library and command line tool for reading and writing metadata in various image formats. Found in almost every GNU/Linux distribution
+
/Users/$USER/Library/Preferences/com.apple.LaunchServices.QuarantineEventsV2
 +
</pre>
  
; pngtools
+
== sleepimage ==
: http://www.stillhq.com/pngtools/
+
This file is similar to the hibernation file on Windows.
: Open source suite of commands (pnginfo, pngchunks, pngchunksdesc) that reads metadata found in [[PNG]] files. Found in many Debian based distributions.
+
<pre>
 +
/private/var/vm/sleepimage
 +
</pre>
  
; pngmeta
+
Also see: [http://osxdaily.com/2010/10/11/sleepimage-mac/]
: http://sourceforge.net/projects/pmt/files/
+
: Open source command line tool that extracts metadata from [[PNG]] images. Found in many Debian based distributions.
+
  
=General=
+
== Package Files (.PKG) ==
These general-purpose programs frequently work when the special-purpose programs fail, but they generally provide less detailed information.
+
Package Files (.PKG) are XAR archives [http://en.wikipedia.org/wiki/Xar_(archiver)] that contain a cpio archive and metadata [http://s.sudre.free.fr/Stuff/Ivanhoe/FLAT.html].
  
; [[Metadact-e]]
+
== Also see ==
: "Patented server-based metadata cleaning software that previews, cleans and converts documents in Microsoft Outlook, Web Access email, tablets and smartphones, as well as desktop-based documents."
+
* [[MacOS Process Monitoring]]
: http://www.litera.com/Products/Metadact-e.aspx
+
* [[Acquiring a MacOS System with Target Disk Mode]]
 +
* [[Converting Binary Plists]]
 +
* [[FileVault Disk Encryption]]
 +
* [[File Vault]]
  
; [[Metadata Extraction Tool]]
+
=== Formats ===
: "Developed by the National Library of New Zealand to programmatically extract preservation metadata from a range of file formats like PDF documents, image files, sound files Microsoft office documents, and many others."
+
* [[Basic Security Module (BSM) file format]]
: http://meta-extractor.sourceforge.net/
+
* [[Property list (plist)]]
  
; [[Metadata Assistant]]
+
== External Links ==
: http://www.payneconsulting.com/products/metadataent/
+
* [http://www.apple.com/macosx/ Official website]
 +
* [http://en.wikipedia.org/wiki/OS_X Wikipedia entry on OS X]
 +
* [http://menial.co.uk/blog/2011/06/16/mac-quarantine-event-database/ Quarantine event database]
 +
* [http://www2.tech.purdue.edu/cit/Courses/cit556/readings/MacForensicsCraiger.pdf Mac Forensics: Mac OS X and the HFS+ File System] by P. Craiger
 +
* [http://web.me.com/driley/iWeb/Previous_files/Directory_Services_Overview.pdf Mac OS X Directory Services Integration including Active Directory]
 +
* [http://digitalinvestigation.wordpress.com/2012/04/04/geek-post-nskeyedarchiver-files-what-are-they-and-how-can-i-use-them/ NSKeyedArchiver files – what are they, and how can I use them?]
 +
* [http://krypted.com/mac-os-x/command-line-alf-on-mac-os-x/ Command Line ALF on Mac OS X]
 +
* [http://newosxbook.com/DMG.html Demystifying the DMG File Format]
 +
* [https://code.google.com/p/mac-security-tips/wiki/ALL_THE_TIPS mac-security-tips]
  
; [[hachoir|hachoir-metadata]]
+
=== Apple Examiner ===
: Extraction tool, part of '''[[Hachoir]]''' project
+
* [http://www.appleexaminer.com/ The Apple Examiner]
 +
* [http://www.appleexaminer.com/MacsAndOS/Analysis/USBOSX/USBOSX.html USB Entries on OS X]
 +
* [http://www.appleexaminer.com/Downloads/MacForensics.pdf Macintosh Forensics - A Guide for the Forensically Sound Examination of a Macintosh Computer] by Ryan R. Kubasiak
  
; [[file]]
+
=== iCloud ===
: The UNIX '''file''' program can extract some metadata
+
* [http://support.apple.com/kb/HT4865?viewlocale=en_US&locale=en_US iCloud: iCloud security and privacy overview]
  
; [[GNU libextractor]]
+
[[Category:Mac OS X]]
: http://gnunet.org/libextractor/ The libextractor library is a plugable system for extracting metadata
+
[[Category:Operating systems]]
 
+
; [[Directory Lister Pro]]
+
: Directory Lister Pro is a Windows tool which creates listings of files from selected directories on hard disks, CD-ROMs, DVD-ROMs, floppies, USB storages and network shares. Listing can be in HTML, text or CSV format (for easy import to Excel). Listing can contain standard file information like file name, extension, type, owner and date created, but especially for forensic analysis file meta data can be extracted from various formats: 1) executable file information (EXE, DLL, OCX) like file version, description, company, product name. 2) multimedia properties (MP3, AVI, WAV, JPG, GIF, BMP, MKV, MKA, MPEG) like track, title, artist, album, genre, video format, bits per pixel, frames per second, audio format, bits per channel. 3) Microsoft Office files (DOC, DOCX, XLS, XLSX, PPT, PPTX) like document title, author, keywords, word count. For each file and folder it is also possible to obtain its CRC32, MD5, SHA-1 and Whirlpool hash sum. Extensive number of options allows to completely customize the visual look of the output. Filter on file name, date, size or attributes can be applied so it is possible to limit the files listed.
+
: http://www.krksoft.com
+
 
+
[[Category:Tools]]
+

Revision as of 13:08, 12 June 2014

Information icon.png

Please help to improve this article by expanding it.
Further information might be found on the discussion page.

Apple Inc.'s Macintosh OS X (pronounced "OS Ten") is the operating system distributed with Apple computers. It includes heavily used several programs by default, including Apple Mail, a web browser called Safari, and an Apple Address Book, and iCal.

Disk image types

Mac OS X has support for various disk image types build-in, some of which are:

Burn Folder

Mac OS X Burn Folder:

$NAME.fpbf

This folder normally contains alias files (similar to LNK files under Windows). Which should have the following signature.

00000000  62 6f 6f 6b 00 00 00 00  6d 61 72 6b 00 00 00 00  |book....mark....|

These alias files contain additional date and time values.

Also check the following files for references to deleted .fpbf paths:

/Users/$USERNAME/Library/Preferences/com.apple.finder.plist
/Users/$USERNAME/Library/Preferences/com.apple.sidebarlists.plist

Actual burning of optical media is logged in:

/var/log/system.log
/Users/$USERNAME/Library/Logs/DiscRecording.log
/private/var/.logs_exporter/cache/Users/$USERNAME/Library/Logs/DiscRecording.log

HFS/HFS+ date and time values

In HFS+ date and time values are stored in an unsigned 32-bit integer containing the number of seconds since January 1, 1904 at 00:00:00 (midnight) UTC (GMT). This is slightly different from HFS where the date and time value are stored using the local time. The maximum representable date is February 6, 2040 at 06:28:15 UTC (GMT). The date values do not account for leap seconds. They do include a leap day in every year that is evenly divisible by four. This is sufficient given that the range of representable dates does not contain 1900 or 2100, neither of which have leap days. Also see: Technical Note TN1150 - HFS Plus Volume Format

Converting HFS/HFS+ date and time values with Python:

import datetime

print datetime.datetime( 1904, 1, 1 ) + datetime.timedelta( seconds=0xCBDAF25B )

Launch Agents

System-wide:

/Library/LaunchAgents
/System/Library/LaunchAgents

Per user:

/Users/$USERNAME/Library/LaunchAgents

These directories contain Property list (plist) files.

Launch Daemons

System-wide:

/Library/LaunchDaemons
/System/Library/LaunchDaemons

These directories contain Property list (plist) files.

Startup Items

/Library/StartupItems/
/System/Library/StartupItems/

Crash Reporter

/Library/Application Support/CrashReporter

Diagnostic Reports

/Library/Logs/DiagnosticReports

Quarantine event database

See [1]

Snow Leopard and earlier

/Users/$USER/Library/Preferences/com.apple.LaunchServices.QuarantineEvents
SELECT datetime(LSQuarantineTimeStamp + 978307200, "unixepoch") as LSQuarantineTimeStamp, LSQuarantineAgentName, LSQuarantineOriginURLString, LSQuarantineDataURLString from LSQuarantineEvent;

Lion and later

/Users/$USER/Library/Preferences/com.apple.LaunchServices.QuarantineEventsV2

sleepimage

This file is similar to the hibernation file on Windows.

/private/var/vm/sleepimage

Also see: [2]

Package Files (.PKG)

Package Files (.PKG) are XAR archives [3] that contain a cpio archive and metadata [4].

Also see

Formats

External Links

Apple Examiner

iCloud