Difference between pages "Bulk extractor" and "Training Courses and Providers"

From ForensicsWiki
(Difference between pages)
Jump to: navigation, search
m (Academic Publications)
 
(On-going / Continuous Training)
 
Line 1: Line 1:
== Overview ==
+
This is the list of Training Providers, who offer training courses of interest to practitioners and researchers in the field of Digital Forensics.   Conferences which may include training are located on the [[Upcoming_events]] page.
'''bulk_extractor''' is a computer forensics tool that scans a disk image, a file, or a directory of files and extracts useful information without parsing the file system or file system structures. The results can be easily inspected, parsed, or processed with automated tools. '''bulk_extractor''' also created a histograms of features that it finds, as features that are more common tend to be more important. The program can be used for law enforcement, defense, intelligence, and cyber-investigation applications.
+
  
bulk_extractor is distinguished from other forensic tools by its speed and thoroughness. Because it ignores file system structure, bulk_extractor can process different parts of the disk in parallel. In practice, the program splits the disk up into 16MiByte pages and processes one page on each available core. This means that 24-core machines process a disk roughly 24 times faster than a 1-core machine. bulk_extractor is also thorough. That’s because bulk_extractor automatically detects, decompresses, and recursively re-processes compressed data that is compressed with a variety of algorithms. Our testing has shown that there is a significant amount of compressed data in the unallocated regions of file systems that is missed by most forensic tools that are commonly in use today.
+
<b>PLEASE READ BEFORE YOU EDIT THE LIST BELOW</b><br>
 +
Some training providers offer on-going training courses that are available in an on-line "any time" format. Others have regularly scheduled training that is the same time each month. Others have recurring training but are scheduled at various times throughout the year. Providers training courses should be listed in alphabetical order, and should be listed in the appropriate section.  Non-Commercial training is typically offered by governmental agencies or organizations that directly support law enforcement.  Tool Vendor training is training offered directly by a specific tool vendor, which may apply broadly, but generally is oriented to the vendor's specific tool (or tool suite). Commercial Training is training offered by commercial companies which may or may not be oriented to a specific tool/tool suite, but is offered by a company other than a tool vendor.
  
Another advantage of ignoring file systems is that bulk_extractor can be used to process any digital media. We have used the program to process hard drives, SSDs, optical media, camera cards, cell phones, network packet dumps, and other kinds of digital information.
+
<i>Some training opportunities may be <u>limited</u> to <b>Law Enforcement Only</b> or to a specific audience.  Such restrictions should be noted when known.</i>
 +
== On-going / Continuous Training ==
 +
{| border="0" cellpadding="2" cellspacing="2" align="top"
 +
|- style="background:#bfbfbf; font-weight: bold"
 +
! width="40%"|Title
 +
! width="20%"|Date/Location
 +
! width="40%"|Website
 +
|-
 +
|- style="background:pink;align:left"
 +
! DISTANCE LEARNING
 +
|-
 +
|Basic Computer Examiner Course - Computer Forensic Training Online
 +
|Distance Learning Format
 +
|http://www.cftco.com
 +
|-
 +
|Linux Data Forensics Training
 +
|Distance Learning Format
 +
|http://www.onlineforensictraining.com/courses.html
 +
|-
 +
|SANS On-Demand Training
 +
|Distance Learning Format
 +
|http://www.sans.org/ondemand/?portal=69456f95660ade45be29c00b0c14aea1
 +
|-
 +
|Champlain College - CCE Course
 +
|Online / Distance Learning Format
 +
|http://online.champlain.edu/computer-forensics-digital-investigation/CFDI_440
 +
|-
 +
|National Center for Media Forensics
 +
|Distance and Concentrated Audio/Video/Image Forensics
 +
|http://cam.ucdenver.edu/ncmf
 +
|-
 +
|- style="background:pink;align:left"
 +
!RECURRING TRAINING
 +
|-
 +
|Evidence Recovery for Windows 7&reg; operating system;
 +
|First full week every month<br>Brunswick, GA
 +
|http://www.internetcrimes.net
 +
|-
 +
|Evidence Recovery for Windows 8&reg;
 +
|Second full week every month<br>Brunswick, GA
 +
|http://www.internetcrimes.net
 +
|-
 +
|Evidence Recovery for Windows Server&reg; 2008 and 2012
 +
|Third full week every month<br>Brunswick, GA
 +
|http://www.internetcrimes.net
 +
|-
 +
|}
  
==Output Feature Files==
+
==Non-Commercial Training==
 +
{| border="0" cellpadding="2" cellspacing="2" align="top"
 +
|- style="background:#bfbfbf; font-weight: bold"
 +
! width="40%"|Title
 +
! width="40%"|Website
 +
! width="20%"|Limitation
 +
|-
 +
|Defense Cyber Investigations Training Academy (DCITA)
 +
|http://www.dc3.mil/dcita/dcitaAbout.php
 +
|Limited To Certain Roles within US Government Agencies[http://www.dc3.mil/dcita/dcitaRegistration.php (1)]
 +
|-
 +
|Federal Law Enforcement Training Center
 +
|http://www.fletc.gov/training/programs/technical-operations-division
 +
|Limited To Law Enforcement
 +
|-
 +
|MSU National Forensics Training Center
 +
|http://www.security.cse.msstate.edu/ftc
 +
|Limited To Law Enforcement
 +
|-
 +
|IACIS
 +
|http://www.iacis.com/training/course_listings
 +
|Limited To Law Enforcement and Affiliate Members of IACIS
 +
|-
 +
|SEARCH
 +
|http://www.search.org/programs/hightech/courses/
 +
|Limited To Law Enforcement
 +
|-
 +
|National White Collar Crime Center
 +
|http://www.nw3c.org/ocr/courses_desc.cfm
 +
|Limited To Law Enforcement
 +
|-
 +
|}
  
bulk_extractor now creates an output directory that has the following layout:
+
==Tool Vendor Training==
;alerts.txt
+
{| border="0" cellpadding="2" cellspacing="2" align="top"
:Processing errors.
+
|- style="background:#bfbfbf; font-weight: bold"
;ccn.txt
+
! width="40%"|Title
:Credit card numbers
+
! width="40%"|Website
;ccn_track2.txt
+
! width="20%"|Limitation
:Credit card “track 2″ informaiton, which has previously been found in some bank card fraud cases.
+
|-
;domain.txt
+
|AccessData (Forensic Tool Kit FTK)
:Internet domains found on the drive, including dotted-quad addresses found in text.
+
|http://accessdata.com/training
;email.txt
+
|-
:Email addresses.
+
|ASR Data (SMART)
;ether.txt
+
|http://www.asrdata.com/forensic-training/overview/
;Ethernet MAC addresses found through IP packet carving of swap files and compressed system hibernation files and file fragments.
+
|-
;exif.txt
+
|ATC-NY (P2P Marshal, Mac Marshal)
:EXIFs from JPEGs and video segments. This feature file contains all of the EXIF fields, expanded as XML records.
+
|http://p2pmarshal.atc-nycorp.com/index.php/training http://macmarshal.atc-nycorp.com/index.php/training
;find.txt
+
|-
:The results of specific regular expression search requests.
+
|BlackBag Technologies (Mac Forensic Tools- BlackLight and SoftBlock)
;ip.txt
+
|https://www.blackbagtech.com/training.html
:IP addresses found through IP packet carving.
+
|-
;rfc822.txt
+
|Cellebrite (UFED)
:Email message headers including Date:, Subject: and Message-ID: fields.
+
|http://cellebrite.com/mobile-forensics-products/ufed-training.html
;tcp.txt
+
|-
:TCP flow information found through IP packet carving.
+
|CPR Tools (Data Recovery)
;telephone.txt
+
|http://www.cprtools.net/training.php
:US and international telephone numbers.
+
|-
;url.txt
+
|Digital Intelligence (FRED Forensics Platform)
:URLs, typically found in browser caches, email messages, and pre-compiled into executables.
+
|http://www.digitalintelligence.com/forensictraining.php
;url_searches.txt
+
|-
:A histogram of terms used in Internet searches from services such as Google, Bing, Yahoo, and others.
+
|e-fense, Inc. (Helix3 Pro)
;url_services.txt
+
|http://www.e-fense.com/training/index.php
:A histogram of the domain name portion of all the URLs found on the media.
+
|-
;wordlist.txt
+
|Guidance Software (EnCase)
:A list of all “words” extracted from the disk, useful for password cracking.
+
|http://www.guidancesoftware.com/computer-forensics-training-courses.htm
;wordlist_*.txt
+
|-
:The wordlist with duplicates removed, formatted in a form that can be easily imported into a popular password-cracking program.
+
|Micro Systemation (XRY)
;zip.txt
+
|http://www.msab.com/training/schedule
:A file containing information regarding every ZIP file component found on the media. This is exceptionally useful as ZIP files contain internal structure and ZIP is increasingly the compound file format of choice for a variety of products such as Microsoft Office
+
|-
 +
|Nuix (eDiscovery)
 +
|http://www.nuix.com.au/eDiscovery.asp?active_page_id=147
 +
|-
 +
|Paraben (Paraben Suite)
 +
|http://www.paraben-training.com/schedule.html
 +
|-
 +
|Software Analysis & Forensic Engineering (CodeSuite)
 +
|http://www.safe-corp.biz/training.htm
 +
|-
 +
|Technology Pathways(ProDiscover)
 +
|http://www.techpathways.com/DesktopDefault.aspx?tabindex=6&tabid=9
 +
|-
 +
|SubRosaSoft (MacForensicsLab)
 +
|http://www.macforensicslab.com/ProductsAndServices/index.php?main_page=index&cPath=2
 +
|-
 +
|Volatility Labs (Volatility Framework)
 +
|http://volatility-labs.blogspot.com/search/label/training
 +
|-
 +
|WetStone Technologies (Gargoyle, Stego Suite, LiveWire Investigator)
 +
|https://www.wetstonetech.com/trainings.html
 +
|-
 +
|X-Ways Forensics (X-Ways Forensics)
 +
|http://www.x-ways.net/training/
 +
|-
 +
|}
  
For each of the above, two additional files may be created:
+
==Commercial Training (Non-Tool Vendor)==
;*_stopped.txt
+
{| border="0" cellpadding="2" cellspacing="2" align="top"
:bulk_extractor supports a stop list, or a list of items that do not need to be brought to the user’s attention. However rather than simply suppressing this information, which might cause something critical to be hidden, stopped entries are stored in the stopped files.
+
|- style="background:#bfbfbf; font-weight: bold"
;*_histogram.txt
+
! width="40%"|Title
:bulk_extractor can also create histograms of features. This is important, as experience has shown that email addresses, domain names, URLs, and other informaiton that appear more frequently on a hard drive or in a cell phone’s memory can be used to rapidly create a pattern of life report.
+
! width="40%"|Website
 
+
! width="20%"|Limitation
Bulk extractor also creates a file that captures the provenance of the run:
+
|-
;report.xml
+
|Applied Security (Digital Forensics Training)
:A Digital Forensics XML report that includes information about the source media, how the bulk_extractor program was compiled and run, the time to process the digital evidence, and a meta report of the information that was found.
+
|http://www.appliedsec.com/forensics/training.html
 
+
|-
==Post-Processing==
+
|BerlaCorp iOS and GPS Forensics Training
 
+
|http://www.berlacorp.com/training.html
We have developed four programs for post-processing the bulk_extractor output:
+
|-
;bulk_diff.py
+
|Computer Forensic Training Center Online (CFTCO)
:This program reports the differences between two bulk_extractor runs. The intent is to image a computer, run bulk_extractor on a disk image, let the computer run for a period of time, re-image the computer, run bulk_extractor on the second image, and then report the differences. This can be used to infer the user’s activities within a time period.
+
|http://www.cftco.com/
;cda_tool.py
+
|-
:This tool, currently under development, reads multiple bulk_extractor reports from multiple runs against multiple drives and performs a multi-drive correlation using Garfinkel’s Cross Drive Analysis technique. This can be used to automatically identify new social networks or to identify new members of existing networks.
+
|CCE Bootcamp
;identify_filenames.py
+
|http://www.cce-bootcamp.com/
:In the bulk_extractor feature file, each feature is annotated with the byte offset from the beginning of the image in which it was found. The program takes as input a bulk_extractor feature file and a DFXML file containing the locations of each file on the drive (produced with Garfinkel’s fiwalk program) and produces an annotated feature file that contains the offset, feature, and the file in which the feature was found.
+
|-
;make_context_stop_list.py
+
|Cyber Security Academy
:Although forensic analysts frequently make “stop lists”—for example, a lsit of email addresses that appear in the operating system and should therefore be ignored—such lists have a significant problem. Because it is relatively easy to get an email address into the binary of an open source application, ignoring all of these email addresses may make it possible to cloak email addresses from forensic analysis. Our solution is to create context-sensitive stop lists, in which the feature to be stopped is presented with the context in which it occures. The make_context_stop_list.py program takes the results of multiple bulk_extractor runs and creates a single context-sensitive stop list that can then be used to suppress features when found in a specific context. One such stop list constructed from Windows and Linux operating systems is available on the bulk extractor website.
+
|http://www.cybersecurityacademy.com/
 
+
|-
== Download ==
+
|Dera Forensics Group
The current version of '''bulk_extractor''' is 1.3. It can be downloaded from http://digitalcorpora.org/downloads/bulk_extractor/
+
|http://www.deraforensicgroup.com/courses.htm
 
+
|-
== Bibliography ==
+
|e-fense Training
=== Academic Publications ===
+
|http://www.e-fense.com/training/index.php
# Garfinkel, Simson Simson, [http://simson.net/clips/academic/2013.COSE.bulk_extractor.pdf Digital media triage with bulk data analysis and bulk_extractor]. Computers and Security 32: 56-72 (2013)
+
|-
# Beverly, Robert, Simson Garfinkel and Greg Cardwell, [http://simson.net/clips/academic/2011.DFRWS.ipcarving.pdf "Forensic Carving of Network Packets and Associated Data Structures"], DFRWS 2011, Aug. 1-3, 2011, New Orleans, LA. BEST PAPER AWARD (Acceptance rate: 23%, 14/62)
+
|Forward Discovery, Inc.
#Garfinkel, S., [http://simson.net/clips/academic/2006.DFRWS.pdf Forensic Feature Extraction and Cross-Drive Analysis,]The 6th Annual Digital Forensic Research Workshop Lafayette, Indiana, August 14-16, 2006. (Acceptance rate: 43%, 16/37)
+
|http://www.forwarddiscovery.com
 
+
|-
===Tutorials===
+
|H-11 Digital Forensics
# [http://simson.net/ref/2012/2012-08-08%20bulk_extractor%20Tutorial.pdf Using bulk_extractor for digital forensics triage and cross-drive analysis], DFRWS 2012
+
|http://www.h11-digital-forensics.com/training/viewclasses.php
 +
|-
 +
|High Tech Crime Institute
 +
|http://www.gohtci.com
 +
|-
 +
|Infosec Institute
 +
|http://www.infosecinstitute.com/courses/security_training_courses.html
 +
|-
 +
|Intense School (a subsidiary of Infosec Institute)
 +
|http://www.intenseschool.com/schedules
 +
|-
 +
|MD5 Group (Computer Forensics and E-Discovery courses)(Dallas, TX)
 +
|http://www.md5group.com
 +
|-
 +
|Mile 2 (Security and Forensics Certification Training)
 +
|https://www.mile2.com/mile2-online-estore/classess.html
 +
|-
 +
|Mobile Forensics, Inc
 +
|http://mobileforensicsinc.com/
 +
|-
 +
|NetSecurity
 +
|http://www.netsecurity.com/training/registration_schedule.html
 +
|-
 +
|NID Forensics Academy (Certified Digital Forensic Investigator - CDFI Program)
 +
|http://www.nidforensics.com.br/
 +
|-
 +
|NTI (an Armor Forensics Company) APPEARS DEFUNCT
 +
|http://www.forensics-intl.com/training.html
 +
|-
 +
|Security University
 +
|http://www.securityuniversity.net/classes.php
 +
|-
 +
|Steganography Analysis and Research Center (SARC)
 +
|http://www.sarc-wv.com/training
 +
|-
 +
|Sumuri, LLC - Mac, Mobile, iLook Training
 +
|http://www.sumuri.com/index.php/features/training-and-events-calendar
 +
|-
 +
|SysAdmin, Audit, Network, Security Institute (SANS)
 +
|http://computer-forensics.sans.org/courses/
 +
|-
 +
|Teel Technologies Mobile Device Forensics Training
 +
|http://www.teeltech.com/tt3/training.asp
 +
|-
 +
|viaForensics Advanced Mobile Forensics Training
 +
|http://viaforensics.com/education/calendar/
 +
|-
 +
|Zeidman Consulting (MCLE)
 +
|http://www.zeidmanconsulting.com/speaking.htm
 +
|-
 +
|}

Revision as of 16:02, 10 April 2013

This is the list of Training Providers, who offer training courses of interest to practitioners and researchers in the field of Digital Forensics. Conferences which may include training are located on the Upcoming_events page.

PLEASE READ BEFORE YOU EDIT THE LIST BELOW
Some training providers offer on-going training courses that are available in an on-line "any time" format. Others have regularly scheduled training that is the same time each month. Others have recurring training but are scheduled at various times throughout the year. Providers training courses should be listed in alphabetical order, and should be listed in the appropriate section. Non-Commercial training is typically offered by governmental agencies or organizations that directly support law enforcement. Tool Vendor training is training offered directly by a specific tool vendor, which may apply broadly, but generally is oriented to the vendor's specific tool (or tool suite). Commercial Training is training offered by commercial companies which may or may not be oriented to a specific tool/tool suite, but is offered by a company other than a tool vendor.

Some training opportunities may be limited to Law Enforcement Only or to a specific audience. Such restrictions should be noted when known.

On-going / Continuous Training

Title Date/Location Website
DISTANCE LEARNING
Basic Computer Examiner Course - Computer Forensic Training Online Distance Learning Format http://www.cftco.com
Linux Data Forensics Training Distance Learning Format http://www.onlineforensictraining.com/courses.html
SANS On-Demand Training Distance Learning Format http://www.sans.org/ondemand/?portal=69456f95660ade45be29c00b0c14aea1
Champlain College - CCE Course Online / Distance Learning Format http://online.champlain.edu/computer-forensics-digital-investigation/CFDI_440
National Center for Media Forensics Distance and Concentrated Audio/Video/Image Forensics http://cam.ucdenver.edu/ncmf
RECURRING TRAINING
Evidence Recovery for Windows 7® operating system; First full week every month
Brunswick, GA
http://www.internetcrimes.net
Evidence Recovery for Windows 8® Second full week every month
Brunswick, GA
http://www.internetcrimes.net
Evidence Recovery for Windows Server® 2008 and 2012 Third full week every month
Brunswick, GA
http://www.internetcrimes.net

Non-Commercial Training

Title Website Limitation
Defense Cyber Investigations Training Academy (DCITA) http://www.dc3.mil/dcita/dcitaAbout.php Limited To Certain Roles within US Government Agencies(1)
Federal Law Enforcement Training Center http://www.fletc.gov/training/programs/technical-operations-division Limited To Law Enforcement
MSU National Forensics Training Center http://www.security.cse.msstate.edu/ftc Limited To Law Enforcement
IACIS http://www.iacis.com/training/course_listings Limited To Law Enforcement and Affiliate Members of IACIS
SEARCH http://www.search.org/programs/hightech/courses/ Limited To Law Enforcement
National White Collar Crime Center http://www.nw3c.org/ocr/courses_desc.cfm Limited To Law Enforcement

Tool Vendor Training

Title Website Limitation
AccessData (Forensic Tool Kit FTK) http://accessdata.com/training
ASR Data (SMART) http://www.asrdata.com/forensic-training/overview/
ATC-NY (P2P Marshal, Mac Marshal) http://p2pmarshal.atc-nycorp.com/index.php/training http://macmarshal.atc-nycorp.com/index.php/training
BlackBag Technologies (Mac Forensic Tools- BlackLight and SoftBlock) https://www.blackbagtech.com/training.html
Cellebrite (UFED) http://cellebrite.com/mobile-forensics-products/ufed-training.html
CPR Tools (Data Recovery) http://www.cprtools.net/training.php
Digital Intelligence (FRED Forensics Platform) http://www.digitalintelligence.com/forensictraining.php
e-fense, Inc. (Helix3 Pro) http://www.e-fense.com/training/index.php
Guidance Software (EnCase) http://www.guidancesoftware.com/computer-forensics-training-courses.htm
Micro Systemation (XRY) http://www.msab.com/training/schedule
Nuix (eDiscovery) http://www.nuix.com.au/eDiscovery.asp?active_page_id=147
Paraben (Paraben Suite) http://www.paraben-training.com/schedule.html
Software Analysis & Forensic Engineering (CodeSuite) http://www.safe-corp.biz/training.htm
Technology Pathways(ProDiscover) http://www.techpathways.com/DesktopDefault.aspx?tabindex=6&tabid=9
SubRosaSoft (MacForensicsLab) http://www.macforensicslab.com/ProductsAndServices/index.php?main_page=index&cPath=2
Volatility Labs (Volatility Framework) http://volatility-labs.blogspot.com/search/label/training
WetStone Technologies (Gargoyle, Stego Suite, LiveWire Investigator) https://www.wetstonetech.com/trainings.html
X-Ways Forensics (X-Ways Forensics) http://www.x-ways.net/training/

Commercial Training (Non-Tool Vendor)

Title Website Limitation
Applied Security (Digital Forensics Training) http://www.appliedsec.com/forensics/training.html
BerlaCorp iOS and GPS Forensics Training http://www.berlacorp.com/training.html
Computer Forensic Training Center Online (CFTCO) http://www.cftco.com/
CCE Bootcamp http://www.cce-bootcamp.com/
Cyber Security Academy http://www.cybersecurityacademy.com/
Dera Forensics Group http://www.deraforensicgroup.com/courses.htm
e-fense Training http://www.e-fense.com/training/index.php
Forward Discovery, Inc. http://www.forwarddiscovery.com
H-11 Digital Forensics http://www.h11-digital-forensics.com/training/viewclasses.php
High Tech Crime Institute http://www.gohtci.com
Infosec Institute http://www.infosecinstitute.com/courses/security_training_courses.html
Intense School (a subsidiary of Infosec Institute) http://www.intenseschool.com/schedules
MD5 Group (Computer Forensics and E-Discovery courses)(Dallas, TX) http://www.md5group.com
Mile 2 (Security and Forensics Certification Training) https://www.mile2.com/mile2-online-estore/classess.html
Mobile Forensics, Inc http://mobileforensicsinc.com/
NetSecurity http://www.netsecurity.com/training/registration_schedule.html
NID Forensics Academy (Certified Digital Forensic Investigator - CDFI Program) http://www.nidforensics.com.br/
NTI (an Armor Forensics Company) APPEARS DEFUNCT http://www.forensics-intl.com/training.html
Security University http://www.securityuniversity.net/classes.php
Steganography Analysis and Research Center (SARC) http://www.sarc-wv.com/training
Sumuri, LLC - Mac, Mobile, iLook Training http://www.sumuri.com/index.php/features/training-and-events-calendar
SysAdmin, Audit, Network, Security Institute (SANS) http://computer-forensics.sans.org/courses/
Teel Technologies Mobile Device Forensics Training http://www.teeltech.com/tt3/training.asp
viaForensics Advanced Mobile Forensics Training http://viaforensics.com/education/calendar/
Zeidman Consulting (MCLE) http://www.zeidmanconsulting.com/speaking.htm