Difference between revisions of "Tools:Visualization"

From ForensicsWiki
Jump to: navigation, search
m (Graph and (Social) Network Visualization)
m (Processing.org)
 
(12 intermediate revisions by 3 users not shown)
Line 3: Line 3:
 
==Programming Languages and Developer Toolkits==
 
==Programming Languages and Developer Toolkits==
 
If you are building forensic tools, you probably want to start with one of these:
 
If you are building forensic tools, you probably want to start with one of these:
; Java and Swing
+
===Java===
: Advantage: Portable and lots of good documentation out there.
+
Advantage: Portable and lots of good documentation out there.
: Disadvantage: Programs are a bit verbose, and only offers about 1/2 the performance of C
+
  
; Python with tkinter
+
Disadvantage: Programs are a bit verbose, and only offers about 1/2 the performance of C
: Advantage: Portable
+
* [http://csbi.sourceforge.net/index.html Graph Interface Library (GINY)] - Java
: Disadvantage: Python is one of the slowest modern languages around.
+
* [http://hypergraph.sourceforge.net/ HyperGraph] - Hyperbolic trees, in Java. Check out the home page. Try clicking on the logo...
 +
* [http://ivtk.sourceforge.net/ InfoViz Toolkit] - Java, originally developed at [[INRA]].
 +
* [https://jdigraph.dev.java.net/ Jdigrah] - Java Directed Graphs.
 +
* [http://jgrapht.sourceforge.net/ JGraphT] - A Java visualization kit designed to be simple and extensible.
 +
* [http://prefuse.sourceforge.net/ Perfuse] - A Java-based toolkit for building interactive information visualization applications
 +
* [http://www.ssec.wisc.edu/~billh/visad.html#intro VisAD] - A Java component library for interactive and collaborative visualization.
 +
* [http://www.softwaresecretweapons.com/jspwiki/Wiki.jsp?page=LinguineMaps Linguine Maps] - An open-source Java-based system for visualizing software call maps.
 +
* [http://zvtm.sourceforge.net/index.html Zoomable Visual Transformation Machine] - Java. Originally started at Xerox Research Europe.
 +
* [http://openmap.bbn.com/ OpenMap] A Java-based Geographical Information System framework, from [[BBN]].
  
; Python with wxWidgets
+
===Python===
: Advantage: Portable and a better development environment than tkiner
+
Advantage: Portable
: Disadvantage: wxWidgets is not installed by default, so you'll need to get it installed. Not as well documented as Tkinter
+
  
; [http://www.pyside.org Python with Qt (PySide)]
+
Disadvantage: Python is one of the slowest modern languages around and doesn't work well with big data sets.
: Advantage: Portable and a better development environment than tkiner or wxWidgets
+
* Python with Tk
: Disadvantage: Though not difficult, PySide has to be installed separately
+
* Python with matplotlib
 +
* Python with wxWidgets (not installed by default)
 +
* [http://networkx.lanl.gov/ NetworkX], a pure Python network layout program which uses matplotlib to do the actual graphing.
  
; [http://processing.org processing.org]
+
===Processing.org===
: Advantage: Programming language specifically developed for visualization; compiles to java byte code
+
Advantage: Programming language specifically developed for visualization; compiles to java byte code
: Disadvantage: Very oddball
+
  
; JavaFX - Java's version of Flash
+
Disadvantage: Very oddball
 +
*  [http://processing.org processing.org] and
  
; Flash
+
===JavaScript===
 +
Browsers are now very fast and there are a large number of data plotting systems built on JavaScript. Check out:
 +
* [http://processingjs.org processingjs.org]
 +
* [http://highcharts.com/ Highcharts JS]
 +
* [http://mbostock.github.com/d3/ D3 - Data Driven Documents] - A visualization library for the Web.
 +
* [http://key-lines.com KeyLines] - Commercially licensed visualization library for networks/graphs.
  
Or you could try one of these higher-level toolkits:
+
===C/C++===
 +
* [http://www.vtk.org/ The Visualization Toolkit] - C++ multi-platform with interfaces available for Tcl/Tk, Java and Python.
 +
 
 +
== Applications ==
 +
Most of these applications can be used to do visualization
  
 
; Crystal Space 3D
 
; Crystal Space 3D
Line 33: Line 50:
 
; Panda#D
 
; Panda#D
  
== Applications ==
+
===Data Plotting Applications===
Most of these are scriptable.
+
===Open Source===
+
====Data Plotting====
+
 
* http://ploticus.sourceforge.net
 
* http://ploticus.sourceforge.net
 
* http://www.gnuplot.info/
 
* http://www.gnuplot.info/
* [http://www.opendx.org/ OpenDX] - Based on [[IBM]]'s Visualization Data Explorer for 3D, runs on [[Unix]]/X11/Motif. (2007)
 
 
* http://tulip.labri.fr/TulipDrupal/
 
* http://tulip.labri.fr/TulipDrupal/
  
====Graph and (Social) Network Visualization====
+
===Graph and (Social) Network Visualization===
* [http://code.google.com/p/boomslang/ Boomslang] --- A thin layer of python over matplotlib that makes it easier to do common plots.
+
 
* [http://www.cytoscape.org/ Cytoscape] - Cytoscape is an open source software platform for visualizing complex networks and integrating these with any type of attribute data.  
 
* [http://www.cytoscape.org/ Cytoscape] - Cytoscape is an open source software platform for visualizing complex networks and integrating these with any type of attribute data.  
 
* [http://www.graphviz.org/ Graphviz] - Originally developed by the [http://public.research.att.com/areas/visualization/ AT&T Information Visualization Gorup], designed for drawing connected graphs of nodes and edges. Neato is a similar system but does layout based on a spring model. Can produce output as [[PostScript]], [[PNG]], [[GIF]], or as an annotated graph file with the locations of all of the objects — ideal for drawing in a GUI. Runs from the command line on [[Unix]], [[Windows]] and [[Mac]], although there is also a [http://www.pixelglow.com/graphviz/ MacOS GUI version].
 
* [http://www.graphviz.org/ Graphviz] - Originally developed by the [http://public.research.att.com/areas/visualization/ AT&T Information Visualization Gorup], designed for drawing connected graphs of nodes and edges. Neato is a similar system but does layout based on a spring model. Can produce output as [[PostScript]], [[PNG]], [[GIF]], or as an annotated graph file with the locations of all of the objects — ideal for drawing in a GUI. Runs from the command line on [[Unix]], [[Windows]] and [[Mac]], although there is also a [http://www.pixelglow.com/graphviz/ MacOS GUI version].
 
* [http://www.codeplex.com/nodexl NodeXL] - Free/open excel add-in extends the spreadsheet with network metrics and visualizations. (Only runs on Windows)
 
* [http://www.codeplex.com/nodexl NodeXL] - Free/open excel add-in extends the spreadsheet with network metrics and visualizations. (Only runs on Windows)
 
* [http://gephi.org/ Gephi] -Gephi is an interactive visualization and exploration platform for all kinds of networks and complex systems, dynamic and hierarchical graphs
 
* [http://gephi.org/ Gephi] -Gephi is an interactive visualization and exploration platform for all kinds of networks and complex systems, dynamic and hierarchical graphs
* http://graphstream-project.org/
+
 
 
* http://projects.skewed.de/graph-tool/ - graph-tool is an efficient python module for manipulation and statistical analysis of graphs (a.k.a. networks).  
 
* http://projects.skewed.de/graph-tool/ - graph-tool is an efficient python module for manipulation and statistical analysis of graphs (a.k.a. networks).  
* http://igraph.sourceforge.net/
+
* http://igraph.sourceforge.net/ - Integrates with R.
* http://nwb.cns.iu.edu/ - NetworkWorkbench, a workbench for network scientists.  
+
 
* http://socnetv.sourceforge.net/ - "Social Networks Visualizer (SocNetV) is a flexible and user-friendly tool for the analysis and visualization of Social Networks."
 
* http://socnetv.sourceforge.net/ - "Social Networks Visualizer (SocNetV) is a flexible and user-friendly tool for the analysis and visualization of Social Networks."
* [http://jung.sourceforge.net/ Java Universal Network/Graph Framework (JUNG)] - Graphing, [[data mining]], [[social network]] analysis, and other stuff.
+
* [https://sites.google.com/site/netdrawsoftware/home NetDraw] - "a free program written by Steve Borgatti for visualizing both 1-mode and 2-mode social network data."
* [http://bioinformatics.icmb.utexas.edu/lgl/ Large Graph Layout (LGL)] - A bioinformatics system from University of Texas. They really mean Large.
+
* [http://www.analytictech.com/netdraw/netdraw.htm NetDraw] - "a free program written by Steve Borgatti for visualizing both 1-mode and 2-mode social network data."
+
 
* [http://pajek.imfm.si/doku.php Pajek] - Windows program for drawing large networks.
 
* [http://pajek.imfm.si/doku.php Pajek] - Windows program for drawing large networks.
 
* [http://sourceforge.net/projects/sonia/ Social Network Image Animator (SoNIA)] - Originally developed at Stanford. Written in Java. Makes movies.  
 
* [http://sourceforge.net/projects/sonia/ Social Network Image Animator (SoNIA)] - Originally developed at Stanford. Written in Java. Makes movies.  
* [http://wilma.sourceforge.net/ WilmaScope] - Real-time animations of dynamic graph structures. Written in Java. Sophisticated force model with strings and attraction.
 
 
* [http://www.caida.org/tools/visualization/walrus/ Walrus] - A 3-d graph network exploration tool. Employs 3D hyperbolic displays and layout based on a user-supplied spanning tree.
 
* [http://www.caida.org/tools/visualization/walrus/ Walrus] - A 3-d graph network exploration tool. Employs 3D hyperbolic displays and layout based on a user-supplied spanning tree.
* [http://afterglow.sf.ne AfterGlowt] - A tool to convert CSV data into DOT descriptions with highly configurable instructions.
+
* [http://afterglow.sf.net AfterGlow] - A tool to simplify the generation of network graphs in GraphViz, Gephi, etc.  Designed for security visualizations.  
 
* http://tulip.labri.fr/TulipDrupal/ - Tulip is an information visualization framework dedicated to the analysis and visualization of relational data.  
 
* http://tulip.labri.fr/TulipDrupal/ - Tulip is an information visualization framework dedicated to the analysis and visualization of relational data.  
  
 
See also: http://en.wikipedia.org/wiki/Social_network_analysis_software
 
See also: http://en.wikipedia.org/wiki/Social_network_analysis_software
  
====Abandoned Social network Graphers====
+
Reas govisual diagram editor
(Abandoned means that it hasn't been updated since 2009)
+
reas.com
* [http://graphexploration.cond.org/ Guess: The Graph Exploration System] - Originally developed at HP, this is a large Jython/Java-based system that you can use for building your own applications. Distributed under GPL. (2007)
+
gdf.net
* [http://sourceforge.net/projects/ivc/ InfoVis Cyberinfrastructure] - Another graph drawing system written in Java. (2009)
+
* [http://www.andrew.cmu.edu/user/krack/krackplot.shtml Krackplot] - "KrackPlot is a program for network visualization designed for social network analysts." (2006; Windows only; no source, apparently)
+
* [http://www.sfu.ca/~richards/Multinet/Pages/multinet.htm MultiNet] - A data analysis package for drawing conventional data and graph data.
+
(2007)
+
* [http://developer.berlios.de/projects/nv2d/ NetVis 2D] - Another graph visualization and layout tool written in Java. (2005)
+
* [http://www.informatik.uni-bremen.de/uDrawGraph/en/uDrawGraph/uDrawGraph.html uDrawGraph]
+
* [http://ubietylab.net/ubigraph/ Ubigraph] - a tool for visualizing dynamic graphs. The basic version is free, and talks to Python, Ruby, PHP, Java, C, C++, C#, Haskell, and OCaml.  (2008)
+
  
====Computer Network Visualization====
 
* [http://tnv.sourceforge.net/ The Network Visualizer]
 
  
 
=== Commercial Graphic Applications and Tools===
 
=== Commercial Graphic Applications and Tools===
Line 91: Line 90:
 
* [http://www.clarifiednetworks.com/Clarified%20Analyzer Clarified Analyzer] - Visualizes Network Traffic and allows to drill down from visualizations to the packet level.
 
* [http://www.clarifiednetworks.com/Clarified%20Analyzer Clarified Analyzer] - Visualizes Network Traffic and allows to drill down from visualizations to the packet level.
  
== Visualization Toolkits and Libraries ==
 
===C/C++===
 
* [http://public.kitware.com/VTK/ The Visualization Toolkit] - C++ multi-platform with interfaces available for Tcl/Tk, Java and Python. Professional support provided by [http://www.kitware.com/ Kitware].
 
* [http://kdirstat.sourceforge.net/ KDirStat], an open source implementation of [http://www.cs.umd.edu/hcil/treemap-history/index.shtml Treemaps] written in C. (Treemaps are a visualization technique developed at the University of Maryland for visualizing large amounts of multi-dimensional data.)  You can find a copy of it in [http://www.derlien.com/ Disk Inventory X] and
 
===Java===
 
* [http://csbi.sourceforge.net/index.html Graph Interface Library (GINY)] - Java
 
* [http://hypergraph.sourceforge.net/ HyperGraph] - Hyperbolic trees, in Java. Check out the home page. Try clicking on the logo...
 
* [http://ivtk.sourceforge.net/ InfoViz Toolkit] - Java, originally developed at [[INRA]].
 
* [https://jdigraph.dev.java.net/ Jdigrah] - Java Directed Graphs.
 
* [http://jgrapht.sourceforge.net/ JGraphT] - A Java visualization kit designed to be simple and extensible.
 
* [http://prefuse.sourceforge.net/ Perfuse] - A Java-based toolkit for building interactive information visualization applications
 
* [http://www.ssec.wisc.edu/~billh/visad.html#intro VisAD] - A Java component library for interactive and collaborative visualization.
 
* [http://www.softwaresecretweapons.com/jspwiki/Wiki.jsp?page=LinguineMaps Linguine Maps] - An open-source Java-based system for visualizing software call maps.
 
* [http://zvtm.sourceforge.net/index.html Zoomable Visual Transformation Machine] - Java. Originally started at Xerox Research Europe.
 
* [http://openmap.bbn.com/ OpenMap] A Java-based Geographical Information System framework, from [[BBN]].
 
===JavaScript===
 
* [http://mbostock.github.com/d3/ D3 - Data Driven Documents] - A visualization library for the Web.
 
 
===Unclassified===
 
===Unclassified===
 
* [http://gravisto.fim.uni-passau.de/ Gravisto: Graph Visualization Toolkit] - An editor and toolkit for developing graph visualization algorithms.  
 
* [http://gravisto.fim.uni-passau.de/ Gravisto: Graph Visualization Toolkit] - An editor and toolkit for developing graph visualization algorithms.  
Line 113: Line 95:
 
* [http://touchgraph.sourceforge.net/ TouchGraph] - Library for building graph-based interfaces.
 
* [http://touchgraph.sourceforge.net/ TouchGraph] - Library for building graph-based interfaces.
  
==Journals and Conferences==
 
* [http://www.palgrave-journals.com/ivs/index.html Information Visualization Journal]
 
* [http://rw4.cs.uni-sb.de/~diehl/softvis/seminar/index.php?goto=seminar ACM Symposium on Software Visualization]
 
==Research Groups==
 
===Berkeley===
 
* [http://bailando.sims.berkeley.edu/infovis.html Bailando Visualization]
 
* [http://vis.berkeley.edu/ Berkeley Visualization Lab]
 
===Brown===
 
* [http://www.cs.brown.edu/people/rt/gd.html Roberto Tamassia's resources on Graph Drawing]
 
===Stanford===
 
* [http://window.stanford.edu/projects/rivet/ Rivet Project] (Visualization complex systems)
 
===UNM===
 
* [http://www.msi.umn.edu/user_support/scivis/scivis-list.html Scientific Visualization at the Supercomputing Institute]
 
===Wattenberg===
 
* [http://www.bewitched.com/ Bewitched], a one-man research group.
 
 
==See Also==
 
==See Also==
 +
* [[Network Data Visualizations]]
 
* [http://www-static.cc.gatech.edu/gvu/ii/resources/infovis.html GVU's Information Visualization Resources link farm]
 
* [http://www-static.cc.gatech.edu/gvu/ii/resources/infovis.html GVU's Information Visualization Resources link farm]
 
* [http://directory.google.com/Top/Science/Math/Combinatorics/Software/Graph_Drawing/ Google Directory of Graph Drawing Software]
 
* [http://directory.google.com/Top/Science/Math/Combinatorics/Software/Graph_Drawing/ Google Directory of Graph Drawing Software]
Line 138: Line 106:
 
* http://visant.bu.edu/
 
* http://visant.bu.edu/
 
* http://sourceforge.net/projects/touchgraph/
 
* http://sourceforge.net/projects/touchgraph/
 +
* [http://www.informatik.uni-rostock.de/~ct/ Christian Tominski]
  
 
CAIDA has 15+ years of work visualizing Internet topologies. You may find their tools to be useful:
 
CAIDA has 15+ years of work visualizing Internet topologies. You may find their tools to be useful:

Latest revision as of 15:41, 6 April 2013

Although not strictly for forensic purposes, visualization tools such as the ones discussed here can be very useful for visualizing large data sets. As forensic practitioners need to process more and more data, it is likely that some of the techniques implemented by these tools will need to be adopted.

Programming Languages and Developer Toolkits

If you are building forensic tools, you probably want to start with one of these:

Java

Advantage: Portable and lots of good documentation out there.

Disadvantage: Programs are a bit verbose, and only offers about 1/2 the performance of C

Python

Advantage: Portable

Disadvantage: Python is one of the slowest modern languages around and doesn't work well with big data sets.

  • Python with Tk
  • Python with matplotlib
  • Python with wxWidgets (not installed by default)
  • NetworkX, a pure Python network layout program which uses matplotlib to do the actual graphing.

Processing.org

Advantage: Programming language specifically developed for visualization; compiles to java byte code

Disadvantage: Very oddball

JavaScript

Browsers are now very fast and there are a large number of data plotting systems built on JavaScript. Check out:

C/C++

Applications

Most of these applications can be used to do visualization

Crystal Space 3D
Panda#D

Data Plotting Applications

Graph and (Social) Network Visualization

  • Cytoscape - Cytoscape is an open source software platform for visualizing complex networks and integrating these with any type of attribute data.
  • Graphviz - Originally developed by the AT&T Information Visualization Gorup, designed for drawing connected graphs of nodes and edges. Neato is a similar system but does layout based on a spring model. Can produce output as PostScript, PNG, GIF, or as an annotated graph file with the locations of all of the objects — ideal for drawing in a GUI. Runs from the command line on Unix, Windows and Mac, although there is also a MacOS GUI version.
  • NodeXL - Free/open excel add-in extends the spreadsheet with network metrics and visualizations. (Only runs on Windows)
  • Gephi -Gephi is an interactive visualization and exploration platform for all kinds of networks and complex systems, dynamic and hierarchical graphs
  • http://projects.skewed.de/graph-tool/ - graph-tool is an efficient python module for manipulation and statistical analysis of graphs (a.k.a. networks).
  • http://igraph.sourceforge.net/ - Integrates with R.
  • http://socnetv.sourceforge.net/ - "Social Networks Visualizer (SocNetV) is a flexible and user-friendly tool for the analysis and visualization of Social Networks."
  • NetDraw - "a free program written by Steve Borgatti for visualizing both 1-mode and 2-mode social network data."
  • Pajek - Windows program for drawing large networks.
  • Social Network Image Animator (SoNIA) - Originally developed at Stanford. Written in Java. Makes movies.
  • Walrus - A 3-d graph network exploration tool. Employs 3D hyperbolic displays and layout based on a user-supplied spanning tree.
  • AfterGlow - A tool to simplify the generation of network graphs in GraphViz, Gephi, etc. Designed for security visualizations.
  • http://tulip.labri.fr/TulipDrupal/ - Tulip is an information visualization framework dedicated to the analysis and visualization of relational data.

See also: http://en.wikipedia.org/wiki/Social_network_analysis_software

Reas govisual diagram editor reas.com gdf.net


Commercial Graphic Applications and Tools

  • aiSee Graph Layout Software - Supports 15 layout algorithms, recursive graph nesting, and easy printing. Runs on Windows, Linux, Solaris, NetBSD, and MacOS. 30-day trial and free registered versions available. Academic pricing available.
  • Geomantics - Geographical, Visualization and Graphics software. Runs on Windows.
  • Graphis 2D and 3D graphing software - Runs on Windows. Free 30-day evaluation copy available.
  • OpenViz and PowerViz - Both from Advanced Visual Systems, super high-end visualization toolkits. $$$$
  • Tom Sawyer Software Analysis, Visualizaiton, and Layout programs. - Heavy support for drawing graphs. Beautiful gallery. ActiveX, Java, C++ and .NET editions.
  • NetMiner - A comprehensive tool for Social Network Analysis. Runs on Windows, with a Linux version under development. $35 for "Express" student version, $250 for "Professional" student version, $950 for "Normal" "Professional" version.
  • UCINET - A comprehensive package for the analysis of social network data as well as other 1-mode and 2-mode data.
  • Logster - an ultra-easy software tool to visualize Apache-style logs on a world map.
  • Clarified Analyzer - Visualizes Network Traffic and allows to drill down from visualizations to the packet level.

Unclassified

See Also

CAIDA has 15+ years of work visualizing Internet topologies. You may find their tools to be useful: