This is a small suite of tools used to perform bitwise analysis of data and processes related to digital preservation.
There are Python and Java tools, both held under bitwiser-core/src/main.
The best and most recent version of the main tools for bitwise analysis are written in Python. The BitwiseAnalyser is designed to run a given command (those in the tools directory) on every possible bitwise permutation of an input file, and record whether and how the given process responds to the bit-level modification. There is also an additional Python tool to aid in the visualisation of those results.
More information about these tools, and about the kind of results that can be generated using them, see:
The Java codebase contains an older version of the bitwise analysis tools, but these have been largely superseded by the Python implementation. However, apart from that, the Java codebase contains utilities when performing low-level analysis of bitstreams, in particular:
- An Entropy class, based on the ent command source code, that calculates the Shannon entropy of a bitstream.
- An SSDeep class, based on the ssdeep source code, that can calculate the ssdeep fuzzy hash of a bitstream.
- Tools to help reverse engineer binary file formats
- Tupni: Automatic Reverse Engineering of Input Formats
- Follow up on http://www.openplanetsfoundation.org/comment/428#comment-428
- Merge in the shotgun approach, and make a UI/web tool?
- master - Main release branch.
- python - Old python development branch, now folded into master.
These tools were initially developed as part of the SCAPE Project: http://www.scape-project.eu/