quickavro is a Python library for working with the Avro file format. The purpose of this library is to provide a high-performance interface in Python for reading/writing Avro files. The performance of Avro has been historically very poor in Python, so quickavro makes use of a Python C extension that directly interacts with the official Avro C API. quickavro is currently alpha quality.
API documentation and examples can be found at http://chrisrx.github.io/quickavro.
$ pip install quickavroIt is important to note, however, that until PyPi allows binary wheels for linux, setup.py will attempt to download and compile the dependencies when installing with pip install.
quickavro depends upon several C libraries:
They depend upon traditional build/config tools (cmake, autoconf, pkgconfig, etc), that sometimes make compiling this a nightmare so I ended up trying something a little different here and so far it is working well.
make vendor
make
make installThe vendor make target downloads and unpacks the source files for all the libraries, while the default make target build, calls Python setuptools/distutils to staticly compile these and creates a Wheel binary package. This removes the need for these libraries to be dynamically linked correctly and can trivially be packaged within the binary Wheel package without worries like if the header package has installed for the library.