AWS Re:Invent 2013

I recently spoke at amazon's "re:invent" conference regarding some observations on using dynamoDB (slides, pics, video). There was also discussion of some open source libraries I have released that we are currently using at smugmug for using dynamoDB:

• godynamo is a clean-room implementation of a dynamoDB sdk for Go. It is designed to be a complete sdk supporting amazon's aws v4 signing mechanism. The most notable difference is support for batch operations with request payloads of arbitrary size (amazon mandates preset upper bounds in the spec). This is achieved using Go's idiomatic concurrency support, that permits splitting arbitrarily-sized requests for concurrent dispatch in conformance with amazon's static limits.
• goawsroles is a library used by godynamo to permit support for IAM credentials to be safely updated in a long-running process.
• bbpd is an http proxy for dynamoDB that uses the above libraries. An http proxy allows credentialling and concurrency to be performed in a long-running process, so that callers can easily dispatch requests to dynamoDB, even if there is no native dynamoDB sdk for a caller's native programming toolchain.

last update 2013-11-17