This was broken for a while even though the Python version continued to work. This adds a test so it doesn't regress.