Undefined index: panelizer during attach hook.

I have a situation where Taxonomy Manager's ajax keeps erroring on term save due to panelizer:

[Thu Apr 04 10:20:00 2013] [error] [client 127.0.0.1] PHP Notice: Undefined index: panelizer in /home/sam/www/gateway/docroot/sites/all/modules/contrib/panelizer/plugins/entity/PanelizerEntityDefault.class.php on line 1117, referer: http://gateway.local.com/admin/structure/taxonomy_manager/voc/topics
[Thu Apr 04 10:20:00 2013] [error] [client 127.0.0.1] PHP Stack trace:, referer: http://gateway.local.com/admin/structure/taxonomy_manager/voc/topics
[Thu Apr 04 10:20:00 2013] [error] [client 127.0.0.1] PHP 1. {main}() /home/sam/www/gateway/docroot/index.php:0, referer: http://gateway.local.com/admin/structure/taxonomy_manager/voc/topics
[Thu Apr 04 10:20:00 2013] [error] [client 127.0.0.1] PHP 2. menu_execute_active_handler() /home/sam/www/gateway/docroot/index.php:21, referer: http://gateway.local.com/admin/structure/taxonomy_manager/voc/topics
[Thu Apr 04 10:20:00 2013] [error] [client 127.0.0.1] PHP 3. call_user_func_array() /home/sam/www/gateway/docroot/includes/menu.inc:517, referer: http://gateway.local.com/admin/structure/taxonomy_manager/voc/topics
[Thu Apr 04 10:20:00 2013] [error] [client 127.0.0.1] PHP 4. ajax_form_callback() /home/sam/www/gateway/docroot/includes/menu.inc:0, referer: http://gateway.local.com/admin/structure/taxonomy_manager/voc/topics
[Thu Apr 04 10:20:00 2013] [error] [client 127.0.0.1] PHP 5. drupal_process_form() /home/sam/www/gateway/docroot/includes/ajax.inc:370, referer: http://gateway.local.com/admin/structure/taxonomy_manager/voc/topics
[Thu Apr 04 10:20:00 2013] [error] [client 127.0.0.1] PHP 6. form_execute_handlers() /home/sam/www/gateway/docroot/includes/form.inc:860, referer: http://gateway.local.com/admin/structure/taxonomy_manager/voc/topics
[Thu Apr 04 10:20:00 2013] [error] [client 127.0.0.1] PHP 7. taxonomy_manager_term_data_form_submit() /home/sam/www/gateway/docroot/includes/form.inc:1464, referer: http://gateway.local.com/admin/structure/taxonomy_manager/voc/topics
[Thu Apr 04 10:20:00 2013] [error] [client 127.0.0.1] PHP 8. taxonomy_form_term_submit_build_taxonomy_term() /home/sam/www/gateway/docroot/sites/all/modules/contrib/taxonomy_manager/taxonomy_manager.admin.inc:1679, referer: http://gateway.local.com/admin/structure/taxonomy_manager/voc/topics
[Thu Apr 04 10:20:00 2013] [error] [client 127.0.0.1] PHP 9. entity_form_submit_build_entity() /home/sam/www/gateway/docroot/modules/taxonomy/taxonomy.admin.inc:858, referer: http://gateway.local.com/admin/structure/taxonomy_manager/voc/topics
[Thu Apr 04 10:20:00 2013] [error] [client 127.0.0.1] PHP 10. field_attach_submit() /home/sam/www/gateway/docroot/includes/common.inc:7961, referer: http://gateway.local.com/admin/structure/taxonomy_manager/voc/topics
[Thu Apr 04 10:20:00 2013] [error] [client 127.0.0.1] PHP 11. panelizer_field_attach_submit() /home/sam/www/gateway/docroot/modules/field/field.attach.inc:871, referer: http://gateway.local.com/admin/structure/taxonomy_manager/voc/topics
[Thu Apr 04 10:20:00 2013] [error] [client 127.0.0.1] PHP 12. PanelizerEntityDefault->hook_field_attach_submit() /home/sam/www/gateway/docroot/sites/all/modules/contrib/panelizer/panelizer.module:231, referer: http://gateway.local.com/admin/structure/taxonomy_manager/voc/topics

The attached patch fixes this, but maybe this is something that should be fixed in taxonomy_manager?