Specific node type templates not rendering Ok

When I enable the Node Displays module, the node-type.tpl.php templates stop rendering in the right way.
Looking at the code, I see that the module is adding nd templates and node.tpl.php even when I'm not using the ND for this content type, so my node is rendered with node.tpl.php instead of node.tpl.php.

// Add nd-content_type-build_mode(-nid) template suggestion.
$vars['template_files'][] = 'nd';
$vars['template_files'][] = 'nd-'. $node->type;
$vars['template_files'][] = 'nd-'. $node->type .'-'. $node->build_mode;
$vars['template_files'][] = 'nd-'. $node->type .'-'. $node->build_mode .'-'. $node->nid;

// Break all the rendering if needed.
if (!$node->render_by_ds) {
    $vars['template_files'][] = 'node';
    return;
}

This seems to be a bug in the module, am I missing something?